I actually think of that a lot. If I was dead the world would keep spinning, people would continue doing their things, etc. Like you, I don't think my demise would be a big loss to the world.
I don't really know what to say. But I just wanted to let you know that you're not alone with this feeling.
IMO though, any person's suicide would affect someone else one way or the other, whether he/she knows them personally or not. The person who finds the body would be affected, neighbours would be affected, the shopkeeper whose shop the deceased frequent would be affected, etc.