Losing parents and spouses might be something like choosing between death by musket or by arrows, all aboard a pirate ship like the Black Pearl. It's not your fault, though. Like frogs, people croak. I don't know what obligations you have toward your siblings, but none of the obligations include making someone else happy. I don't think any of us can control whether someone else is happy. I don't think any of us controls how or when another person stops being alive and begins being dead, except by acts of murder or warfare unlikely involved here. If you didn't kill anyone, then it's not your fault.
The fellas who are bugging you about it are perhaps operating from side agendas of some kind. Of course I can't know what these are, but it seems that whoever is doing this is unable to state their issue directly, and so presents you with innuendo instead. Yet where crooked crocodiles fill the water, all the best luck o' the English-speaking world may yet come to you anyway. Best wishes.