Fair enough, you think people are nice and caring, and think that you'd not feel guilty should you decide to keep the money for yourself.
And while I won't agree that billionaires actually put physical labour into their fortunes, they certainly put effort into it, and like every other person, they should be able to spend their money as they wish, be it owning a fleet of jets or making other people feel good.
It's about how WE feel about them, or are supposed to. We're supposed to venerate them as such fantastic individuals because they're helping others without needing to, giving amounts of money that none of us can. But we don't consider that they don't actually feel that loss; they're not sacrificing anything. Just like us giving a penny to a homeless man on the street, except we're not considered heroes for it.
Well, to reciever, the rich would be heroes, of course. As long as the fact that the rich could've given so much more is ignored, of course. I mean, we'd not think Superman was such a hero if he'd go "Fuck it, I'm not taking you further to the hospital", drop off the rescuee a few blocks away, and then fly away. I'm not saying he had to, obviously, but I AM saying that he's not being heroic enough to be venerated to the level that he is.