I guess it boils down to who said it, what was said, and the situation it was said in. It if were me, I'd either have to do some self-reflection or I may need to drop that person like a hot potato.
Without knowing anything about you, I'm going to say you're not a bad person. I've had family members say what I thought were hurtful things to me at the time...but upon further reflection and talking to them, I found out they were just worried as hell about the direction my life was going in.