I don't know who these people are, who you are referring to, Champagne. . . but if they are not friends &/or family; & by that, I mean close friends (which this sort of behavior would - or should - rule out)... then I'd say it might be a good time to put your foot down, practice some resilience in the form of assertiveness, or being "assertive." And in so doing, doing what is right & best for you! : )
You don't want or need people in your life who do this sort of thing to you. It's hard enough as it is... We don't need any help from any one else!
One thing that might help, is if you could somehow take some lessons in 'not caring so much.' In other words, if you didn't place such emphasis, on how they feel or think about you - and I don't know if this is just gossip on the lighter side / as in funny jokes & such, at your expense however / or if it is more deeply rooted & seeded animosities that are rearing their ugly head. Regardless, and either way - I'd try to gut them from out of my life if I were you. Again, a little harder to do if they're already tied by bonds such as family or friends of other circumstance (that makes it difficult to avoid interaction).
But what's happening, or what you're doing in this breakdown (mini) of sorts, when all the smack talk goes down, is giving them WAY Too Much Power over you & your livelihood, or happiness - in life. That's just in my opinion, o.k.? No problem if you disagree. I just think the situation would get, or be a whole lot easier if you were to care a whole lot less, about what 'they,' say & think & do & feel. Maybe they enjoy living their lives like they're in a TV Drama geared towards teens? Who knows!
Hopefully, you get - my point! And no worries if ya don't..
peace~