If they chose to leave you, it's both. They might not care the same way, but they lose out on you - what you are, what you become.

[That's what he tells himself, and wants to believe.]

But you lose them too. The parts of them you liked, most of all.