You’re personalizing a situation when you shouldn’t be. People are free to come and go as they please. This is no reflection on you.