'To get something you never had, you have to do something you never did.' When God takes something from your grasp, He's not punishing you, but merely opening your hands to receive something better. Concentrate on this sentence... 'The will of God will never take you where the Grace of God will not protect you.'
There comes a point in your life when you realize:
Who never did,
Who won't anymore...
And who always will.
So, don't worry about people from your past,
there's a reason why they didn't make it to your future.