In many instances, people start bringing out your unglamorous past because they are threatened by a very promising future you will have compared to theirs. Guess what? Their opinions are theirs and they do not define you. So focus on dong excellence and being excellent. Hard to argue against that.