I understand it perfectly because I am quite small for a guy, but I choose to act on it. Workout and boxing helped me a lot.
So I think you should find something that you like and follow it. Don't bother about the pressure that other people would put on your shoulders. If your said friends don't accept you like you are or try to use you then they are not friends. Sorry to break it to you