It's just how Oda handles top tiers he doesn't want in action yet. BB runs away because he doesnt want to get hurt or lose his crew unnecessarily, Mihawk walks away because he isn’t interested, Shanks with his whole crew challenges people that he knows won't fight him at that moment etc