I could see Yamato eventually having to admit that she doesn’t think he’s strong enough to be a defender due to his failure with the Admiral, which would would his pride, like Zoro said.
That would def push him to prove himself and power up from there. Oda powered up Koby and Tama rather quick, so it’s only a matter of time he powers up as well.