He wasn't holding back. He was in sorrow (Vergo), anger (Law), stress (Kaido), anguish (his lifes work Dressrosa), pressed (Fujitora), split minded (crew mates at risk), unsure (Luffy playing hero) and probably more.
He had to keep up Bird Cage (I think that, same as Kaidos carrying Onigashima...