That is not him falling down.
He was knocked off his feet and falling back when Frankie hit him. He's saying is lower than the number standing next to him.
I miss seeing he's no longer falling back, he's back on his feet. We are looking almost parallel with his body and what have we seen, King and Queen who are several levels above him. That means we are looking up. Look at his face expression, that's not someone that's been knocked unconscious.
You still falling down in that scene we should be looking at the wall, not towards the sky.
The most important thing you have to remember is Oda decided to show Zoro and Luffy being thrown down towards him. They had to land somewhere and it's going to cause an impact. That impacts them landing on the number.