Everyone can react to meteors, we literally see them falling down from outer space. Doffy reacted to them and cut them with his strings, same with Law. The Pica Golem was more massive than meteors and Zoro cut him into pieces. Apart from that, it would be pointless to use meteors in a 1 on 1 because of their collateral damage. Unless Fujitora is hundreds of meters away and drops them.