-Apoo's attacks take too long to prepare. The guy has to make an entire song for a single attack by playing his entire body. We've seen this twice, once with Kizaru and now with Luffy/Zoro. Both of the times he was lucky that the opponent was standing curious about what he was going to do. If they rushed him, he'd have been at a loss.
-Apoo is surprised easily and lacks defences, including observation haki. This is one of the things that made people downplay Apoo. Notably the 3D2Y part where Apoo was running from Boars. And now, Kid. Apoo lost his shit when Kid came after him. Rather than sensing a big ass arm coming towards him, Apoo couldn't detect him with his observation haki. Which is a major flaw.
Even after Kid came for him, Apoo didn't have any decent defences to resort to. Instead, Apoo just screeched and had no choice but to take the hit. Also filling in the fact that he doesn't have many defensive attacks on the reserve.