Yeah, basically Doffy was more practical in his evil. Most of the citizens he had turned into toys were rebels or enemies or those who found out a little too much about his plans. He wasn't about to just wreck a house and randomly murder if it served no greater purpose, like Kaido was doing for years. Doffy used evil brutality to conquer Dressrosa and then allowed its passive subjects to live peacefully so long as they followed his rule about toys. And his Bird Cage lunacy, while stupid and a terrible plot point, only occurred when his rule over the kingdom started to fall apart because of the Straw Hats' intervention. Doffy was an evil asshole, but his evil motives were believable and served a purpose: to increase his own influence and the status of his crew. Anything that didn't contribute to that was pointless, and random tortureporn wasn't going to accomplish anything.
Meanwhile Kaido planned to drop his entire fucking main base on the only prosperous city and the economic capital of his entire country because naked dancing man shat in his bowl of cheerios that one time a couple of decades ago.