Now we Know why Kaidou assumed he is the strongest. He stayed for 25 years in Wano, only fighting guys like Shuten Maru, Kyoshiro, Tama.
It's like I would assume that I'm would be World's strongest because I'm the strongest person in my neighbourhood