Kaido and king didnt go there expecting to find the RHP so no they didnt challenge them ( its headcanon on your part) and the fact that King wasnt defeated reinforces the aspects of them backing down from the fight as they were only 2 against a whole crew.
And Kaido and King were planning on challenging Marineford IIRC, so it changes nothing.