Fujitora didn't even show any skills of a swordsman lmao xDD.
The only thing he did with his sword alone was blocking attacks from Luffy and to block attacks like that, a stick will be enough. A spear, a shield, etc etc, any kind of weapons or object in general actually.
So how is this fight supposed to be balanced against a rival in his tier with all his power? Yeah, he has his Hakis, his basic strength, his speed, durability, but he lacks the power. He can only defend for a time but can't counterattack, he can't clash directly against Oden, he can't deflect his attacks with his own power and even if he connects an attack, the power behind it would be lacking (unless we see for example Base Luffy hurting Kaido with advanced CoA), and anyway, even with that, Oden would still win.
Oden, Fujitra = Admiral lvl = 100 points
Oden with his basic strength (Hakis, swordsmanship, basic stats, etc)= 100 points
Fujitora = devil fruit + his basic strength (Hakis, basic stats, etc) = 100 points
Fujitora without devil fruit << 100 points