Yes, Luffy is fighting him now 1v1, but WG cannot erase the fact that there were 4 people who helped him at first and there's still no assurance that he'll fight him alone up until the end...
In WB's case, BB's crew ganging up to him still is the final factor why he died...