Nobody got issue with Xebec or WB being attracted to a woman, it's the way it is expressed that is absolute sad. They behave like random fodders, it makes them appear like they have zero willpower.
See pre-ts
Aokiji is clearly straight but he didn't start go heart eyes over Hancock during MF.