That's a mistranslation. The correct translation was that Oden started visiting the Pleasure Hall, which is another terminology for the Entertainment district, which houses more than just brothels. It's theaters, restaurants, gambling dens, Kabuki, Vocal music, festivals, Sumo events, etc...