Both Doflamingo and Smoker questioned Aokiji about what his status in the World is. Smoker went as far as to ask him if he had black market connections, and the Marines were shocked Smoker would ask him such a thing, as he used to be a former Admiral.
Tell me. If the World knew Aokiji was a Blackbeard Commander at the time, then why are both Doffy and Smoker questioning where he stands? Why does Doffy refer to it as rumors?