It was kinda a flippant post, but I do actually believe he was a pirate.
His clothing looks rough, not what you would think of as royal. In real life striped pants are pirate 101, I think even in this manga these striped patterns and baggy pants are usually seen on pirates, like Don Sai and...