I don’t think so. So far, all of Luffy’s opponents were villains who didn’t take it seriously until the end. His first real test will be against Saturn.
On top of that, we’ve seen time to time where Luffy was at the most vulnerable against a Blade user. Even a weakened and tired Kaido said G5 Luffy was affected by his slash so imagine that with Mihawk, Shanks and Nusjuro with blitzkrieg fight style and has zero tolerance for goofy behavior?
That’s why I believe Luffy is only a threat because of Joyboy’s DF ability of making people side with him like Mihawk, Ace and Sabo said. Not his strength.