Lanji being scared is natural, arms crossed Zoro telling everyone that the bridge is a bottleneck and a death sentence for cowards like Barkji is also normal.
And not letting Zoro go is smart because he would surely get lost
Lets see whats the actual translation for Zoro's sentence cuz it doesn't leave that much of a good look