Why would the solution be disabling ladders? That makes literally no sense to lock off pathways and areas. Just let the AI climb them, problem solved.
It's very easy to abuse AI that climbs ladders, they'd basically be lining up for free hits one after another, just like in Mount & Blade sieges :)