Trees are a real menace

A hacky way to solve this would be to designate an empty room around the walls. Not great, but that should keep trees from spawning there.