[2020] Please can you make the settlers/ raiders actually give a damn when an enemy enters their settlements?

Every now and then enemies walk up to these settlements and everyone just kinda stands there ignoring them walking about. Oh a scorched came to the settlement, let's just continue our normal daily activities and ignore the safety of our residents.

A raider is in our camp? Let's not even attempt to reason with him and let him walk out with Ward's stolen equipment. Ward should really keep his high value items locked up.

It kinda breaks the immersion a bit and I wish that a few people within these settlements would actually attack back to eliminate threats to their community.