How to make part of your deed cultural?

I'm sorry if this has been asked already. Did not find anything.

Im in a Town and wanted to create a Gallery which adds to the culture of the town.
As far as i know, you can change some of your deed from residency to cultural to do this.
But when i tried it just said: 'Can't change property type when there are active residents. Try again once residents are removed.'

Does this mean in can only make my deed cultural if i leave it? Which i dont want to.
Or can i claim a second Deed within the town which is not adjacent to my homestead and make this cultural?

Thanks for the help