With the build menu open, you can remove blueprints by right-clicking them.
To remove things you have built, you need to deconstruct them with the clear/remove job in the jobs menu. With the job selecting left-click the desired object you want to deconstruct. Someone with the deconstruct skill enabled will come and remove it.