[2019] How to delete Single player character and game world?

In the Single Player / Host menu, to the right-hand side of the 'ATLAS' title, you'll see a button to delete the save file.