[2021] Are Valheim worlds and characters saved online/cloud?

Yes, if you have Steam Cloud enabled. (Should be enabled by default)

Tbh I wouldn't trust Steam's Cloud Saves. Better back-up your Valheim Saves on a USB. If it has worked with the Cloud, you're good. If not, you've got a safety net.