Install (and troubleshoot) Docker on Centos 8

I recently stumbled upon troubles ¹ trying to run Docker on a fresh CentOS 8 install. Here my notes to spare your (and my) time: