docker ps was a confusing command for me, because I thought that it would show all containers by default. But trying to run a container that has been stopped will give you a an error that there is a container in use with that name. Running
docker ps will be fruitless because that container will not be listed by default.
You can easily view all your containers, running & stopped, with:
docker ps -a
H/T to the docs lol - https://docs.docker.com/engine/reference/commandline/ps/Tweet