{"id":3871,"date":"2023-09-01T19:59:12","date_gmt":"2023-09-01T19:59:12","guid":{"rendered":"https:\/\/geekmungus.co.uk\/?p=3871"},"modified":"2023-09-01T19:59:13","modified_gmt":"2023-09-01T19:59:13","slug":"docker-basics","status":"publish","type":"post","link":"https:\/\/geekmungus.co.uk\/?p=3871","title":{"rendered":"Docker Basics"},"content":{"rendered":"\n

Containerisation is an increasingly popular method to deploy and run applications on both your computer but also for enterprise applications. Containerisation essentially bundles an application’s code with all the files and libraries it needs to run.<\/p>\n\n\n\n

Having a layer of abstraction like this means that as long as you are running the same Operating System, then everything else is essentially taken care of, meaning you don’t need to worry about matching loads of different dependencies, packages and libraries within the environment that your application runs, that is all taken care of by the container.<\/p>\n\n\n\n

In my previous article: Docker Install on Ubuntu 22.04.2 LTS<\/a> we went through the installation of Docker on a Linux machine, in this article we’ll go into more depth <\/p>\n\n\n\n

Running a Docker Container<\/h2>\n\n\n\n

Let’s start with a simple example. We first need to create the container, to do this we’ll run the following command to create the hello-world container. Note that this does not run the container, it just retrieves it from the image registry (more on this later) and readies it to be run.<\/p>\n\n\n\n

docker container create hello-world:linux<\/code><\/pre>\n\n\n\n
All being well you should see an alphanumeric string showing that it has been downloaded and saved successfully.<\/p>\n\n\n\n
Let’s run the following, it will normally show running containers, in our case we’ve not started any; but we’ve added the “-a” so it will show all containers running or otherwise.<\/p>\n\n\n\n
docker ps -a<\/code><\/pre>\n\n\n\n
And in the output we can see:<\/p>\n\n\n\n
ubuntu@development:~$ docker ps -a\nCONTAINER ID   IMAGE                 COMMAND                  CREATED              STATUS                     PORTS     NAMES\n5625528d15d8   hello-world:linux     \"\/hello\"                 About a minute ago   Created                              romantic_snyder\n<\/code><\/pre>\n\n\n\n
Cool, that’s showing its created and ready, so lets run our container now. There’s three things you can do here, you can start the container with the terminal attached, or you can start the container without the terminal attached, but that means you need to examine the logs to see the output. Or you can use Docker Run to create the container, run it and attach to the terminal.<\/p>\n\n\n\n
Option 1 – Run Container without Terminal Attached<\/h3>\n\n\n\n
From the previous output take the Container ID, and run the following:<\/p>\n\n\n\n
docker container start 5625528d15d8<\/code><\/pre>\n\n\n\n
Assuming it runs okay, all you’ll get is that Container ID echoed back to you. To see what actually happened we then need to examine the logs with:<\/p>\n\n\n\n
docker logs 5625528d15d8<\/code><\/pre>\n\n\n\n
And we get the output as follows:<\/p>\n\n\n\n
\"\"<\/figure>\n\n\n\n
Option 2 – Run Container with Terminal Attached<\/h3>\n\n\n\n
The other approach is to run the container with the terminal attached as follows:<\/p>\n\n\n\n
docker container start --attach 5625528d15d8<\/code><\/pre>\n\n\n\n
\"\"<\/figure>\n\n\n\n
As you can see in this case the output is put straight to the screen, which option you choose, well, that is down to what your application needs.<\/p>\n\n\n\n
Option 3 – Use Docker Run<\/h3>\n\n\n\n
docker run hello-world:linux<\/code><\/pre>\n\n\n\n
As you’ll see with this you’ll get the result printed to the terminal. You’ll also notice that you didn’t need to refer to the Container ID, but what “Docker Run” does is to create the container and run it, which means you’ll end up with a number of containers created which you can see with “docker ps -a”, for example:<\/p>\n\n\n\n
\"\"<\/figure>\n\n\n\n
Running a Container in the Background<\/h2>\n\n\n\n
To run a container in the background use the below, referring to the Container ID from the examples above.<\/p>\n\n\n\n
docker run -d 5625528d15d8<\/code><\/pre>\n\n\n\n
Viewing Running Containers<\/h2>\n\n\n\n
To see containers as they are running you can use “docker ps”, this shows you containers that are currently running.<\/p>\n\n\n\n
docker ps<\/code><\/pre>\n\n\n\n
Cleaning-Up Old Containers<\/h2>\n\n\n\n
Okay, so we’ve run a few containers and there’s a few of them starting to build up, we want to clear these away now, as they aren’t needed anymore.<\/p>\n\n\n\n
So first run:<\/p>\n\n\n\n
docker ps -a<\/code><\/pre>\n\n\n\n
Then get the Container ID of the container you wish to delete, the container needs to be stop to run this.<\/p>\n\n\n\n
docker rm <Container ID><\/code><\/pre>\n\n\n\n
(Add a “-f”, so “docker rm -f <Container ID>” to remove a running container.)<\/p>\n\n\n\n
Stopping a Container<\/h2>\n\n\n\n
To stop a running container, you first obtain the Container ID, then run the following to stop the container from running.<\/p>\n\n\n\n
docker stop <Container ID><\/code><\/pre>\n\n\n\n
(Add a “-t” to force stop the container)<\/p>\n\n\n\n
Creating Your Own Docker Container<\/h2>\n\n\n\n
Let’s create a simple web-server container, so we can use it across the network in the following section. We’re not running Apache or the like, instead we’ll just use netcat to return a page to illustrate the point.<\/p>\n\n\n\n
Creating a Docker container, requires that you create a Dockerfile that specifies what the container will look like, i.e. what packages are needed and so forth in the form of an image. You then also need a specify the “Entrypoint” which is what is started when the container starts (in simple terms).<\/p>\n\n\n\n
nc-web-server.Dockerfile<\/em><\/p>\n\n\n\n
FROM ubuntu\n\nUSER root\nCOPY .\/nc-web-server.bash \/\n\nRUN chmod 755 \/nc-web-server.bash\nRUN apt -y update\nRUN apt -y install bash netcat\n\nUSER nobody\n\nENTRYPOINT [ \"\/nc-web-server.bash\" ]<\/code><\/pre>\n\n\n\n
Once created we now need to create the bash file that essentially behaves like a web server by responding to a request using netcat (nc) and gives a simple HTML page in response.<\/p>\n\n\n\n
nc-web-server.bash<\/em><\/p>\n\n\n\n
#!\/usr\/bin\/env bash\n\nwebserver() {\n  echo \"Netcat Web Server ready, access: http:\/\/localhost:5000 or http:\/\/<Server IP>:5000\"\n  \n  serveroutput=$(echo \"<html><body><p>Web Site Output: $(date)<\/p><\/body><\/html>\")\n  \n  length=$(wc -c <<< \"$serveroutput\")\n  \n  content=\"\\\nHTTP\/1.1 200 OK\nContent-Length: $((length-1))\n\n$serveroutput\"\n  \n  while true\n  do echo -ne \"$content\" | nc -l -p 5000\n  done\n}\n\nwebserver<\/code><\/pre>\n\n\n\n
Now we can build the Docker container image with:<\/p>\n\n\n\n
docker build -t nc-web-server -f nc-web-server.Dockerfile .<\/code><\/pre>\n\n\n\n
Let’s quickly explore this. So the “-t” names the image, the “-f” specifies the Dockerfile with the instructions to build the image, the full stop afterwards specifies the working directory of the build command, in this case the current directory (i.e. “.”) where it will be able to find the nc-web-server.bash file which is needed for the build.<\/p>\n\n\n\n
Once completed run the following to show the list of images:<\/p>\n\n\n\n
docker images<\/code><\/pre>\n\n\n\n
And there you can see the image has been created successfully and is ready to be run.<\/p>\n\n\n\n
\"\"<\/figure>\n\n\n\n
Running a Docker Container and Accessing Across the Network<\/h2>\n\n\n\n
In this example, we have a web server container called “nc-web-server”, the container is configured to listen on port 5000\/TCP, however we need to expose it to the outside world, i.e. expose it to your local network and to do that on another port. So when we run it we need to specify the ports with “-p”, so the format is Outside Port:Inside Port<\/em> and in this case: 8080:5000.<\/p>\n\n\n\n
docker run -d -p 8080:5000 nc-web-server<\/code><\/pre>\n\n\n\n
Once run, we should find that the web server is now listening on port 8080 on your machine’s IP address, in my case my machine’s IP address is 192.168.1.6, but in the below you can see its listening on 0.0.0.0:8080, what this means is any IP address on your machine.<\/p>\n\n\n\n
\"\"<\/figure>\n\n\n\n
Now let’s access the web server with a web browser…..and bingo, we’re in.<\/p>\n\n\n\n
\"\"<\/figure>\n\n\n\n
We now have our simple web server running in a docker container on our machine. Of course this is just an example, but you can see how this could be very useful. <\/p>\n\n\n\n
Imagine you have your web application within a Docker container, its currently running v1.0, you want to upgrade to v1.1, all you need to do is prepare a new container, test it, and when you’re ready swap the containers over; if you find a problem, just swap it back again!<\/p>\n\n\n\n
Persistence<\/h2>\n\n\n\n
So having a Docker container that you can just run and stop is fine, but what if you need data (files) to persist between you stopping and starting a container. Perhaps you want the container to pull in files as it starts, or you want it to perform an action and write a result for some future container to be able to use. <\/p>\n\n\n\n
No problem, that’s where persistence comes in. <\/p>\n\n\n\n
There are two ways to do this which we’ll explore in this section.<\/p>\n\n\n\n
    \n
  1. Mount a Local Directory<\/li>\n\n\n\n
  2. Using Docker Volumes<\/li>\n<\/ol>\n\n\n\n
    Option 1 – Mount a Local Directory<\/h3>\n\n\n\n
    Let’s run a basic Ubuntu container in this way and get it to echo some data to a file, which we’ll want to  persist after the container has finished running. Now, in your home directory on your machine, let’s create a directory which we’ll present within our container when it runs.<\/p>\n\n\n\n
    mkdir ~\/cont-data\ncd ~\/cont-data\n\ndocker run --rm --entrypoint sh -v \/home\/ubuntu\/cont-data:\/tmp ubuntu -c \"echo 'Persistent data' > \/tmp\/persist && cat \/tmp\/persist\"<\/code><\/pre>\n\n\n\n
    Okay so let’s examine the command above. The main part is the “-v \/home\/ubuntu\/cont-data:\/tmp” <\/em>argument, what this means is that the directory on our machine i.e. the \/home\/ubuntu\/cont-data<\/strong> is being mapped to the \/tmp <\/strong>directory within the container.<\/p>\n\n\n\n
    And what we can find is that there is a file within our home directory \/home\/ubuntu\/cont-data<\/strong> called “persist” which has the “Persistent data” text string within it. And this persists after the container finishes running.<\/p>\n\n\n\n
    It’s also worth noting that this is a 2 way synchronised directory. i.e. the file changed on the host is changed within what the container can see and vice versa.<\/p>\n\n\n\n
    Option 2 – Using Docker Volumes<\/h3>\n\n\n\n
    Another way to do this is to use a Docker Volume, this is similar to the previous method except you’re created an abstracted volume rather than just presenting a directory (into the container), thus allowing more separation from the host’s specifics (which may or may not exist). <\/p>\n\n\n\n
    The Docker Volume is also isolated from the host’s storage. If you need a persistent place to store data going to and from your container, but without needing to be seen or changed by your host system, this is an approach you can use.<\/p>\n\n\n\n
    docker volume create mydockervol<\/code><\/pre>\n\n\n\n
    Then run the container and this time rather than specifying a path (after the -v) you specify the name of the Docker volume, as so:<\/p>\n\n\n\n
    docker run –rm –entrypoint sh -v mydockervol:\/tmp ubuntu -c “echo ‘Persistent data’ > \/tmp\/persist && cat \/tmp\/persist”<\/p>\n\n\n\n
    Let’s see what it did:<\/p>\n\n\n\n
    docker volume ls<\/code><\/pre>\n\n\n\n
    And there you can see the Docker volume has been created:<\/p>\n\n\n\n
    ubuntu@development:~\/cont-data$ docker volume ls\nDRIVER    VOLUME NAME\nlocal     mydockervol\n<\/code><\/pre>\n\n\n\n
    If we wanted to see the actual data, we first need to find where the data really is with:<\/p>\n\n\n\n
    ubuntu@development:~\/cont-data$ docker volume inspect mydockervol\n[\n    {\n        \"CreatedAt\": \"2023-08-31T21:12:24+01:00\",\n        \"Driver\": \"local\",\n        \"Labels\": null,\n        \"Mountpoint\": \"\/var\/lib\/docker\/volumes\/mydockervol\/_data\",\n        \"Name\": \"mydockervol\",\n        \"Options\": null,\n        \"Scope\": \"local\"\n    }\n]\n<\/code><\/pre>\n\n\n\n
    Then with sudo we can actually show the directory and inspect the file within.<\/p>\n\n\n\n
    $ sudo -s\n# cd \/var\/lib\/docker\/volumes\/mydockervol\/_data\n# ls -la\ntotal 12\ndrwxrwxrwt 2 root root 4096 Aug 31 21:12 .\ndrwx-----x 3 root root 4096 Aug 31 21:12 ..\n-rw-r--r-- 1 root root   16 Aug 31 21:12 persist<\/code><\/pre>\n\n\n\n
    To delete the Docker volume all you need to run is a cheeky:<\/p>\n\n\n\n
    docker volume rm mydockervol<\/code><\/pre>\n\n\n\n
    Docker Container Registry<\/h2>\n\n\n\n
    A container image registry is a service that allows you to store images that you can then call upon and run the container at a later date. The Container image tags consists of its name, a colon and then its version (and it defaults to “latest” if no version number is provided.<\/p>\n\n\n\n
    Docker Hub is a registry you can use with the Docker. I’m going to assume that you’ve already setup a Docker Hub account, so if you’ve not done that go and do that now.<\/p>\n\n\n\n
    Login to Docker from Docker CLI<\/h3>\n\n\n\n
    To login run the following, enter your Docker Hub username and password:<\/p>\n\n\n\n
    docker login<\/code><\/pre>\n\n\n\n
    The credentials are saved into your home directory for future use.<\/p>\n\n\n\n
    Push an Image to the Registry<\/h3>\n\n\n\n
    We’ll take the image and then rename it, then we can upload it to the Docker Hub registry.<\/p>\n\n\n\n
    docker tag nc-web-server geekmungus\/nc-web-server:1.0.0\n\ndocker push geekmungus\/nc-web-server:1.0.0<\/code><\/pre>\n\n\n\n
    You’ll now see it start to upload:<\/p>\n\n\n\n
    ubuntu@development:~$ docker tag nc-web-server geekmungus\/nc-web-server:1.0.0\r\nubuntu@development:~$ docker push geekmungus\/nc-web-server:1.0.0\r\nThe push refers to repository [docker.io\/geekmungus\/nc-web-server]\r\n5ebe31cc7a4e: Pushed\r\nd96d02bfe339: Pushing [===============>                                   ]  12.71MB\/40.25MB\r\n5634744e4c7d: Pushed\r\n2182c773bb4b: Pushed\r\n1b9698f962dc: Mounted from library\/ubuntu\r<\/code><\/pre>\n\n\n\n
    When completed, we can then see it in the registry, ready for use.<\/p>\n\n\n\n
    \"\"<\/figure>\n\n\n\n
    If you want to upload a new version, just tag the image with an updated version number and then upload, for example geekmungus\/nc-web-server:1.0.1<\/strong> in my case.<\/p>\n\n\n\n
    Pull an Image from the Registry<\/h3>\n\n\n\n
    In this final task, we’ll pull an image from the registry. To ensure the (nc-web-server) image is not present in the local cache, we’ll delete it, we may need to stop the running container first, but then we’ll be able to pull down a new copy.<\/p>\n\n\n\n
    Firstly run “docker ps” and get the Container ID of any container that is using the nc-web-server image, then run the following command to stop it.<\/p>\n\n\n\n
    docker stop <Container ID><\/code><\/pre>\n\n\n\n
    Now delete the image:<\/p>\n\n\n\n
    docker images\ndocker rmi <Image Name><\/code><\/pre>\n\n\n\n
    (e.g. “docker rmi nc-web-server” or “docker rmi geekmungus\/nc-web-server”)<\/em><\/p>\n\n\n\n
    Right now we can pull down the image, let’s pull down the latest nc-web-server image we pushed up, so the image: geekmungus\/nc-web-server:1.0.1<\/strong><\/p>\n\n\n\n
    ubuntu@development:~$ docker pull geekmungus\/nc-web-server:1.0.1\r\n1.0.1: Pulling from geekmungus\/nc-web-server\r\ndb76c1f8aa17: Already exists\r\n978d20ea8b1d: Already exists\r\n639eb43d03dd: Already exists\r\n4f45d942f960: Already exists\r\n92c89c6f91e2: Already exists\r\nDigest: sha256:aaa4c84cf3273203a1e9acc96342bc437d200d63b482395f5c852f941bd9ba4a\r\nStatus: Downloaded newer image for geekmungus\/nc-web-server:1.0.1\r\ndocker.io\/geekmungus\/nc-web-server:1.0.1\n\r\nubuntu@development:~$ docker images\r\nREPOSITORY                    TAG       IMAGE ID       CREATED        SIZE\r\ngeekmungus\/nc-web-server      1.0.1     0f51daf29ec1   3 days ago     111MB\r\nubuntu                        latest    a2f229f811bf   4 weeks ago    69.2MB\r<\/code><\/pre>\n\n\n\n
    And there you go its been downloaded, and is available, for a quick test, lets fire up that container again:<\/p>\n\n\n\n
    docker run -d -p 8080:5000 geekmungus\/nc-web-server:1.0.1<\/code><\/pre>\n\n\n\n
    Check it is running:<\/p>\n\n\n\n
    ubuntu@development:~$ docker ps\r\nCONTAINER ID   IMAGE                            COMMAND                 CREATED         STATUS         PORTS                                       NAMES\r\n47e9b96e1b17   geekmungus\/nc-web-server:1.0.1   \"\/nc-web-server.bash\"   5 seconds ago   Up 4 seconds   0.0.0.0:8080->5000\/tcp, :::8080->5000\/tcp   kind_almeida\r<\/code><\/pre>\n\n\n\n
    And we can access the website:<\/p>\n\n\n\n
    \"\"<\/figure>\n\n\n\n
    Conclusion<\/h2>\n\n\n\n
    We’ve seen how to run some Docker containers to use functions of these applications, wrapping your application up in its own container can be very helpful in terms of deployment (you don’t have to worry about building the exact environment for the application to run in), but also in terms of its support and operation in the long term. For example, if you’re running your version 1.0 and want to upgrade to version 1.2, previously this would require a re-installation of the application, if anything went wrong rolling back the change may be very difficult; however with a container, you just stop the version 1.2 container and start the version 1.0 container again.<\/p>\n\n\n\n
    When you’re running at enterprise scale you’ll be using something like Docker Swarm or Kubernetes to manage the orchestration of containers and running them in a manageable way.<\/p>\n\n\n\n
    Stay tuned for further containerisation articles in future.<\/p>\n\n\n\n
    Image Attribution<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"
    Containerisation is an increasingly popular method to deploy and run applications on both your computer but also for enterprise applications. Containerisation essentially bundles an application’s code with all the files and libraries it needs to run. Having a layer of abstraction like this means that as long as you are running the same Operating System, … Read more<\/a><\/p>\n","protected":false},"author":4,"featured_media":3873,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[46],"tags":[],"class_list":["post-3871","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-docker"],"_links":{"self":[{"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/3871","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3871"}],"version-history":[{"count":21,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/3871\/revisions"}],"predecessor-version":[{"id":3901,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/3871\/revisions\/3901"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/media\/3873"}],"wp:attachment":[{"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3871"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3871"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3871"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}