Voir la source de Tuto pour le déploiement des sites avec Docker

A la fin de ce tuto, vous pourrez déployer votre site (ou service) sur les serveurs du BR ! Ceci permet de profiter d'une infrastructure gratuite, performante et robuste !

Note : ce tutoriel peut être délicat, n'hésitez pas à contacter un BRman pour obtenir de l'aide.

= Comment déployer des conteneurs Docker sur l'infrastructure du BR =

== Overview ==

This tutorial will walk you through :
* How to convert your website to a Docker service
* How to build it automatically on Gitlab-CI
* How to deploy it automatically on our servers

== Requirements ==

* Basics of git (videos [https://git-scm.com/video/what-is-version-control here] or the beginning of [https://git-scm.com/book/en/v2 this awesome online book]) ;
* Basics of containers (see a really good explanation [https://www.docker.com/resources/what-container here]) and of docker-compose (see the getting-started [https://docs.docker.com/compose/gettingstarted/ here]) ;
* Basics of web (see an [https://developer.mozilla.org/en-US/docs/Learn/Getting_started_with_the_web/How_the_Web_works introduction] on MDN) ;
* Basics of gitlab-ci (reading the [https://docs.gitlab.com/ee/ci/ getting-started] is recommended) ;

== Existing architecture ==

A physical server called <code>endalcher</code> deploys and runs your container. It uses the following services to connect your service to the Internet:

* [https://docs.docker.com/compose/ docker-compose] to deploy the correct environment for your containers ;
* [https://docs.traefik.io/v1.7/ traefik] as a reverse proxy to serve your site behind your endpoint, it is configured [https://gitlab.binets.fr/br/docker-default-services here] ;
* nginx to serve your site to the outside world (as all the binets sites).

== How to convert your website to a Docker service ==

The exact procedure will be dependant on your project. An example can be found here : [https://gitlab.binets.fr/br/qdj/-/blob/master/deployment/Dockerfile?ref_type=heads qdj-Dockerfile]

A ''Docker container'' is an isolated machine on which you can run your website. In this step, we will help you convert you app to be Docker-ready. This basically means installing everything your app needs inside a linux computer. You'll need to install ''Docker'' on your computer first [https://docs.docker.com/desktop/install/windows-install/ windows-installer].

We assume your project is hosted on the [https://gitlab.binets.fr BR's gitlab instance]. Create a <code>deployment</code> directory at the root of your repository and create a file <code>Dockerfile</code> (with no extension) and a file <code>docker-compose.yaml</code> in it.

* Dockerfile
<source lang="yaml">
FROM hello-world
</source>

* docker-compose.yaml
<source lang="yaml">
# this is a docker-compose meant for local testing of the deployment image.
# for the real deployment, go to the docker-services BR gitlab project

version: "3"
services:
  app:
    build:
      context: ..
      dockerfile: deployment/Dockerfile
#    ports:
#      - "8000:8000"
</source>

Then open a terminal in this directory and type <code>docker compose up --build</code>. If everything went well, you see a nice message from Docker telling you everything is working !

Now, you need to make ''your'' app work in the docker container. For this, you need:

* To update the Dockerfile to install everything you need. The following works for a basic (Django) python app :
<source>
FROM python:3

# copies all the code inside the container
COPY . /my_super_project

WORKDIR /my_super_project
RUN pip install --no-cache-dir -r requirements.txt
CMD python3 manage.py runserver
</source>

* To update the docker-compose file to expose the port you need (uncomment the corresponding line in the dockerfile).

=== How to handle persistant data ===

If you app uses an external database or need to not lose some files accross resets, you should use ''docker volumes'' with or without a ''postgres'' image. The [https://gitlab.binets.fr/br/docker-services/-/blob/master/docker-compose.site-jtx.yml?ref_type=heads jtx-docker-compose] might help you understand what you need.

=== How to handle secrets  ===

Often your app has some secrets in a file (such as ''.env'') that is not in Git. DO NOT put it in git (or all your secrets will be stolen !). Later we are going to see how to securely make them available for the automatic gitlab build.

== Automatic build ==

We will you ''gitlab continuous integration'' to build your docker image directly on the BR's servers. Write the following into a file name <code>.gitlab-ci.yml</code> at the root of your repository :

<source lang="yaml"># Build docker image and upload to registry
variables:
  IMAGE_TAG: $CI_REGISTRY_IMAGE:$CI_PIPELINE_IID
  PROJECT: mySuperProject

docker:build:
  stage: build
  only: # put here the git branches you want the job to run on :
    - main
    - stable
  image: docker:stable
  services:
    - docker:dind
  variables:
    DOCKER_HOST: tcp://docker:2375/
    DOCKER_DRIVER: overlay2
    DOCKER_TLS_CERTDIR: '' # disables TLS in docker-in-docker (not needed)
  script:
    - docker login -u $CI_REGISTRY_USER -p $CI_REGISTRY_PASSWORD $CI_REGISTRY
    - docker build --pull --build-arg version=$CI_PIPELINE_IID -t $IMAGE_TAG -f deployment/Dockerfile .
    - docker push $IMAGE_TAG
</source>

As you commit this file to Gitlab, you should see a new job appear (or look under Build/jobs). Your image should build correctly (if not, it means something is not available to gitlab that is when you build on your computer. Read the job logs and try to fix it !)

=== Checking the image ===

This step is optional, but it is the easiest way to debug your image ! You can run it locally like so :

<source lang=bash>
docker login registry.binets.fr
docker run --rm registry.binets.fr/<nom.prenom>/<my-gitlab-repo>:<image>
</source>

Where <code>image</code> is the number of the image (available in <code>Gitlab -> Deploy -> Container registry</code>) and <code><nom.prenom>/<my-gitlab-repo></code> is the same as in your project Gitlab URL.

Typically, your app won't start because you forgot a secret file (see below how to manage that !).

== Automatic deployment ==

We will now add a second CI job to your repository to deploy your image. It will trigger ''another'' CI pipeline of [https://gitlab.binets.fr/br/docker-services br/docker-services]. This pipeline has the rights to deploy on <code>endalcher</code>, and do so using a <code>docker-compose.yaml</code> file. To trigger it, add the following to your <code>.gitlab-ci.yml</code>

<source lang=yaml>
docker:deploy:
  stage: deploy
  only:
    - stable
  image: debian:latest
  when: manual
  script:
    - apt-get update && apt-get install -y curl
    - curl --fail-with-body --request POST --form token=$TRIGGER_TOKEN --form ref=master --form variables[PROJECT]=$PROJECT --form variables[DOCKER_IMAGE]=$IMAGE_TAG https://gitlab.binets.fr/api/v4/projects/560/trigger/pipeline
</source>

Make sure the variable <code>PROJECT</code> in <code>.gitlab-ci.yml</code> is correct : our pipeline will deploy the file named <code>docker-compose.${PROJECT}.yaml</code>.

In order to create the correct <code>docker-compose.${PROJECT}.yaml</code> file, you will need to create a Merge Request on [https://gitlab.binets.fr/br/docker-services br/docker-services], or send a <code>docker-compose.yaml</code> file to a BRman. The [https://gitlab.binets.fr/br/docker-services br/docker-services] is full of examples and a basic one is explained below :

=== Extra parameters and secrets ===

You can also pass any parameter needed in the compose file by adding arguments to the cURL call like so : <code>--form variables[MY_SUPER_VARIABLE]="elle vaut 42!"</code>

If you want to pass secret environnements variables, store then in gitlab under <code>Settings/CI-CD/Variables</code> and make sure they are "protected" and "masked". Pass them like so <code>--form variables[MY_PASSWORD]=$PASSWORD_STORED_IN_GITLAB</code>.

Be aware that any secret passed this way is visible to the BR and everyone that has maintainer access to you repository ! If you need help setting up, don't hesitate to ask for help from the BR !

=== Secret files ===

''Be aware that any secret passed this way too is visible to the BR and everyone that has ''ANY'' access to you repository (because they can get the docker image) ! So only do this for a private registry or make sure your setting <code>Settings -> General -> Visibility, project features, permissions</code> only allows for registry access for members''

Another way to store secrets in your Gitlab repo is <code>Gitlab -> Settings -> CI-CD -> Secure-files</code>. You can upload any (small) secret file here and it will not be exposed ! You can downlod it at buildtime like so :

<source lang=yaml>
# Build docker image and upload to registry
docker:build:
  stage: build
  only:
    - main
    - stable
  image: docker:stable
  services:
    - docker:dind
  variables:
    DOCKER_HOST: tcp://docker:2375/
    DOCKER_DRIVER: overlay2
    # For disabling TLS in docker-in-docker (not needed)
    DOCKER_TLS_CERTDIR: ""
    # !!! where to download our secure .env file 
    SECURE_FILES_DOWNLOAD_PATH: "."
  script:
    # !!! download secure .env file
    - apk add --no-cache curl bash
    - curl --silent "https://gitlab.com/gitlab-org/incubation-engineering/mobile-devops/download-secure-files/-/raw/main/installer" | bash
    # build docker image
    - docker login -u $CI_REGISTRY_USER -p $CI_REGISTRY_PASSWORD $CI_REGISTRY
    - docker build --pull --build-arg version=$CI_PIPELINE_IID -t $IMAGE_TAG -f deployment/Dockerfile .
    - docker push $IMAGE_TAG
    - echo "=> pushed $IMAGE_TAG"
</source>

== Example ==

You want to deploy the QDJ site with docker, and bind it to the server name <code>qdj.binets.fr</code>. Your site is running on flask and uses a postgresql database.

=== Pre-existant configuration ===

You have a little <code>Dockerfile</code>:

<pre># Base image: python3
FROM python:3
WORKDIR /usr/src/app

# Install dependacies
COPY requirements.txt ./
RUN pip install --no-cache-dir -r requirements.txt

# Copy application files
COPY . .

EXPOSE 5000/tcp

# the command runs the migrations and then launches gunicorn to serve the app
CMD python -m flask db upgrade &amp;&amp; gunicorn -b :5000 qdj:app</pre>
You have the following <code>docker-compose.yaml</code>:

<source lang="yaml">version: '3.1'

services:
  db:
    # Use a small postgres image, as we don't need anything on this container
    image: postgres:alpine
    environment:
      POSTGRES_USER: qdj
      POSTGRES_PASSWORD: somepassword
      POSTGRES_DB: qdj
    # store the data on a persistent file
    volumes:
      - "qdj-data:/var/lib/postgresql/data"
    restart: always

  app:
    # Use the image from Dockerfile
    image: ${DOCKER_IMAGE}
    environment:
      FLASK_APP: qdj.py
      FLASK_ENV: production
      FLASK_DEBUG: 0
      DATABASE_URI: "postgresql://qdj:somepassword@db:5432/qdj"
      SECRET_KEY:
    # Tells to docker to start app after db (otherwise flask crashes)
    depends_on:
      - db
    # Always restart on crash
    restart: always
    
volumes:
  qdj-data:</source>
=== Production <code>docker-compose.yaml</code> ===

We will adapt your <code>docker-compose.yaml</code> file in order to bind your site to the hostname :

<ol>
<li>First let's connect your <code>app</code> container to the global network. We won't bind the <code>db</code> container to the global network to protect it from intruders. [[File:https://cloud.binets.fr/s/QTgY55AapFDTyyW/preview|Network graph in endalcher]] We will add network configuration to the <code>docker-compose.yaml</code>:
<ul>
<li><p>to enable the network <code>web</code>, we add at the bottom of the file:</p>
<source lang="yaml">networks:
  web:
    external: true</source></li>
<li><p>to connect <code>app</code> to the network <code>web</code>, we add to the <code>app</code> configuration:</p>
<source lang="yaml">networks:
  - web
  - default</source></li></ul>
</li>
<li><p>Then we can add labels to tell <code>traefik</code> to match the hostname to a packet going to <code>app</code>:</p>
<source lang="yaml">labels:
    - "traefik.docker.network=web"
    - "traefik.frontend.rule=Host:qdj.binets.fr"
    - "traefik.port=5000"</source></li></ol>

This gives us the following <code>docker-compose.qdj.yaml</code>:

<source lang="yaml">version: '3.1'

services:

  db:
    image: postgres:alpine
    restart: always
    environment:
      POSTGRES_USER: qdj
      POSTGRES_PASSWORD: qdjpw
      POSTGRES_DB: qdj
    volumes:
      - "qdj-data:/var/lib/postgresql/data"

  app:
    image: ${DOCKER_IMAGE}
    environment:
      FLASK_APP: qdj.py
      FLASK_ENV: production
      FLASK_DEBUG: 0
      DATABASE_URI: "postgresql://qdj:qdjpw@db:5432/qdj"
      SECRET_KEY:
    depends_on:
      - db
    restart: always
    networks:
      - web
      - default
    labels:
      - "traefik.docker.network=web"
      - "traefik.frontend.rule=Host:qdj.binets.fr"
      - "traefik.port=5000"

volumes:
  qdj-data:

networks:
  web:
    external: true</source>
This file goes into the [https://gitlab.binets.fr/br/docker-services br/docker-services] repository, it will be used by the triggered pipeline to create your containers.

=== Triggering pipelines with Gitlab CI ===

In this pipeline, we will need to add 2 jobs:

* one to build the docker image using the <code>Dockerfile</code>
* one to trigger the [https://gitlab.binets.fr/br/docker-services br/docker-services] pipeline to create the containers.

To build the docker image, we will use the template do so:

<source lang="yaml"># Build docker image and upload to registry
docker:build:
  stage: build
  only:
    - master
    - stable
  image: docker:stable
  services:
    - docker:dind
  variables:
    DOCKER_HOST: tcp://docker:2375/
    DOCKER_DRIVER: overlay2
    # For disabling TLS in docker-in-docker (not needed)
    DOCKER_TLS_CERTDIR: ''
  script:
    - docker login -u $CI_REGISTRY_USER -p $CI_REGISTRY_PASSWORD $CI_REGISTRY
    - docker build --pull --build-arg version=$CI_PIPELINE_IID -t $IMAGE_TAG -f deployment/Dockerfile .
    - docker push $IMAGE_TAG</source>
The second job is rather tricky. We will use <code>curl</code> to trigger the pipeline, using [https://docs.gitlab.com/ce/ci/triggers/README.html Gitlab Pipeline API]. This call is secured by a trigger token, which should be saved into your project variables as <code>$TRIGGER_TOKEN</code>. This is what the job looks like:

<source lang="yaml">docker:deploy:
  stage: deploy
  when: manual
  script:
    - apt-get update && apt-get install -y curl
    - curl --request POST --form token=$TRIGGER_TOKEN --form ref=master --form variables[PROJECT]=qdj --form variables[DOCKER_IMAGE]=$IMAGE_TAG https://gitlab.binets.fr/api/v4/projects/560/trigger/pipeline</source>
Pay attention to this syntax because debugging this api call takes a lot of time...

If you want to add variables that will be used in your <code>docker-compose.yaml</code>, add other arguments to <code>curl</code> like <code>--form variables[WELCOME_MESSAGE]=&quot;Hello World!&quot;</code>.

You can see an example of a CI using this in the [https://gitlab.binets.fr/br/qdj br/qdj] repo.

Note: for BR project, you can use the <code>trigger</code> syntax in the API call since you don't need autorisation.

== History ==

* In 2017, the BR16 set up a [https://kubernetes.io/ Kubernetes] cluster. They managed to set up a workflow to deploy seamlessly from gitlab on that cluster. However, the configuration was hard to maintain and the BR17 was not able to keep it going.
* In 2018, the BR17 (Oliver Facklam + Hadrien Renaud) set up a small docker service on a computer from the Salle Informatiques

= Developping a site for BR docker deployement =

Docker allows for most technologies to be abstracted into a container and thus most - if not all - sites can be deployed in docker. However, here is a bit of advice to make deployement less painful :

* Before using a particular external service (something that should run in a seperate container), check that a well supported docker image exists and with a BRman that there are no other constraints (for example, using a MinIO will go through a seperate dedicated server that already exists rather than a container).
* Use a postgres database to get access to an admin website for your server.