dnscontrol/documentation/ci-cd-gitlab.md

GitLab CI/CD example

Before discussing the GitLab CI/CD setup, let's assume you already have a working DNSControl setup. Aren't you there yet? Then first check out the 'Getting Started' section.

DNSControl - Demo setup

For this tutorial, there is a GitLab repository ready with an example DNSControl setup/domain.

This is based on:

• The domain cafferata.dev.
• The DNS provider TransIP.
• The TransIP account cafferatax.

For convenience, both configuration files are shown below.

{% code title="dnsconfig.js" %}

var PROVIDER_NONE = NewRegistrar("none");
var PROVIDER_TRANSIP = NewDnsProvider("transip");

D("cafferata.dev",
    PROVIDER_NONE,
    DnsProvider(PROVIDER_TRANSIP),
    DefaultTTL("1d"),
    TXT("spf", [
        "v=spf1",
        "-all"
    ].join(" "))
);

{% endcode %}

{% code title="creds.json" %}

{
  "transip": {
    "TYPE": "TRANSIP",
    "AccountName": "cafferatax",
    "PrivateKey": "$TRANSIP_PRIVATE_KEY"
  }
}

{% endcode %}

GitLab CI - Preparation

You may have noticed that the creds.json file contains a variable $TRANSIP_PRIVATE_KEY. This variable is populated from the GitLab CI variables and contain the TransIP API key.

-----BEGIN PRIVATE KEY-----
MIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDgJjUQcUrijxul
NbbN+KD3tDISPDczuJW8HYZRafOc9BgHWuYiBcE+1+9mzHi7FOujuHuTBD84vvRN
x9buaOLoJNjCvtHDtotYQMhUWF8bnNYyoIIdJGXXcRG0G0+NNreVQiZ+5IQIvhRU
PXyjvUdQoIaRc9S5NxAMbGLJUHtZ4LEdJKa7HmCXAA5dBYaMMSZjpdBJImSJAtxj
msseUkc0EiznGgsBVMOkn3VMba2gjo5RDGbfXXLUX3DTOKdwY+hdWktG/gO/3D9l
hY/gnT/MmXXko3YAcI4eQL8=
-----END PRIVATE KEY-----

Example of variable $TRANSIP_PRIVATE_KEY contents.

GitLab CI - DNSControl preview

Now it's time to apply the power of DNSControl within GitLab CI merge requests. We'll start by adding the basic GitLab CI setup. You can view the git diff online in the GitLab merge request #1. The GitLab CI setup has also been added for convenience.

.gitlab-ci.yml

dnscontrol-preview:
  stage: 'test'
  image:
    name: 'stackexchange/dnscontrol'
    entrypoint: ['']
  script:
    - '/usr/local/bin/dnscontrol version'
    - '/usr/local/bin/dnscontrol check'
    - '/usr/local/bin/dnscontrol preview'
  rules:
    - if: '$CI_PIPELINE_SOURCE == "merge_request_event"'
      changes:
        - 'dnsconfig.js'

What does this YAML configuration mean?

• The dnscontrol preview is run within the GitLab CI predefined stage test using the Docker image stackexchange/dnscontrol.
  • A conscious decision has been made to always use the latest version so that no maintenance is required. Of course you can choose to include a Docker image version. You do this by choosing from the available versions, and including it in image: for example: name: 'stackexchange/dnscontrol:v3.20.0'
• Because the choice was made not to adopt a version, it's nice to know from the GitLab CI jobs which version DNSControl is running. We check and validate the DNSControl set-up dnsconfig.js.
• Then we ask TransIP which DNS diff there is.
• (!) This only happens in the context of a GitLab merge request and (very important) only when there is a change in the DNSControl configuration (dnsconfig.js).

Because the above GitLab CI configuration expects a diff, we apply this by (for example) adding the Google Workspace SPF include.

dnsconfig.js

var PROVIDER_NONE = NewRegistrar("none");
var PROVIDER_TRANSIP = NewDnsProvider("transip");

D("cafferata.dev",
    PROVIDER_NONE,
    DnsProvider(PROVIDER_TRANSIP),
    DefaultTTL("1d"),
    TXT("spf", [
        "v=spf1",
+       "include:_spf.google.com",
        "-all"
    ].join(" "))
);

From that moment everything comes together! Within the GitLab merge request #1, a GitLab pipeline with a GitLab job starts running containing the command dnscontrol preview. The outcome of this job? The desired change that will be made within TransIP. Wow this is cool!

/usr/local/bin/dnscontrol version

dnscontrol "3.20.0" ("8bb63be8f5ed996a7ae0a21091954fcab996621b") built 26 Aug 22 14:59 UTC

/usr/local/bin/dnscontrol preview

******************** Domain: cafferata.dev
1 correction
#1: MODIFY TXT spf.cafferata.dev: ("v=spf1 -all" ttl=86400) -> ("v=spf1 include:_spf.google.com -all" ttl=86400)
Done. 1 corrections.

GitLab CI - DNSControl push

We just saw that we can view the DNSControl diff from the GitLab job. Now it's time to make GitLab CI responsible for the command dnscontrol push.

From here several choices can be made. You can choose to have the dnscontrol push run as soon as a merge request is pushed to default branch (e.g. main), or from a GitLab pipeline trigger within the GitLab web interface. We have opted for the GitLab pipeline web interface so that it cannot happen that DNS changes are made from previous merge requests in default branch (e.g. main).

It will probably not surprise you that the basis of this GitLab YAML configuration corresponds for 90% with the DNSControl preview. See the GitLab merge request #2 here.

.gitlab-ci.yml

dnscontrol-push:
  stage: 'deploy'
  image:
    name: 'stackexchange/dnscontrol'
    entrypoint: ['']
  script:
    - '/usr/local/bin/dnscontrol version'
    - '/usr/local/bin/dnscontrol push'
  rules:
    - if: '$CI_COMMIT_BRANCH == $CI_DEFAULT_BRANCH && $CI_PIPELINE_SOURCE == "web"'

What does this (new) YAML configuration mean?

• The dnscontrol push is run within the GitLab CI predefined stage deploy.
• This only happens when you start a GitLab pipeline from the GitLab web interface for the default branch (e.g. main).

When we start the new GitLab pipeline from the GitLab web interface, we see the GitLab job dnscontrol-push which makes the changes within the DNS provider TransIP.

/usr/local/bin/dnscontrol version

dnscontrol "3.20.0" ("8bb63be8f5ed996a7ae0a21091954fcab996621b") built 26 Aug 22 14:59 UTC

/usr/local/bin/dnscontrol push

******************** Domain: cafferata.dev
1 correction
#1: MODIFY TXT spf.cafferata.dev: ("v=spf1 -all" ttl=86400) -> ("v=spf1 include:_spf.google.com -all" ttl=86400)
SUCCESS!
Done. 1 corrections.

GitLab CI - Duplicate YAML configuration

We have a working setup at this point that includes a dnscontrol preview and a dnscontrol push command. Well done! You might consider cleaning up the duplicate GitLab YAML configuration. We can move the DNSControl image name and entrypoint to a GitLab YAML extends. Then we can also move the duplicate dnscontrol version command to a GitLab before_script. See the third (and also last) GitLab merge request #3.

This eventually brings us to the following GitLab CI setup.

.gitlab-ci.yml

.dnscontrol:
  image:
    name: 'stackexchange/dnscontrol'
    entrypoint: ['']
  before_script:
    - '/usr/local/bin/dnscontrol version'

dnscontrol-preview:
  extends: '.dnscontrol'
  stage: 'test'
  script:
    - '/usr/local/bin/dnscontrol check'
    - '/usr/local/bin/dnscontrol preview'
  rules:
    - if: '$CI_PIPELINE_SOURCE == "merge_request_event"'
      changes:
        - 'dnsconfig.js'

dnscontrol-push:
  extends: '.dnscontrol'
  stage: 'deploy'
  script:
    - '/usr/local/bin/dnscontrol push'
  rules:
    - if: '$CI_COMMIT_BRANCH == $CI_DEFAULT_BRANCH && $CI_PIPELINE_SOURCE == "web"'

If you are unexpectedly unable to set up this setup, feel free to ask questions about it.