187

I am trying to run a container. I already have the image uploaded to private Docker registry. I want to write a compose file to download and deploy the image. But I want to pass the TAG name as a variable from the docker-compose run command.My compose file looks like below. How can I pass the value for KB_DB_TAG_VERSION as part of docker-compose up command?

version: '3'
services:
   db:
    #build: k-db
    user: "1000:50"
    volumes:
      - /data/mysql:/var/lib/mysql
    container_name: k-db
    environment:
      - MYSQL_ALLOW_EMPTY_PASSWORD=yes
    image:  XX:$KB_DB_TAG_VERSION
    image: k-db
    ports:
      - "3307:3306"

8 Answers 8

227

You have two options (option 2. overrides 1.):

  1. Create the .env file as already suggested in another answer.

  2. Prepend KEY=VALUE pair(s) to your docker-compose command, e.g:

    KB_DB_TAG_VERSION=kb-1.3.20-v1.0.0 docker-compose up
    

    Exporting it earlier in a script should also work, e.g.:

    export KB_DB_TAG_VERSION=kb-1.3.20-v1.0.0
    docker-compose up
    

Keep in mind that these options just pass an environment varible to the docker-compose.yml file, not to a container. For an environment variable to be actually passed to a container you always need something like this in your docker-compose.yml:

  environment:
    - KB_DB_TAG_VERSION=$KB_DB_TAG_VERSION
6
  • 51
    KB_DB_TAG_VERSION=kb-1.3.20-v1.0.0 docker-compose up, Only works if in docker-compose.yml in environment: KB_DB_TAG_VERSION=$KB_DB_TAG_VERSION Commented Jul 31, 2019 at 6:22
  • 130
    How wierd that the -e flag is missing. It's there for docker-compose run. Well well.
    – Karl Pokus
    Commented Sep 24, 2019 at 9:08
  • 3
    Prepending a variable seems to override the version given in the .env. (So prepending can be used to do try ad hoc changes without changing the .env)
    – vlz
    Commented May 8, 2020 at 12:30
  • 5
    This doesn't work on Windows CMD or PowerShell
    – Slav
    Commented Oct 6, 2022 at 15:49
  • 1
    @KarlPokus "How wierd that the -e flag is missing" - I guess that's because up applies to all containers and there could be arbitrary numbers of containers you're passing the same env var to. For an alternative where you can still use the command line, see my answer: stackoverflow.com/a/74069689/28190 Commented Oct 14, 2022 at 13:06
71

You can create a .env file on the directory where you execute the docker-compose up command (and your docker-compose.yml file is located) with the following content:

KB_DB_TAG_VERSION=kb-1.3.20-v1.0.0

Your docker-compose.yml file should look like the following (added { and }):

version: '3'
services:
   db:
     user: "1000:50"
     volumes:
       - /data/mysql:/var/lib/mysql
     container_name: k-db
     environment:
       - MYSQL_ALLOW_EMPTY_PASSWORD=yes
     image: XX:${KB_DB_TAG_VERSION}
     image: k-db
     ports:
       - "3307:3306"

After making the above changes , check whether the changes are reflected or not using the command docker-compose config. The variable will be replaced by the variable value. Please refer to the page here to understand more about variable replacement.

6
  • When I try this option I see that additional "+" is being added. XX:+kb-1.3.20-v1.0.0
    – Abhi.G
    Commented Mar 15, 2018 at 9:36
  • You don't want to set the additional +? Which value should be set? Commented Mar 15, 2018 at 10:02
  • I want it to be XX:kb-1.3.20-v1.0.0 not XX:+kb-1.3.20-v1.0.0. I dont want the "+".
    – Abhi.G
    Commented Mar 20, 2018 at 5:04
  • Quick hint, in my case I had the .env file named .env.dev and referenced inside the env_file attribute in docker-compose.yml and could not use ${variable} option inside docker-compose. Renaming my .env.dev file to just .env as stated here did the trick. Commented Sep 5, 2022 at 17:35
  • This is really This is really weird, ${XXX} doesn't work under my .env, $XXX does. Wait ...... It works now, if it doesn't, restart your shell ......
    – Jay
    Commented Nov 30, 2022 at 5:42
24

Just to supplement what has been outlined by others, in particular by @JakubKukul

For security purposes you probably wouldn't want to keep vulnerable information such as username/password in your docker-compose files if they're under version control. You can map environment variables that you have on your host to environment variables inside container as well. In this case it could be something like the following:

version: '3'
services:
   db:
    #build: k-db
    user: "1000:50"
    volumes:
      - /data/mysql:/var/lib/mysql
    container_name: k-db
    environment:
      - MYSQL_ALLOW_EMPTY_PASSWORD=yes
      - MYSQL_PASSWORD=${MYSQL_PASSWORD}
    image:  XX:$KB_DB_TAG_VERSION
    image: k-db
    ports:
      - "3307:3306"

where MYSQL_PASSWORD would be both:

  1. An environment variable on your host (maybe just in the current shell session)
  2. An environment variable inside the containers from the db service
14

It's possible to pass environment variables to containers on the command line without specifying the values in files. Add an environment key with the variable's name only (no value or assignment operator) on the container's service definition in the docker-compose file:

db:
    ...
    environment:
        - KB_DB_TAG_VERSION

Used in that way, with no assignment, means that docker-compose will look up the environment variable in the current environment/shell:

KB_DB_TAG_VERSION=mytagversion docker-compose up

Ref: https://docs.docker.com/compose/environment-variables/#pass-environment-variables-to-containers

0
14
docker-compose  --env-file .\.env up

https://docs.docker.com/compose/environment-variables/

2

The doc that you can declare the env file in compose -

web:
  env_file:
    - web-variables.env
1

For Windows, instead of export, use:

$env.KB_DB_TAG_VERSION = "1.3.20-v1.0.0"
docker-compose up
-4

In your docker-compose.yml file add

env_file:
  - .env_file

to your db service where .env_file is your .env file (change its name accordingly).

version: '3'
services:
   db:
    #build: k-db
    user: "1000:50"
    volumes:
      - /data/mysql:/var/lib/mysql
    container_name: k-db
    env_file:
      - .env_file
    environment:
      - MYSQL_ALLOW_EMPTY_PASSWORD=yes
    image:  XX:$KB_DB_TAG_VERSION
    image: k-db
    ports:
      - "3307:3306"
1
  • 23
    THIS IS WRONG! Read the docs. env_file: defines runtime envars, not build-time! By default, docker-compose will parse a .env file (HAS to be named .env this is not parametrable apparently) into build-time environment. In that case however, the fact that you declared it under env_file: .env or not is completely irrelevant - docker-compose looks for it anyways. So it will SEEM like your answer works, but in fact doesn't. Those looking for built-time envars should read the other answer. Commented Mar 17, 2021 at 15:38

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.