Tag: workflow

Creating docker image out of a production environment possible?

I know it’s very common to create Docker containers/images locally upfront of a project and deploy them to a certain environment (DEV/QA/PROD) once you have made changes. But what if you have a project already in production and you want to make local development possible/easier? General design question Is there any (clever) way to clone […]

Docker workflow for development- running containers build up

I’ve gotten pretty comfortable with a basic development workflow using docker for mac (or machine) and docker compose. However, when developing in docker I always end up with a lot of running containers- Example from a compose file with images for postgres, app, sidekiq, and redis: I run the app using docker-compose up and exit […]

Docker for a one shot CLI application

Since I first knew of Docker, I thought it might be the solution for several problems we are usually facing at the lab. I work as a Data Analyst for a small Biology research group. I am using Snakemake for defining the -usually big and quite complex- workflows for our analyses. From Snakemake, I usually […]

Docker worklfow of testing images

what is the “best practice” workflow of testing dockerized applications in a CI/CD process? Run tests and then create the container Create the container and run test against interface of containerized app something else?

Mount directory to docker container while using CWL (Common Workflow Language)

I’m trying to get a bunch of very big files into a docker container while using CWL. When using the default method of file-inputs via job.yml: input_file: class: File path: /home/ubuntu/data/bigfile.zip the CWL runner somehow copies the file and gets stuck. Is there an easy way of just mounting a directory directly into a docker […]

How should I Accomplish a Better Docker Workflow?

Everytime I change a file in the nodejs app I have to rebuild the docker image. This feels redundant and slows my workflow. Is there a proper way to sync the nodejs app files without rebuilding the whole image again, or is this a normal usage?

Docker workflow for scientific computing

I’m trying to imagine a workflow that could be applied on a scientific work environment. My work involves doing some scientific coding, basically with Python, pandas, numpy and friends. Sometimes I have to use some modules that are not common standards in the scientific community and sometimes I have to integrate some compiled code in […]

Docker workflow for automated builds on Github-Dockerhub

I already have set up a github repository with 3 branches (master, dev and docker). I already set up successfully and linked the automated build on dockerhub. Each time a push is done on Github an image is built on Dockerhub with different tag (latest for master, beta for dev and alpha for docker). This […]

Docker: how to manage development and production settings?

I’m just getting started with Docker. With the official NGINX image on my OSX development machine (with Docker Machine as the Docker host) I ran up against the bug with sendfile and VirtualBox which means the server fails to show changes I make to files. The workaround for this is to use a modified nginx.conf […]

Development workflow on Minikube and docker

I am trying to understand how development is done efficiently with dockerized applications, specifically on Kubernetes. I am struggling to find the proper way to go about live editing containers. In the past with Docker, I would just use something like Nodemon to watch for files to change locally and then when I had the […]

Docker will be the best open platform for developers and sysadmins to build, ship, and run distributed applications.