I am running docker on Azure VM (Windows server 2019). I am trying to set up airflow using this link - https://airflow.apache.org/docs/apache-airflow/stable/start/docker.html. One of the steps include checking available memory for docker. docker run --rm “debian:buster-slim” bash -c ‘numfmt --to iec $(echo $(($(getconf _PHYS_PAGES) * $(getconf PAGE_SIZE))))’ It requires 4G of memory while I am getting 973M. Any idea how I can increase the docker engine memory. All articles online tell me how I can increase the memory of docker-container.
nethras
@nethras
I am a AWS DevOps Developer. I have been working as Lead DevOps Engineer and Principal Linux administrator from past 10 years and had teaching experience of DevOps, AWS, Linux and Automation from the past 7 years. Good in all infra related topics and can provide the exposure of real-time scenarios.
Posts made by nethras
-
Docker engine not enough memory
-
How to induct Ansible in the AWS DevOps work flow?
Currently i’m learning AWS and DevOps. I was given this scenario to implement. I was hired as an Ansible Engineer and my role is to induct the Ansible in the DevOps workflow (GIT->Jenkins->AWS Infrastructure). How will you induct the Ansible for Configuration Management.
Please Correct me if I’m wrong.
My answer was:
Write a pipeline in jenkins which will execute the aws cli command to get the public ip addresses of the instances behind the ALB.
Write a pipeline in jenkins which will add the id_rsa.pub of Ansible master to all the instances.(or else adding IAM role of ec2 instances to the current jenkins server).
Execute the another pipeline with Ansible playbook where we will update the public ip addresses in the inventory file and run it.
With the above approach I have few doubts which are as follows:At the time of creating the Jenkins pipeline (to get public ip addresses) we might have 150 instances at that given point of time. What if the new instances are added to the load balancer in the meanwhile?. so how to include them as they will get new public addresses and by the time all the above 3 jobs will already been ran.
Needed a better and fully controlled approach on this. Please improve my approach.
AWS learner in need of your help.