<\/p>\n
All these above mentioned architecture can be used as per the server set up requirements. But there few things missing from these architectures that might not be needed in beginning but they can be essential need as our e-commerce store grows.<\/p>\n
We all have seen that our previous architectures lack SSL and do not have any mechanism to take database backup on the scheduled basi<\/strong>s<\/strong><\/em>. Although we had secured our application code keeping it on our host but database is as important as server code.<\/p>\n So in this blog, in addition to previous setups we will also configure SSL for our Magento 2 store and we will create a bash script that will make regular database backups on our docker hosts. Also as we had discussed in our last blog that we will achieve an extra layer of optimisation, so in this blog we will also integrate Redis-server as well.<\/p>\n <\/p>\n <\/p>\n As Varnish-Cache works as a HTTP accelerator, Redis alongside its various features, \u00a0can be used as database cache. Quoting from docs itself,<\/p>\n <\/p>\n Redis is an open source, BSD licensed, advanced key-value store that can optionally be used in Magento for back end and session storage. It can be used to cache the database resulting in exploitation of less database resources, and provides a tunable persistent cache. It is a good alternative to memcacheD.<\/strong><\/em><\/p><\/blockquote>\n <\/p>\n When first time page is loaded, a database is queried on the server. Redis caches the query. Next time other user loads the page the results are provided from the redis without quering the actual database. It implements a persistent object cache (no expiration). An object cache works by caching the SQL queries in memory which are needed to load the web page. When the data of main database server is updatedc,then corresponding key in the redis is invalidated. So it provides the updated data instead of caching the data. If a query is not available in redis, the database provides the result and it adds the result to its cache.<\/p>\n Magento supports many backend caches like MemcacheD and APC that are commonly used. However, Redis has become a popular and powerful cache system for Magento and other web applications.<\/strong><\/em><\/p>\n <\/p>\n <\/p>\n You all, who are not much familiar with nginx-varnish relationship, might have thought that why we are going to use nginx for SSL instead of configuring SSL with apache2 server itself.<\/strong><\/em> Take a note that, Varnish being a reverse proxy caching server sits in front of apache2 server. Also as Varnish is a HTTP accelerator it cannot deal with HTTPS traffic. So we must deploy a way to direct both HTTP and HTTPS traffic to Varnish cache server which in turn, if needed, forward it apache2 server.<\/strong><\/em><\/p>\n Nginx comes in action here. Nginx serves as a reverse proxy server that receives traffic on port 80 and 443 and then proxy pass it to listening port of Varnish Cache server.<\/strong><\/em><\/p>\n So continuing our legacy of multi-container Docker architecture, we will be using separate containers for apache2 server, mysql-server, varnish-cache server, redis-server and nginx-server (for ssl termination) for its integration with Magento 2 on Ubuntu 16.04.<\/strong><\/em><\/p>\n The main\u00a0directory holding all the files\/directories will be considered as the project name. Custom project name can also be in set docker-compose.yml file. Here\u00a0we are creating separate directories for apache2, mysql-server, redis-server, varnish cache server and nginx server setup that hold their Dockerfile(s) and their associated volumes.<\/strong><\/em><\/p>\n Take a note that: following the same approach,\u00a0Magento 2 files will be placed on our host. As it is a good practice to keep application files on host so that it will not be lost if containers or images get accidentally removed. These magento files will be mapped from host to running docker container<\/strong>.<\/em><\/p>\n We are also using supervisor<\/strong><\/em> to control all five\u00a0of our servers\u00a0in their respective containers. Apart from controlling these servers, supervisor is also running various commands and scripts that will be mentioned later in this blog.<\/p>\n To begin with create a directory on your Ubuntu 16.04 server for this project. Our directory architecture will be something like:<\/p>\n <\/p>\n Dockerfile<\/em><\/p>\n supervisord.conf<\/em><\/p><\/blockquote>\n Dockerfile<\/em><\/p>\n mysql.sh<\/em><\/p>\n supervisord.conf<\/em><\/p><\/blockquote>\n Dockerfile<\/p>\n default.vcl<\/p>\n supervisord.conf<\/p>\n varnish<\/p><\/blockquote>\n Dockerfile<\/p>\n supervisord.conf<\/p><\/blockquote>\n Dockerfile<\/p>\n default<\/p>\n nginx.conf<\/p>\n supervisord.conf<\/p><\/blockquote>\n Unarchived Magento 2 files and directories.<\/em><\/p><\/blockquote>\n <\/p>\n The\u00a0docker-compose.yml<\/em>\u00a0file is shown below:<\/p>\n <\/p>\n <\/p>\n Here in YAML file above, we are defining five services: ssl_server, redis_server, cache_server, web_server and database_server.<\/p>\n <\/p>\n <\/p>\n Lets take a look in our\u00a0web_server\u00a0directory<\/em>. It contains 2 files.\u00a0Dockerfile<\/em>\u00a0is shown below:<\/p>\n <\/p>\n <\/p>\n And at last we have\u00a0supervisord.conf<\/em>\u00a0file that supervisor use to run apache2 server and ownership commands. Its contents are shown below:<\/p>\n <\/p>\n <\/p>\n Moving on to our\u00a0database_server directory,\u00a0<\/em>it contains 3 files.\u00a0Dockerfile<\/em>\u00a0is shown below:<\/p>\n <\/p>\n <\/p>\n As we have discussed many times we cannot perform any operation from Dockerfile that requires a particular service to be running.\u00a0As with case of database, we cannot create database from Dockerfile as mysql service is not running. For database and its user creation, we will create a bash script that will run whenever a container will launch, hence creating mentioned database and its user<\/strong><\/em><\/p>\n We are using \u201cmysql.sh<\/em>\u201d as the bash script as mentioned in\u00a0Dockerfile<\/em>. Bash script \u201cmsyql.sh<\/em>\u201d resides on our host parallel to\u00a0Dockerfile<\/em>.<\/p>\n Contents of\u00a0mysql.sh<\/em>\u00a0is shown below:<\/p>\n <\/p>\n <\/p>\n Apart from\u00a0mysql.sh<\/em>\u00a0and\u00a0Dockerfile,<\/em>\u00a0we are also mapping\u00a0supervisord.conf file<\/em>. Its contents are shown below:<\/p>\n <\/p>\n <\/p>\n Moving on and taking a look on our cache_server directory, It contains 4 files. Dockerfile contents are shown below:<\/p>\n <\/p>\n <\/p>\n We also have server configuration file named\u00a0varnish<\/em>\u00a0whose contents are shown below.<\/p>\n <\/p>\n <\/p>\n And most importantly, our Varnish configuration language file. This VCL file is provided by Magento 2 itself and it works perfectly. Its contents are shown below.<\/p>\n <\/p>\n <\/p>\n Take a note that we have mentioned\u00a0apache2 (apache container name)\u00a0<\/em>for backend host in our default.vcl file as our magento code will be mapped to apache container. Also, we also have supervisor for controlling varnish server. Its contents are shown below:<\/p>\n <\/p>\n <\/p>\n Proceeding to redis_server directory, we have Dockerfile as,<\/p>\n <\/p>\n <\/p>\n and the supervisord.conf file,<\/p>\n <\/p>\n <\/p>\n And at last, lets take a look on our ssl_server directory. Its Dockerfile is shown below:<\/p>\n <\/p>\n <\/p>\n And its default configuration file,<\/p>\n <\/p>\n <\/p>\n As you can see that, nginx is listening to port 80 and 443 and forwarding the traffic to varnish container. In our configuration, we have used private SSL certificates. You can use your own certificates and mention their path in default configuration file.<\/p>\n Contents of nginx.conf file is shown below:<\/p>\n <\/p>\n <\/p>\n And its supervisord.conf file,<\/p>\n <\/p>\n <\/p>\n And our last directory is\u00a0magento2 directory.\u00a0<\/em>In our case, we have download Magento 2.2.5 from\u00a0https:\/\/magento.com\/tech-resources\/download<\/a>\u00a0and unarchived it in magento2 directory.\u00a0This directory will be mapped with \/var\/www\/html directory in apache2 docker container.<\/strong><\/em><\/p>\n After extracting Magento 2 files in the desired directory, our project directory setup will be completed. Now in order to build the images with docker-compose.yml file, go to project parent directory and run command,<\/p>\n <\/p>\n <\/p>\n This command will build up all three images for apache2, mysql and varnish server. To check the built images, run command,<\/p>\n <\/p>\n <\/p>\n Now to run the containers as a part of single project being as mentioned in docker-compose.yml file, run the command:<\/p>\n <\/p>\n <\/p>\n Your containers will get running. To list running containers under docker-compose, run command:<\/p>\n <\/p>\n <\/p>\n <\/p>\n Now, your server setup is all ready, now hit your domain name or IP to install Magento 2 store and configure it with Varnish Cache server as we did in\u00a0https:\/\/cloudkul.com\/blog\/magento-2-and-varnish-cache-integration-with-docker-compose\/.<\/a> Also test the Varnish cache using varnishhist tool.<\/strong><\/em><\/p>\n NOTE:-\u00a0<\/strong>Use name or id of the mysql container as database host.<\/p>\n Now, to configure redis-server, go to magento2 directory in your main project directory and open file ~\/app\/etc\/env.php. It will be something just like this,<\/p>\n <\/p>\n <\/p>\n Add following piece of code in the last second line of this file:<\/p>\n <\/p>\n <\/p>\n Please take a note that we have mentioned name of our redis-server container in server value in above code.<\/p>\n Now go to redis-server container and restart the server as,<\/p>\n <\/p>\n <\/p>\n You can also check if Redis-server is able to set keys or not,<\/p>\n <\/p>\n <\/p>\n You can also use ‘info’ command to get information and statistics about the server as,<\/p>\n <\/p>\n <\/p>\n <\/p>\n Our databases inside Docker Containers are as critical as our application code. So in order to keep their backup we schedule a shell script that will take backups of all the databases present in mysql-server container and keep them in archived from on our host.<\/p>\n The database backup bash script is shown below:<\/p>\n <\/p>\n <\/p>\n Now setup the cron to take regular backup.<\/p>\n <\/p>\n <\/p>\n Add the script as,<\/p>\n <\/p>\n <\/p>\n It will take database backups twice a day at interval of 12 hours.<\/p>\n So far we have discussed an optimised architecture of Magento 2 using docker-compose tool. Having very complex and code structure, Magento 2 needs optimisation which we have achieved with Varnish-cache, redis-server cache and also our store is configured with SSL. Please refer to repository\u00a0https:\/\/github.com\/webkul\/magento2-varnish-redis-ssl-docker-compose<\/a>\u00a0setup same architecture.<\/p>\n In our later blogs, we explore\u00a0see more applications of docker. Stay tuned.<\/p>\n","protected":false},"excerpt":{"rendered":"Introduction to Redis<\/h2>\n
Need For Nginx as SSL Termination<\/h2>\n
\n
\n
\n
\n
\n
\n
version: '3'\r\nservices:\r\n ssl_server:\r\n build:\r\n context: .\/ssl_server\/\r\n container_name: nginx\r\n depends_on:\r\n - web_server\r\n - cache_server\r\n - database_server\r\n - redis_server\r\n volumes:\r\n - .\/ssl_server\/supervisord.conf:\/etc\/supervisor\/conf.d\/supervisord.conf\r\n - .\/ssl_server\/default:\/etc\/nginx\/sites-enabled\/default\r\n - .\/ssl_server\/nginx.conf:\/etc\/nginx\/nginx.conf\r\n links:\r\n - web_server\r\n - cache_server\r\n - database_server\r\n - redis_server\r\n ports: \r\n - \"80:80\"\r\n - \"443:443\"\r\n \r\n redis_server:\r\n build:\r\n context: .\/redis_server\/\r\n container_name: redis\r\n depends_on:\r\n - web_server\r\n - cache_server\r\n - database_server\r\n volumes:\r\n - .\/redis_server\/supervisord.conf:\/etc\/supervisor\/conf.d\/supervisord.conf\r\n links:\r\n - web_server\r\n - database_server\r\n\r\n ports:\r\n - \"6379:6379\"\r\n\r\n cache_server:\r\n build:\r\n context: .\/cache_server\/\r\n container_name: varnish\r\n depends_on:\r\n - web_server\r\n volumes:\r\n - .\/cache_server\/default.vcl:\/etc\/varnish\/default.vcl\r\n - .\/cache_server\/varnish:\/etc\/default\/varnish\r\n - .\/cache_server\/supervisord.conf:\/etc\/supervisor\/conf.d\/supervisord.conf\r\n ports:\r\n - \"6081:6081\"\r\n - \"6082:6082\"\r\n links:\r\n - web_server\r\n - database_server\r\n\r\n\r\n web_server:\r\n build:\r\n context: .\/web_server\/\r\n container_name: apache2\r\n volumes:\r\n - .\/magento2:\/var\/www\/html \r\n - .\/web_server\/supervisord.conf:\/etc\/supervisor\/conf.d\/supervisord.conf\r\n ports:\r\n - \"8080:8080\"\r\n links:\r\n - database_server\r\n \r\n database_server:\r\n build:\r\n context: .\/database_server\/\r\n args:\r\n - mysql_password=mention_your_mysql_root_password\r\n - mysql_database=mention_your_database_name\r\n container_name: mysql\r\n volumes: \r\n - .\/database_server\/supervisord.conf:\/etc\/supervisor\/conf.d\/supervisord.conf\r\n - .\/database_server\/mysql.sh:\/etc\/mysql.sh\r\n ports:\r\n - \"3306:3306\"\r\n<\/pre>\n
\n
FROM ubuntu:16.04\r\n\r\nLABEL maintainer=\"Alankrit Srivastava <alankrit.srivastava256@webkul.com>\"\r\n\r\nRUN apt-get update \\\r\n && apt-get -y install apache2 nano mysql-client \\\r\n && a2enmod rewrite \\\r\n && a2enmod headers \\\r\n && export LANG=en_US.UTF-8 \\\r\n && apt-get update \\\r\n && apt-get install -y software-properties-common \\\r\n && apt-get install -y language-pack-en-base \\\r\n && LC_ALL=en_US.UTF-8 add-apt-repository ppa:ondrej\/php \\\r\n && apt-get update \\\r\n && apt-get -y install php7.1 php7.1-curl php7.1-intl php7.1-gd php7.1-dom php7.1-mcrypt php7.1-iconv php7.1-xsl php7.1-mbstring php7.1-ctype php7.1-zip php7.1-pdo php7.1-xml php7.1-bz2 php7.1-calendar php7.1-exif php7.1-fileinfo php7.1-json php7.1-mysqli php7.1-mysql php7.1-posix php7.1-tokenizer php7.1-xmlwriter php7.1-xmlreader php7.1-phar php7.1-soap php7.1-mysql php7.1-fpm php7.1-bcmath libapache2-mod-php7.1 \\\r\n && sed -i -e\"s\/^memory_limit\\s*=\\s*128M\/memory_limit = 512M\/\" \/etc\/php\/7.1\/apache2\/php.ini \\\r\n && rm \/var\/www\/html\/* \\\r\n && sed -i \"s\/None\/all\/g\" \/etc\/apache2\/apache2.conf \\\r\n && sed -i \"s\/80\/8080\/g\" \/etc\/apache2\/ports.conf \/etc\/apache2\/sites-enabled\/000-default.conf \\\r\n##install supervisor and setup supervisord.conf file\r\n && apt-get install -y supervisor \\\r\n && mkdir -p \/var\/log\/supervisor\r\nenv APACHE_RUN_USER www-data\r\nenv APACHE_RUN_GROUP www-data\r\nenv APACHE_PID_FILE \/var\/run\/apache2.pid\r\nenv APACHE_RUN_DIR \/var\/run\/apache2\r\nenv APACHE_LOCK_DIR \/var\/lock\/apache2\r\nenv APACHE_LOG_DIR \/var\/log\/apache2\r\nenv LANG C\r\n\r\nWORKDIR \/var\/www\/html\r\n\r\nCMD [\"\/usr\/bin\/supervisord\"]\r\n<\/pre>\n
[supervisord]\r\nnodaemon=true\r\n\r\n[program:apache2]\r\ncommand=\/bin\/bash -c \"source \/etc\/apache2\/envvars && exec \/usr\/sbin\/apache2 -DFOREGROUND\"\r\n\r\n[program:user_permission]\r\ncommand=\/bin\/bash -c \"chown -R www-data: \/var\/www\/\"<\/pre>\n
FROM ubuntu:16.04\r\n\r\nLABEL maintainer=\"Alankrit Srivastava <alankrit.srivastava256@webkul.com>\"\r\n\r\nARG mysql_password\r\nARG mysql_database\r\nenv MYSQL_ROOT_PASSWORD ${mysql_password}\r\nenv MYSQL_DATABASE ${mysql_database}\r\n\r\nRUN apt-get update \\\r\n&& echo \"mysql-server-5.7 mysql-server\/root_password password ${mysql_password}\" | debconf-set-selections \\\r\n&& echo \"mysql-server-5.7 mysql-server\/root_password_again password ${mysql_password}\" | debconf-set-selections \\\r\n&& DEBIAN_FRONTEND=noninteractive apt-get -y install mysql-server-5.7 && \\\r\n mkdir -p \/var\/lib\/mysql && \\\r\n mkdir -p \/var\/run\/mysqld && \\\r\n mkdir -p \/var\/log\/mysql && \\\r\n touch \/var\/run\/mysqld\/mysqld.sock && \\\r\n touch \/var\/run\/mysqld\/mysqld.pid && \\\r\n chown -R mysql:mysql \/var\/lib\/mysql && \\\r\n chown -R mysql:mysql \/var\/run\/mysqld && \\\r\n chown -R mysql:mysql \/var\/log\/mysql &&\\\r\n chmod -R 777 \/var\/run\/mysqld\/ \\\r\n && sed -i -e\"s\/^bind-address\\s*=\\s*127.0.0.1\/bind-address = 0.0.0.0\/\" \/etc\/mysql\/mysql.conf.d\/mysqld.cnf \\\r\n##install supervisor and setup supervisord.conf file\r\n && apt-get install -y supervisor nano \\\r\n && mkdir -p \/var\/log\/supervisor \r\nCMD [\"\/usr\/bin\/supervisord\"]<\/pre>\n#!\/bin\/bash\r\n\r\nset -u\r\nsleep 4\r\ndatabase_connectivity_check=no\r\nvar=1\r\nwhile [ \"$database_connectivity_check\" != \"mysql\" ]; do\r\n\/etc\/init.d\/mysql start\r\nsleep 2\r\ndatabase_connectivity_check=`mysqlshow --user=root --password=$MYSQL_ROOT_PASSWORD | grep -o mysql`\r\nif [ $var -ge 4 ]; then\r\nexit 1\r\nfi\r\nvar=$((var+1))\r\ndone\r\n\r\n\r\ndatabase_availability_check=`mysqlshow --user=root --password=$MYSQL_ROOT_PASSWORD | grep -ow \"$MYSQL_DATABASE\"`\r\n\r\nif [ \"$database_availability_check\" == \"$MYSQL_DATABASE\" ]; then\r\nexit 1\r\nelse\r\nmysql -u root -p$MYSQL_ROOT_PASSWORD -e \"grant all on *.* to 'root'@'%' identified by '$MYSQL_ROOT_PASSWORD';\"\r\nmysql -u root -p$MYSQL_ROOT_PASSWORD -e \"create database $MYSQL_DATABASE;\"\r\nmysql -u root -p$MYSQL_ROOT_PASSWORD -e \"grant all on $MYSQL_DATABASE.* to 'root'@'%' identified by '$MYSQL_ROOT_PASSWORD';\"\r\nsupervisorctl stop database_creation && supervisorctl remove database_creation\r\necho \"Database $MYSQL_DATABASE created\"\r\nfi\r\n\r\n<\/pre>\n
[supervisord]\r\nnodaemon=true\r\n \r\n\r\n[program:mysql]\r\ncommand=\/bin\/bash -c \"touch \/var\/run\/mysqld\/mysqld.sock;touch \/var\/run\/mysqld\/mysqld.pid;chown -R mysql:mysql \/var\/lib\/mysql;chown -R mysql:mysql \/var\/run\/mysqld;chown -R mysql:mysql \/var\/log\/mysql;chmod -R 777 \/var\/run\/mysqld\/;\/etc\/init.d\/mysql restart\"\r\n\r\n[program:database_creation]\r\ncommand=\/bin\/bash -c \"chmod a+x \/etc\/mysql.sh; \/etc\/mysql.sh\"<\/pre>\n
From ubuntu:16.04\r\n\r\nMAINTAINER Alankrit Srivastava alankrit.srivastava256@webkul.com\r\n\r\n##update server\r\n\r\nRUN apt-get update \\\r\n##install supervisor and setup supervisord.conf file\r\n&& apt-get install -y supervisor \\\r\n&& mkdir -p \/var\/log\/supervisor \\\r\n##install varnish\r\n&& apt-get -y install varnish \\\r\n&& rm \/etc\/varnish\/default.vcl \\\r\n&& rm \/etc\/default\/varnish \r\nEXPOSE 6082 6081\r\nCMD [\"\/usr\/bin\/supervisord\"]<\/pre>\n
# Configuration file for varnish\r\n#\r\n# \/etc\/init.d\/varnish expects the variables $DAEMON_OPTS, $NFILES and $MEMLOCK\r\n# to be set from this shell script fragment.\r\n#\r\n# Note: If systemd is installed, this file is obsolete and ignored. You will\r\n# need to copy \/lib\/systemd\/system\/varnish.service to \/etc\/systemd\/system\/ and\r\n# edit that file.\r\n\r\n# Should we start varnishd at boot? Set to \"no\" to disable.\r\nSTART=yes\r\n\r\n# Maximum number of open files (for ulimit -n)\r\nNFILES=131072\r\n\r\n# Maximum locked memory size (for ulimit -l)\r\n# Used for locking the shared memory log in memory. If you increase log size,\r\n# you need to increase this number as well\r\nMEMLOCK=82000\r\n\r\n# Default varnish instance name is the local nodename. Can be overridden with\r\n# the -n switch, to have more instances on a single server.\r\n# You may need to uncomment this variable for alternatives 1 and 3 below.\r\n# INSTANCE=$(uname -n)\r\n\r\n# This file contains 4 alternatives, please use only one.\r\n\r\n## Alternative 1, Minimal configuration, no VCL\r\n#\r\n# Listen on port 6081, administration on localhost:6082, and forward to\r\n# content server on localhost:8080. Use a 1GB fixed-size cache file.\r\n#\r\n# This example uses the INSTANCE variable above, which you need to uncomment.\r\n#\r\n# DAEMON_OPTS=\"-a :6081 \\\r\n# -T localhost:6082 \\\r\n# \t -b localhost:8080 \\\r\n# \t -u varnish -g varnish \\\r\n# -S \/etc\/varnish\/secret \\\r\n# \t -s file,\/var\/lib\/varnish\/$INSTANCE\/varnish_storage.bin,1G\"\r\n\r\n\r\n## Alternative 2, Configuration with VCL\r\n#\r\n# Listen on port 6081, administration on localhost:6082, and forward to\r\n# one content server selected by the vcl file, based on the request.\r\n#\r\nDAEMON_OPTS=\"-a :6081 \\\r\n -T localhost:6082 \\\r\n -f \/etc\/varnish\/default.vcl \\\r\n -S \/etc\/varnish\/secret \\\r\n -s malloc,256m\"\r\n\r\n\r\n## Alternative 3, Advanced configuration\r\n#\r\n# This example uses the INSTANCE variable above, which you need to uncomment.\r\n#\r\n# See varnishd(1) for more information.\r\n#\r\n# # Main configuration file. You probably want to change it :)\r\n# VARNISH_VCL_CONF=\/etc\/varnish\/default.vcl\r\n#\r\n# # Default address and port to bind to\r\n# # Blank address means all IPv4 and IPv6 interfaces, otherwise specify\r\n# # a host name, an IPv4 dotted quad, or an IPv6 address in brackets.\r\n# VARNISH_LISTEN_ADDRESS=\r\n# VARNISH_LISTEN_PORT=6081\r\n#\r\n# # Telnet admin interface listen address and port\r\n# VARNISH_ADMIN_LISTEN_ADDRESS=127.0.0.1\r\n# VARNISH_ADMIN_LISTEN_PORT=6082\r\n#\r\n# # The minimum number of worker threads to start\r\n# VARNISH_MIN_THREADS=1\r\n#\r\n# # The Maximum number of worker threads to start\r\n# VARNISH_MAX_THREADS=1000\r\n#\r\n# # Idle timeout for worker threads\r\n# VARNISH_THREAD_TIMEOUT=120\r\n#\r\n# # Cache file location\r\n# VARNISH_STORAGE_FILE=\/var\/lib\/varnish\/$INSTANCE\/varnish_storage.bin\r\n#\r\n# # Cache file size: in bytes, optionally using k \/ M \/ G \/ T suffix,\r\n# # or in percentage of available disk space using the % suffix.\r\n# VARNISH_STORAGE_SIZE=1G\r\n#\r\n# # File containing administration secret\r\n# VARNISH_SECRET_FILE=\/etc\/varnish\/secret\r\n# \r\n# # Backend storage specification\r\n# VARNISH_STORAGE=\"file,${VARNISH_STORAGE_FILE},${VARNISH_STORAGE_SIZE}\"\r\n#\r\n# # Default TTL used when the backend does not specify one\r\n# VARNISH_TTL=120\r\n#\r\n# # DAEMON_OPTS is used by the init script. If you add or remove options, make\r\n# # sure you update this section, too.\r\n# DAEMON_OPTS=\"-a ${VARNISH_LISTEN_ADDRESS}:${VARNISH_LISTEN_PORT} \\\r\n# -f ${VARNISH_VCL_CONF} \\\r\n# -T ${VARNISH_ADMIN_LISTEN_ADDRESS}:${VARNISH_ADMIN_LISTEN_PORT} \\\r\n# -t ${VARNISH_TTL} \\\r\n# -w ${VARNISH_MIN_THREADS},${VARNISH_MAX_THREADS},${VARNISH_THREAD_TIMEOUT} \\\r\n# \t -S ${VARNISH_SECRET_FILE} \\\r\n# -s ${VARNISH_STORAGE}\"\r\n#\r\n\r\n\r\n## Alternative 4, Do It Yourself\r\n#\r\n# DAEMON_OPTS=\"\"<\/pre>\nvcl 4.0;\r\n\r\nimport std;\r\n# The minimal Varnish version is 5.0\r\n# For SSL offloading, pass the following header in your proxy server or load balancer: 'X-Forwarded-Proto: https'\r\n\r\nbackend default {\r\n .host = \"apache2\";\r\n .port = \"8080\";\r\n .first_byte_timeout = 600s;\r\n}\r\n\r\nacl purge {\r\n \"localhost\";\r\n}\r\n\r\nsub vcl_recv {\r\n if (req.method == \"PURGE\") {\r\n if (client.ip !~ purge) {\r\n return (synth(405, \"Method not allowed\"));\r\n }\r\n # To use the X-Pool header for purging varnish during automated deployments, make sure the X-Pool header\r\n # has been added to the response in your backend server config. This is used, for example, by the\r\n # capistrano-magento2 gem for purging old content from varnish during it's deploy routine.\r\n if (!req.http.X-Magento-Tags-Pattern && !req.http.X-Pool) {\r\n return (synth(400, \"X-Magento-Tags-Pattern or X-Pool header required\"));\r\n }\r\n if (req.http.X-Magento-Tags-Pattern) {\r\n ban(\"obj.http.X-Magento-Tags ~ \" + req.http.X-Magento-Tags-Pattern);\r\n }\r\n if (req.http.X-Pool) {\r\n ban(\"obj.http.X-Pool ~ \" + req.http.X-Pool);\r\n }\r\n return (synth(200, \"Purged\"));\r\n }\r\n\r\n if (req.method != \"GET\" &&\r\n req.method != \"HEAD\" &&\r\n req.method != \"PUT\" &&\r\n req.method != \"POST\" &&\r\n req.method != \"TRACE\" &&\r\n req.method != \"OPTIONS\" &&\r\n req.method != \"DELETE\") {\r\n \/* Non-RFC2616 or CONNECT which is weird. *\/\r\n return (pipe);\r\n }\r\n\r\n # We only deal with GET and HEAD by default\r\n if (req.method != \"GET\" && req.method != \"HEAD\") {\r\n return (pass);\r\n }\r\n\r\n # Bypass shopping cart, checkout and search requests\r\n if (req.url ~ \"\/checkout\" || req.url ~ \"\/catalogsearch\") {\r\n return (pass);\r\n }\r\n\r\n # Bypass health check requests\r\n if (req.url ~ \"\/pub\/health_check.php\") {\r\n return (pass);\r\n }\r\n\r\n # Set initial grace period usage status\r\n set req.http.grace = \"none\";\r\n\r\n # normalize url in case of leading HTTP scheme and domain\r\n set req.url = regsub(req.url, \"^http[s]?:\/\/\", \"\");\r\n\r\n # collect all cookies\r\n std.collect(req.http.Cookie);\r\n\r\n # Compression filter. See https:\/\/www.varnish-cache.org\/trac\/wiki\/FAQ\/Compression\r\n if (req.http.Accept-Encoding) {\r\n if (req.url ~ \"\\.(jpg|jpeg|png|gif|gz|tgz|bz2|tbz|mp3|ogg|swf|flv)$\") {\r\n # No point in compressing these\r\n unset req.http.Accept-Encoding;\r\n } elsif (req.http.Accept-Encoding ~ \"gzip\") {\r\n set req.http.Accept-Encoding = \"gzip\";\r\n } elsif (req.http.Accept-Encoding ~ \"deflate\" && req.http.user-agent !~ \"MSIE\") {\r\n set req.http.Accept-Encoding = \"deflate\";\r\n } else {\r\n # unkown algorithm\r\n unset req.http.Accept-Encoding;\r\n }\r\n }\r\n\r\n # Remove Google gclid parameters to minimize the cache objects\r\n set req.url = regsuball(req.url,\"\\?gclid=[^&]+$\",\"\"); # strips when QS = \"?gclid=AAA\"\r\n set req.url = regsuball(req.url,\"\\?gclid=[^&]+&\",\"?\"); # strips when QS = \"?gclid=AAA&foo=bar\"\r\n set req.url = regsuball(req.url,\"&gclid=[^&]+\",\"\"); # strips when QS = \"?foo=bar&gclid=AAA\" or QS = \"?foo=bar&gclid=AAA&bar=baz\"\r\n\r\n # Static files caching\r\n if (req.url ~ \"^\/(pub\/)?(media|static)\/\") {\r\n # Static files should not be cached by default\r\n return (pass);\r\n\r\n # But if you use a few locales and don't use CDN you can enable caching static files by commenting previous line (#return (pass);) and uncommenting next 3 lines\r\n #unset req.http.Https;\r\n #unset req.http.X-Forwarded-Proto;\r\n #unset req.http.Cookie;\r\n }\r\n\r\n return (hash);\r\n}\r\n\r\nsub vcl_hash {\r\n if (req.http.cookie ~ \"X-Magento-Vary=\") {\r\n hash_data(regsub(req.http.cookie, \"^.*?X-Magento-Vary=([^;]+);*.*$\", \"\\1\"));\r\n }\r\n\r\n # For multi site configurations to not cache each other's content\r\n if (req.http.host) {\r\n hash_data(req.http.host);\r\n } else {\r\n hash_data(server.ip);\r\n }\r\n\r\n # To make sure http users don't see ssl warning\r\n if (req.http.X-Forwarded-Proto) {\r\n hash_data(req.http.X-Forwarded-Proto);\r\n }\r\n \r\n}\r\n\r\nsub vcl_backend_response {\r\n\r\n set beresp.grace = 3d;\r\n\r\n if (beresp.http.content-type ~ \"text\") {\r\n set beresp.do_esi = true;\r\n }\r\n\r\n if (bereq.url ~ \"\\.js$\" || beresp.http.content-type ~ \"text\") {\r\n set beresp.do_gzip = true;\r\n }\r\n\r\n # cache only successfully responses and 404s\r\n if (beresp.status != 200 && beresp.status != 404) {\r\n set beresp.ttl = 0s;\r\n set beresp.uncacheable = true;\r\n return (deliver);\r\n } elsif (beresp.http.Cache-Control ~ \"private\") {\r\n set beresp.uncacheable = true;\r\n set beresp.ttl = 86400s;\r\n return (deliver);\r\n }\r\n\r\n if (beresp.http.X-Magento-Debug) {\r\n set beresp.http.X-Magento-Cache-Control = beresp.http.Cache-Control;\r\n }\r\n\r\n # validate if we need to cache it and prevent from setting cookie\r\n if (beresp.ttl > 0s && (bereq.method == \"GET\" || bereq.method == \"HEAD\")) {\r\n unset beresp.http.set-cookie;\r\n }\r\n\r\n # If page is not cacheable then bypass varnish for 2 minutes as Hit-For-Pass\r\n if (beresp.ttl <= 0s ||\r\n beresp.http.Surrogate-control ~ \"no-store\" ||\r\n (!beresp.http.Surrogate-Control && beresp.http.Vary == \"*\")) {\r\n # Mark as Hit-For-Pass for the next 2 minutes\r\n set beresp.ttl = 120s;\r\n set beresp.uncacheable = true;\r\n }\r\n return (deliver);\r\n}\r\n\r\nsub vcl_deliver {\r\n if (resp.http.X-Magento-Debug) {\r\n if (resp.http.x-varnish ~ \" \") {\r\n set resp.http.X-Magento-Cache-Debug = \"HIT\";\r\n set resp.http.Grace = req.http.grace;\r\n } else {\r\n set resp.http.X-Magento-Cache-Debug = \"MISS\";\r\n }\r\n } else {\r\n unset resp.http.Age;\r\n }\r\n\r\n unset resp.http.X-Magento-Debug;\r\n unset resp.http.X-Magento-Tags;\r\n unset resp.http.X-Powered-By;\r\n unset resp.http.Server;\r\n unset resp.http.X-Varnish;\r\n unset resp.http.Via;\r\n unset resp.http.Link;\r\n}\r\n\r\nsub vcl_hit {\r\n if (obj.ttl >= 0s) {\r\n # Hit within TTL period\r\n return (deliver);\r\n }\r\n if (std.healthy(req.backend_hint)) {\r\n if (obj.ttl + 300s > 0s) {\r\n # Hit after TTL expiration, but within grace period\r\n set req.http.grace = \"normal (healthy server)\";\r\n return (deliver);\r\n } else {\r\n # Hit after TTL and grace expiration\r\n return (miss);\r\n }\r\n } else {\r\n # server is not healthy, retrieve from cache\r\n set req.http.grace = \"unlimited (unhealthy server)\";\r\n return (deliver);\r\n }\r\n}<\/pre>\n[supervisord]\r\nnodaemon=true\r\n\r\n[program:varnish3.0]\r\ncommand=\/bin\/bash -c \"\/usr\/sbin\/varnishd -P \/run\/varnishd.pid -a :6081 -F -T localhost:6082 -f \/etc\/varnish\/default.vcl -S \/etc\/varnish\/secret -s malloc,256m\"<\/pre>\n
From ubuntu:16.04\r\n\r\nMAINTAINER Alankrit Srivastava alankrit.srivastava256@webkul.com\r\n\r\n##update server\r\n\r\nRUN apt-get update \\\r\n&& apt-get install -y locales \\\r\n&& locale-gen en_US.UTF-8 \\\r\n&& export LANG=en_US.UTF-8 \\\r\n&& apt-get update \\\r\n&& apt-get install -y software-properties-common \\\r\n&& LC_ALL=en_US.UTF-8 add-apt-repository -y ppa:chris-lea\/redis-server \\\r\n&& apt-get update \\\r\n&& apt-get -y install redis-server \\\r\n&& sed -i -e\"s\/^bind\\s127.0.0.1\/bind 0.0.0.0\/\" \/etc\/redis\/redis.conf \\\r\n&& chown -R redis: \/var\/log\/redis\/ \\\r\n##install supervisor and setup supervisord.conf file\r\n&& apt-get install -y supervisor \\\r\n&& mkdir -p \/var\/log\/supervisor \r\nCOPY supervisord.conf \/etc\/supervisor\/conf.d\/supervisord.conf\r\nEXPOSE 6379\r\nCMD [\"\/usr\/bin\/supervisord\"]<\/pre>\n
[supervisord]\r\nnodaemon=true\r\n\r\n[program:redis]\r\ncommand=\/usr\/bin\/redis-server \/etc\/redis\/redis.conf\r\n<\/pre>\n
From ubuntu:16.04\r\n\r\nMAINTAINER Alankrit Srivastava alankrit.srivastava256@webkul.com\r\n\r\n##update server\r\n\r\nRUN apt-get update \\\r\n##install nginx\r\n&& apt-get install -y locales \\\r\n&& locale-gen en_US.UTF-8 \\\r\n&& export LANG=en_US.UTF-8 \\\r\n&& apt-get update \\\r\n&& apt-get install -y software-properties-common \\\r\n&& LC_ALL=en_US.UTF-8 add-apt-repository -y ppa:nginx\/stable \\\r\n&& apt-get -y update \\\r\n&& apt-get -y install nginx \\\r\n&& rm \/etc\/nginx\/sites-enabled\/default \\\r\n## Generate self signed certificate\r\n&& cd \/etc\/nginx && echo -e \"\\n\\n\\n\\n\\n\\n\\n\" | openssl req -x509 -nodes -days 365 -newkey rsa:2048 -keyout \/etc\/nginx\/cert.key -out \/etc\/nginx\/cert.crt \\\r\n##install supervisor and setup supervisord.conf file\r\n&& apt-get install -y supervisor \\\r\n&& mkdir -p \/var\/log\/supervisor\r\nExpose 80 443\r\n\r\nCMD [\"\/usr\/bin\/supervisord\"]<\/pre>\n
server {\r\n listen 80 default_server;\r\n add_header 'Access-Control-Allow-Origin' '*';\r\n server_name localhost; ## mention ip address or domain name \r\n# return 302 https:\/\/$server_name$request_uri;\r\n \r\n location \/ {\r\n include \/etc\/nginx\/proxy_params;\r\n proxy_pass http:\/\/varnish:6081; \r\n }\r\n}\r\nserver {\r\n listen 443;\r\n add_header 'Access-Control-Allow-Origin' '*';\r\n server_name localhost; ## mention ip address or domain name\r\n ssl on;\r\n ssl_certificate \/etc\/nginx\/cert.crt;\r\n ssl_certificate_key \/etc\/nginx\/cert.key;\r\n ssl_session_timeout 5m;\r\n ssl_protocols SSLv3 TLSv1 TLSv1.1 TLSv1.2;\r\n ssl_ciphers \"HIGH:!aNULL:!MD5 or HIGH:!aNULL:!MD5:!3DES\";\r\n ssl_prefer_server_ciphers on;\r\n location \/ {\r\n include \/etc\/nginx\/proxy_params;\r\n proxy_pass http:\/\/varnish:6081;\r\n}\r\n}<\/pre>\nuser www-data;\r\nworker_processes auto;\r\npid \/run\/nginx.pid;\r\ninclude \/etc\/nginx\/modules-enabled\/*.conf;\r\n\r\nevents {\r\n\tworker_connections 768;\r\n\t# multi_accept on;\r\n}\r\n\r\nhttp {\r\n\r\n\t##\r\n\t# Basic Settings\r\n\t##\r\n\r\n\tsendfile on;\r\n\ttcp_nopush on;\r\n\ttcp_nodelay on;\r\n\tkeepalive_timeout 65;\r\n\ttypes_hash_max_size 2048;\r\n\t# server_tokens off;\r\n\r\n\t# server_names_hash_bucket_size 64;\r\n\t# server_name_in_redirect off;\r\n\r\n\tinclude \/etc\/nginx\/mime.types;\r\n\tdefault_type application\/octet-stream;\r\n\r\n\t##\r\n\t# SSL Settings\r\n\t##\r\n\r\n\tssl_protocols TLSv1 TLSv1.1 TLSv1.2; # Dropping SSLv3, ref: POODLE\r\n\tssl_prefer_server_ciphers on;\r\n\r\n\t##\r\n\t# Logging Settings\r\n\t##\r\n\r\n\taccess_log \/var\/log\/nginx\/access.log;\r\n\terror_log \/var\/log\/nginx\/error.log;\r\n\r\n\t##\r\n\t# Gzip Settings\r\n\t##\r\n\r\n\tgzip on;\r\n\tgzip_disable \"msie6\";\r\n\r\n\t# gzip_vary on;\r\n\t# gzip_proxied any;\r\n\t# gzip_comp_level 6;\r\n\t# gzip_buffers 16 8k;\r\n\t# gzip_http_version 1.1;\r\n\t# gzip_types text\/plain text\/css application\/json application\/javascript text\/xml application\/xml application\/xml+rss text\/javascript;\r\n\r\n\r\n\tinclude \/etc\/nginx\/conf.d\/*.conf;\r\n\tinclude \/etc\/nginx\/sites-enabled\/*;\r\n}\r\n\r\n<\/pre>\n[supervisord]\r\nnodaemon=true\r\n\r\n[program:nginx]\r\ncommand=\/usr\/sbin\/nginx -c \/etc\/nginx\/nginx.conf<\/pre>\n
docker-compose build<\/pre>\n
docker images<\/pre>\n
docker-compose up -d<\/pre>\n
docker-compose ps\r\n\r\ndocker ps<\/pre>\n
![\"\"](\"https:\/\/cloudkul.com\/blog\/wp-content\/uploads\/2017\/09\/Screenshot-from-2017-09-12-141036.png\")
<\/a><\/p>\n<?php\r\nreturn array (\r\n 'backend' => \r\n array (\r\n 'frontName' => 'admin',\r\n ),\r\n 'crypt' => \r\n array (\r\n 'key' => '03fb403b80643a6a11255d40ac72631a',\r\n ),\r\n 'session' => \r\n array (\r\n 'save' => 'files',\r\n ),\r\n 'db' => \r\n array (\r\n 'table_prefix' => '',\r\n 'connection' => \r\n array (\r\n 'default' => \r\n array (\r\n 'host' => 'mysql,\r\n 'dbname' => 'magento_db',\r\n 'username' => 'magento_user',\r\n 'password' => 'databasepassword123',\r\n 'active' => '1',\r\n ),\r\n ),\r\n ),\r\n 'resource' => \r\n array (\r\n 'default_setup' => \r\n array (\r\n 'connection' => 'default',\r\n ),\r\n ),\r\n 'x-frame-options' => 'SAMEORIGIN',\r\n 'MAGE_MODE' => 'default',\r\n 'cache_types' => \r\n array (\r\n 'config' => 1,\r\n 'layout' => 1,\r\n 'block_html' => 1,\r\n 'collections' => 1,\r\n 'reflection' => 1,\r\n 'db_ddl' => 1,\r\n 'eav' => 1,\r\n 'customer_notification' => 1,\r\n 'full_page' => 1,\r\n 'config_integration' => 1,\r\n 'config_integration_api' => 1,\r\n 'translate' => 1,\r\n 'config_webservice' => 1,\r\n ),\r\n 'install' => \r\n array (\r\n 'date' => 'Thu, 07 Sep 2017 08:17:00 +0000',\r\n ),\r\n);\r\n<\/pre>\n
'cache' => \r\n array (\r\n 'frontend' => \r\n array (\r\n 'default' => \r\n array (\r\n 'backend' => 'Cm_Cache_Backend_Redis',\r\n 'backend_options' => \r\n array (\r\n 'server' => 'redis', \r\n 'port' => '6379',\r\n 'persistent' => '',\r\n 'database' => '0',\r\n 'force_standalone' => '0',\r\n 'connect_retries' => '1',\r\n 'read_timeout' => '10',\r\n 'automatic_cleaning_factor' => '0',\r\n 'compress_data' => '1',\r\n 'compress_tags' => '1',\r\n 'compress_threshold' => '20480',\r\n 'compression_lib' => 'gzip',\r\n ),\r\n ),\r\n 'page_cache' => \r\n array (\r\n 'backend' => 'Cm_Cache_Backend_Redis',\r\n 'backend_options' => \r\n array (\r\n 'server' => 'redis',\r\n 'port' => '6379',\r\n 'persistent' => '',\r\n 'database' => '1',\r\n 'force_standalone' => '0',\r\n 'connect_retries' => '1',\r\n 'read_timeout' => '10',\r\n 'automatic_cleaning_factor' => '0',\r\n 'compress_data' => '0',\r\n 'compress_tags' => '1',\r\n 'compress_threshold' => '20480',\r\n 'compression_lib' => 'gzip',\r\n ),\r\n ),\r\n ),\r\n ),<\/pre>\n
docker exec -ti redis bash\r\n\r\n\/etc\/init.d\/redis-server restart<\/pre>\n
redis-cli\r\n\r\n127.0.0.1:6379> set mykey KEY\r\nOK\r\n127.0.0.1:6379> get mykey\r\n\"KEY\"\r\n127.0.0.1:6379> exit\r\n<\/pre>\n
redis-cli info<\/pre>\n
Backing Up Databases from Mysql Docker Container<\/h2>\n
#!\/bin\/bash\r\n\r\nset -u\r\n## Mention your database container name\r\ncontainer_name=mysql\r\n\r\n## Mention mysql root password\r\n\r\nMYSQL_ROOT_PASSWORD=mention_your_mysql_root_password\r\n\r\nDATE=`date +%F-%H-%M-%S`\r\n\r\nfor database in `echo 'show databases;' | docker exec -i mysql mysql --user=root --password=$MYSQL_ROOT_PASSWORD | grep -v Database | grep -v information_schema | grep -v mysql | grep -v performance_schema`\r\ndo\r\necho $database\r\ndocker exec $container_name mysqldump -u root -p$MYSQL_ROOT_PASSWORD $database > $database-$DATE.sql && tar -zcvf $database-$DATE.tar.gz $database-$DATE.sql && rm $database-$DATE.sql && echo \"$database-$DATE.tar.gz has been created on `date`\" >> database_backup.log\r\ndone<\/pre>\n
crontab -e<\/pre>\n
0 *\/12 * * * bash path_to_script\/db_backup.sh<\/pre>\n