{"id":8314,"date":"2020-10-06T09:41:53","date_gmt":"2020-10-06T09:41:53","guid":{"rendered":"https:\/\/cloudkul.com\/blog\/?p=8314"},"modified":"2020-11-23T09:51:16","modified_gmt":"2020-11-23T09:51:16","slug":"managing-and-monitoring-magento-2-logs-with-kibana","status":"publish","type":"post","link":"https:\/\/cloudkul.com\/blog\/managing-and-monitoring-magento-2-logs-with-kibana\/","title":{"rendered":"Managing and Monitoring Magento 2 logs with Kibana"},"content":{"rendered":"\n<p><strong><em>Magento is a powerful eCommerce platform that<\/em><\/strong> enables site managers to fully customize their stores to meet various business needs. It also has a robust system of logging that monitors user behavior. It&#8217;s possible to use generated logs to evaluate customer behavior,<strong><em> but the key challenge is to consolidate the logs i<\/em><\/strong>n<strong><em> one place and extract actionable insights quickly.<\/em><\/strong><\/p>\n\n\n\n<p>A<strong><em> log<\/em><\/strong> is a file that is generated automatically each time certain events take place in your system. Log files are generally time-stamped and can document everything that happens in OS or software applications behind the scenes, documenting anything that the server, network, OS, or application feels is necessary to keep track of.<\/p>\n\n\n\n<p> The process of handling log events created by all applications and infrastructure on which they are running is <strong><em>log management<\/em><\/strong>.<\/p>\n\n\n\n<p>To consolidate the Magento 2 logs into one place, we need a powerful log management tool like <strong><em>Kibana<\/em><\/strong>, that can be Used to analyze the large volume of logs.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><em>Kibana &#8211; Log Visualization<\/em><\/h2>\n\n\n\n<p>Kibana is a user-friendly and completely specified interface that allows a number of graphs to browse, scan, and visualize the data collected. The visualization features of Kibana enable you to visualize data using heat maps, line graphs, histograms, pie charts, and geospatial support in alternate ways.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"509\" src=\"https:\/\/cloudkul.com\/blog\/wp-content\/uploads\/2020\/10\/kibana-3-1024x509.png\" alt=\"\" class=\"wp-image-8356\" \/><\/figure>\n\n\n\n<p>It&#8217;s easy to understand big data with Kibana, and you can create and share dynamic <strong><em>dashboards<\/em><\/strong> easily to frame changes to the Elasticsearch query in real-time.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"527\" src=\"https:\/\/cloudkul.com\/blog\/wp-content\/uploads\/2020\/10\/Dashboard-1-5-1024x527.png\" alt=\"\" class=\"wp-image-8363\" \/><\/figure>\n\n\n\n<p>These logs can be analyzed in real-time once obtained by Logstash and stored in Elasticsearch and monitored using the rich <strong><em>visualization<\/em><\/strong> features of Kibana.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"510\" src=\"https:\/\/cloudkul.com\/blog\/wp-content\/uploads\/2020\/10\/visualizations2-11-1024x510.png\" alt=\"\" class=\"wp-image-8379\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Types of Magento 2 log files in Kibana<\/h2>\n\n\n\n<p>There are many logs files that will be created in Kibana like apache access and error logs, Magento system, debug, exception logs. Some of them are listed here &#8211; <\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Apache access logs <\/h3>\n\n\n\n<p>Access log files are used by Apache to record information about each visitor to your site. You can see which files visitors access, how requests are answered by the web server, and other details that visitors use, such as web browsers.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Apache error logs<\/h3>\n\n\n\n<p>The error logs will be used by Apache to document alerts that may signify a possible issue with a specific event or configuration.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Magento Exception logs<\/h3>\n\n\n\n<p>In Exception.log, all exceptions that occur on the Magento site are given. Ultimately, when Magento is unable to detect the correct data for loading a page or feature, an exception occurs. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Why use Kibana?<\/h2>\n\n\n\n<p>One should use kibana because of the following provided features &#8211; <\/p>\n\n\n\n<ul><li><span class=\"has-inline-color has-vivid-red-color\"><strong><em>Exploring details, document by document, or via specialized queries is one of Kibana&#8217;s most basic features.<\/em><\/strong><\/span><\/li><li><span class=\"has-inline-color has-vivid-red-color\"><strong><em>With this visualization feature, we can use the data in our indexes to construct graphs, maps, and other kinds of visualizations.<\/em><\/strong><\/span><\/li><li><span class=\"has-inline-color has-vivid-red-color\"><strong><em>A Dashboard is a collection of visualizations that will be sharing with users outside the network and modified in real-time.<\/em><\/strong><\/span><\/li><li><span class=\"has-inline-color has-vivid-red-color\"><strong><em>In order to view a user admin dashboard, indices, and documents, Kibana &#8216;s settings will customize its GUI. The entire ELK platform can also be tracked by Kibana, ensuring all is working.<\/em><\/strong><\/span><\/li><li><span class=\"has-inline-color has-vivid-red-color\"><strong><em>This visualization tool&#8217;s machine-learning feature lets you detect anomalies in your content. This skill helps you to recognize the root causes of problems.<\/em><\/strong><\/span><\/li><li><span class=\"has-inline-color has-vivid-red-color\"><strong><em>It ensures the safe sharing of the visualization and dashboards, as there is an option that limits the display of information to protect data leakage.<\/em><\/strong><\/span><\/li><li><span class=\"has-inline-color has-vivid-red-color\"><strong><em>One of Kibana&#8217;s best features is its reporting option, which allows you to produce your visualization or dashboard reports quickly. Reports will be created automatically by submitting HTTP POST requests and can be shared with others.<\/em><\/strong><\/span><\/li><\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Conclusion<\/h2>\n\n\n\n<p>In conclusion, it is a centralized logging solution, that integrates Magento with the ELK Stack, provides the ability to manage visitors&#8217; large number of logs and, then analyze that detail.<\/p>\n\n\n\n<p><strong>To get an EFK setup, you can visit our <em><a href=\"https:\/\/store.webkul.com\/\">store<\/a><\/em> and check our module <em><a href=\"https:\/\/store.webkul.com\/magento2-efk-setup.html\">EFK Setup for Magento 2<\/a><\/em> for further details.<\/strong><\/p>\n\n\n\n<p><strong>For further help or query, please <a href=\"https:\/\/cloudkul.com\/contact\/\">contact<\/a> us or raise a <a href=\"https:\/\/webkul.uvdesk.com\/en\/customer\/create-ticket\/\">ticket<\/a>.<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Magento is a powerful eCommerce platform that enables site managers to fully customize their stores <a class=\"text-primary\" title=\"read more\" href=\"https:\/\/cloudkul.com\/blog\/managing-and-monitoring-magento-2-logs-with-kibana\/\">[&#8230;]<\/a><\/p>\n","protected":false},"author":29,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[2,87,46,20,47,340,36],"tags":[114,24],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Managing and Monitoring Magento 2 logs with Kibana - Cloudkul<\/title>\n<meta name=\"description\" content=\"Kibana is a user-friendly and completely specified interface that allows a number of graphs to browse, scan, and visualize the data collected.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/cloudkul.com\/blog\/managing-and-monitoring-magento-2-logs-with-kibana\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Managing and Monitoring Magento 2 logs with Kibana - Cloudkul\" \/>\n<meta property=\"og:description\" content=\"Kibana is a user-friendly and completely specified interface that allows a number of graphs to browse, scan, and visualize the data collected.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/cloudkul.com\/blog\/managing-and-monitoring-magento-2-logs-with-kibana\/\" \/>\n<meta property=\"og:site_name\" content=\"Cloudkul\" \/>\n<meta property=\"article:published_time\" content=\"2020-10-06T09:41:53+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-11-23T09:51:16+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cloudkul.com\/blog\/wp-content\/uploads\/2020\/10\/kibana-3-1024x509.png\" \/>\n<meta name=\"author\" content=\"Tanya Garg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@https:\/\/twitter.com\/CloudWebkul\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/cloudkul.com\/blog\/managing-and-monitoring-magento-2-logs-with-kibana\/\",\"url\":\"https:\/\/cloudkul.com\/blog\/managing-and-monitoring-magento-2-logs-with-kibana\/\",\"name\":\"Managing and Monitoring Magento 2 logs with Kibana - Cloudkul\",\"isPartOf\":{\"@id\":\"https:\/\/cloudkul.com\/blog\/#website\"},\"datePublished\":\"2020-10-06T09:41:53+00:00\",\"dateModified\":\"2020-11-23T09:51:16+00:00\",\"author\":{\"@id\":\"https:\/\/cloudkul.com\/blog\/#\/schema\/person\/65b93d1aa584abd012eb60a25839b984\"},\"description\":\"Kibana is a user-friendly and completely specified interface that allows a number of graphs to browse, scan, and visualize the data collected.\",\"breadcrumb\":{\"@id\":\"https:\/\/cloudkul.com\/blog\/managing-and-monitoring-magento-2-logs-with-kibana\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/cloudkul.com\/blog\/managing-and-monitoring-magento-2-logs-with-kibana\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/cloudkul.com\/blog\/managing-and-monitoring-magento-2-logs-with-kibana\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/cloudkul.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Managing and Monitoring Magento 2 logs with Kibana\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/cloudkul.com\/blog\/#website\",\"url\":\"https:\/\/cloudkul.com\/blog\/\",\"name\":\"Cloudkul\",\"description\":\"Host your eCommerce Store on AWS with Optimized Performance\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/cloudkul.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/cloudkul.com\/blog\/#\/schema\/person\/65b93d1aa584abd012eb60a25839b984\",\"name\":\"Tanya Garg\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/cloudkul.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/9ea334eba6adf9dfe79873bc0bee8dad?s=96&d=https%3A%2F%2Fs.gravatar.com%2Favatar%2F6148c37469011bc2f8e491ca8f5de495%3Fs%3D80&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/9ea334eba6adf9dfe79873bc0bee8dad?s=96&d=https%3A%2F%2Fs.gravatar.com%2Favatar%2F6148c37469011bc2f8e491ca8f5de495%3Fs%3D80&r=g\",\"caption\":\"Tanya Garg\"},\"description\":\"Business Developer Executive at Webkul\",\"sameAs\":[\"https:\/\/cloudkul.com\/\",\"https:\/\/twitter.com\/https:\/\/twitter.com\/CloudWebkul\"],\"url\":\"https:\/\/cloudkul.com\/blog\/author\/tanyagarg-bd037\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Managing and Monitoring Magento 2 logs with Kibana - Cloudkul","description":"Kibana is a user-friendly and completely specified interface that allows a number of graphs to browse, scan, and visualize the data collected.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/cloudkul.com\/blog\/managing-and-monitoring-magento-2-logs-with-kibana\/","og_locale":"en_US","og_type":"article","og_title":"Managing and Monitoring Magento 2 logs with Kibana - Cloudkul","og_description":"Kibana is a user-friendly and completely specified interface that allows a number of graphs to browse, scan, and visualize the data collected.","og_url":"https:\/\/cloudkul.com\/blog\/managing-and-monitoring-magento-2-logs-with-kibana\/","og_site_name":"Cloudkul","article_published_time":"2020-10-06T09:41:53+00:00","article_modified_time":"2020-11-23T09:51:16+00:00","og_image":[{"url":"https:\/\/cloudkul.com\/blog\/wp-content\/uploads\/2020\/10\/kibana-3-1024x509.png"}],"author":"Tanya Garg","twitter_card":"summary_large_image","twitter_creator":"@https:\/\/twitter.com\/CloudWebkul","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/cloudkul.com\/blog\/managing-and-monitoring-magento-2-logs-with-kibana\/","url":"https:\/\/cloudkul.com\/blog\/managing-and-monitoring-magento-2-logs-with-kibana\/","name":"Managing and Monitoring Magento 2 logs with Kibana - Cloudkul","isPartOf":{"@id":"https:\/\/cloudkul.com\/blog\/#website"},"datePublished":"2020-10-06T09:41:53+00:00","dateModified":"2020-11-23T09:51:16+00:00","author":{"@id":"https:\/\/cloudkul.com\/blog\/#\/schema\/person\/65b93d1aa584abd012eb60a25839b984"},"description":"Kibana is a user-friendly and completely specified interface that allows a number of graphs to browse, scan, and visualize the data collected.","breadcrumb":{"@id":"https:\/\/cloudkul.com\/blog\/managing-and-monitoring-magento-2-logs-with-kibana\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/cloudkul.com\/blog\/managing-and-monitoring-magento-2-logs-with-kibana\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/cloudkul.com\/blog\/managing-and-monitoring-magento-2-logs-with-kibana\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/cloudkul.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Managing and Monitoring Magento 2 logs with Kibana"}]},{"@type":"WebSite","@id":"https:\/\/cloudkul.com\/blog\/#website","url":"https:\/\/cloudkul.com\/blog\/","name":"Cloudkul","description":"Host your eCommerce Store on AWS with Optimized Performance","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/cloudkul.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/cloudkul.com\/blog\/#\/schema\/person\/65b93d1aa584abd012eb60a25839b984","name":"Tanya Garg","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/cloudkul.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/9ea334eba6adf9dfe79873bc0bee8dad?s=96&d=https%3A%2F%2Fs.gravatar.com%2Favatar%2F6148c37469011bc2f8e491ca8f5de495%3Fs%3D80&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9ea334eba6adf9dfe79873bc0bee8dad?s=96&d=https%3A%2F%2Fs.gravatar.com%2Favatar%2F6148c37469011bc2f8e491ca8f5de495%3Fs%3D80&r=g","caption":"Tanya Garg"},"description":"Business Developer Executive at Webkul","sameAs":["https:\/\/cloudkul.com\/","https:\/\/twitter.com\/https:\/\/twitter.com\/CloudWebkul"],"url":"https:\/\/cloudkul.com\/blog\/author\/tanyagarg-bd037\/"}]}},"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/cloudkul.com\/blog\/wp-json\/wp\/v2\/posts\/8314"}],"collection":[{"href":"https:\/\/cloudkul.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cloudkul.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cloudkul.com\/blog\/wp-json\/wp\/v2\/users\/29"}],"replies":[{"embeddable":true,"href":"https:\/\/cloudkul.com\/blog\/wp-json\/wp\/v2\/comments?post=8314"}],"version-history":[{"count":17,"href":"https:\/\/cloudkul.com\/blog\/wp-json\/wp\/v2\/posts\/8314\/revisions"}],"predecessor-version":[{"id":8947,"href":"https:\/\/cloudkul.com\/blog\/wp-json\/wp\/v2\/posts\/8314\/revisions\/8947"}],"wp:attachment":[{"href":"https:\/\/cloudkul.com\/blog\/wp-json\/wp\/v2\/media?parent=8314"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cloudkul.com\/blog\/wp-json\/wp\/v2\/categories?post=8314"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cloudkul.com\/blog\/wp-json\/wp\/v2\/tags?post=8314"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}