Data Processing with Logstash (and Filebeat) (Udemy.com)

Process data with Logstash, which is a key part of the ELK stack (Elasticsearch, Logstash, Kibana) and Elastic Stack.

Created by: Bo Andersen

Last updated June 2021

icon
What you will learn

  • Understand the fundamental concepts of Logstash
  • Build pipelines that process and manipulates thousands of events
  • Send data to Logstash from numerous sources and to several destinations
  • Build a fully functional pipeline that handles Apache web server logs
  • Process Filebeat events with Logstash

icon
Quality Score

Content Quality
/
Video Quality
/
Qualified Instructor
/
Course Pace
/
Course Depth & Coverage
/

Overall Score : 94 / 100

icon
Course Description

Want to learn how to process events with Logstash? Then you have come to the right place; this course is by far the most comprehensive course on Logstash here at Udemy! This course specifically covers Logstash, meaning than we can go into much more detail than if this course covered the entire Elastic Stack. So if you want to learn Logstash specifically, then this course is for you!

This course assumes no prior knowledge of or experience with Logstash. We start from the very basics and gradually transition into more advanced topics. The course is designed so that you can follow along the whole time step by step, and you can find all of the configuration files within a GitHub repository. The course covers topics such as handling Apache web server logs (both access and error logs), data enrichment, sending data to Elasticsearch, visualizing data with Kibana, along with covering a number of popular use cases that you are likely to come across. Upon completing this course, you will know all of the most important aspects of Logstash, and will be able to build complex pipeline configurations and process many different kinds of events and data.

What is Logstash?
In case you don't know what Logstash is all about, it is an event processing engine developed by the company behind Elasticsearch, Kibana, and more. Logstash is often used as a key part of the ELK stack or Elastic Stack, so it offers a strong synergy with these technologies. You can use Logstash for processing many different kinds of events, and an event can be many things. You can process access or error logs from a web server, or you can send events to Logstash from an e-commerce application, such as when an order was received or a payment was processed. You can ingest data from files (flat files, JSON, XML, CSV, etc.), receive data over HTTP or TCP, retrieve data from databases, and more. Logstash then enables you to process and manipulate the events before sending them to a destination of your choice, such as Elasticsearch, OpenSearch, e-mail, or Slack.

Why do we need Logstash?
Because by sending events to Logstash, you decouple things. You effectively move event processing out of the web application and into Logstash, representing the entire data pipeline, or perhaps just a part of it. This means that if you need to change how events are processed, you don’t need to deploy a new version of a web application, for instance. The event processing and its configuration is centralized within Logstash instead of every place you trigger events. This means that all the web application needs to do, is to send an event to Logstash; it doesn’t need to know anything about what happens to the event afterwards and where it ends up. This improves your architecture and lets Logstash do what it does best; process events.

Let's get started!
I hope that you are ready to begin learning Logstash. Have a look around the curriculum if you want to check out the course content in more details. I look forward to seeing you inside the course!

icon
Instructor Details

Bo Andersen

My name is Bo Andersen and I am a software engineer from Denmark.

I currently work as the lead developer and partner at a startup company, apart from teaching here at Udemy. I have previously worked at a very successful company, operating one of the largest websites in Denmark, before deciding to teach software engineering.

I have worked with programming for a decade and have a bachelor's degree in computer science. I started out learning to code by building websites in my spare time, and have since worked with many technologies such as Python, PHP, Postgres, MySQL, Docker, AWS, etc. Apart from the ELK Stack  (Elasticsearch, Logstash, Kibana) and Elastic Stack, of course.

icon
More courses by Bo Andersen

Complete Guide to Elasticsearch

$94.99

Data Visualization with Kibana

$74.99

Vue JS 2: From Beginner to Professional (includes Vuex)

$11.99

icon
More elastic search courses

Spring Boot Microservices and Spring Cloud

$11.99

The Flask Mega-Tutorial (Python Web Development)

$11.99

Apache Kafka Series - Learn Apache Kafka for Beginners v3

$99.99

Complete Guide to Elasticsearch

$94.99

Apache Kafka Series - Kafka Connect Hands-on Learning

$94.99

Elasticsearch 8, Kibana, Logstash, Beats: ELK Stack

$74.99

icon
Reviews

4.7

3370 total reviews

5 star 4 star 3 star 2 star 1 star
% Complete
% Complete
% Complete
% Complete
% Complete

By Markus Spengler on 6/14/2024

Again, I followed your great course. As usual, you clearly present and pronounce the content, which provides a deep learning experience. However, this time it was sometimes challenging to recap or use the Logstash product with the current version while following along with the training content, as some of it is a bit outdated. An update would be very welcome.

By Emanuele Pecchioli on 9/2/2023

We all know that the course unfortunately is not up to date with the newer versions of Logstash, Elasticsearch and Kibana, so if you'll follow along it will be harder to fix and adapt all the things that will not work. However if you take this as a challenge, it will be a great exercise, and Bo's content is as usual very very good. To make the most of the course, I'd recommend to take Bo's two other courses first: Elasticsearch and Kibana. I'd like to thank Bo for his three courses, I loved following all of them and I think they are the best courses on the Elastic Stack.

By Miguel de Diego Gómez on 12/20/2022

The course is good, however you get a point where it is very difficult to follow. Everything is made over an IDE and you get lost, you must remember too many things. I think it would be better with more explanations with graphics and pictures. Again, when reaching the end of the course you are completelly lost. All the course is focused on Apache event logs, this makes the course very specific...may be it should be a bit more general

By Olivier O on 11/2/2022

i learnt a great deal about Logstash & filebeat & Bo is definitely an Elasticsearch SME 3 recommendations from me: * the course definitely need to be updated as LS & FB have released new features & a few things within the course have become outdated * it will be best to walk students through on setting up POSTMAN * it will be good to add a section on installing configuring Elasticsearch so we can view these fields we're manipulating within discovery rather than only being limited to the stdout option which will make the course complete IMO

By Ireneusz Sobkowicz on 6/18/2022

The course contains many useful and practical examples of logstash and filebeat configuration implementation and practical use cases. I didn't know anything about ELK before, and after learning it in a week, I set up and started up my first production ELK stack. Without the knowledge from this course, it would not be that easy. I recommend it a lot. Thank you Bo!

By Brianne Corbett on 5/28/2021

The course is quite a bit more difficult than the Kibana course by Bo. He is clearly an expert in the subject matter. But the content is dense and it moves very fast. It requires some substantial knowledge of Grok and other things. So I view it as reference material rather than a simple how to. I will have to return to it in real life to review how he does things and why.

By George Stavroulakis on 10/11/2020

The course is quite detailed and with the examples provided, understanding is highly improved. The ELK itself is a bit of low level (Log File based) configuration, thus it can get pretty complicated to understand. The only issue you might encounter, is that some lectures refer to previous versions, so you will need to adjust the terminology to what u actually see.

By Syed Ghani on 6/23/2020

After beating my head trying to understand and configure logstash for a particular project and failing, I went through this course. Not only is the course thorough, it provides a great insight into how things really work. Having gone through this course, I am now confidentally able to configure for not only the project that I was working on, but for upcoming projects as well. Thank you, Bo, for putting the time in to learn and more importantly to explain it to the rest of us. This was a wonderful course and I thoroughly enjoyed it.

By John Ryan on 4/13/2020

Bo knows this stuff inside and out and will give you the reasons of why one approach is different than the other, as well as , recommendations on which to choose when available. I've already used this information to solve an issue at work with pipelines. If you are really interested in learning Logstash standalone and Logstash with Filebeat, you need to check this course out!! Highly Recommended!! Expect to learn when you learn from a Master!

By Olamide Olajide on 3/30/2020

I usually don't write reviews when I have a good experience. But in this case, I am not just clicking on the button to rate the course, but would also like to state that Bo Andersen is a phenomenal teacher. He starts from the simplest concepts all the up to the most complex use cases and he makes it easy for you to understand that follow-through. I would recommend this course to anyone that's serious about learning Logstash and Filebeat. Thank you Bo!