Real-Time Data Ingestion in Elasticsearch through kafka (Udemy.com)

Real-Time Data Ingestion in Elasticsearch through kafka,logstash,apache monitor and kibana

Created by: Vijay Garg

Produced in 2018

icon
What you will learn

  • Students would be able to learn real time data ingestion in elasticsearch through very popular tools ES,Kafka,Logstash,Kibana and Apache Monitor. It's a very powerful approach to process any kind of data like log files etc and ingest into ES and then we can easily search on Kibana. Students can also learn all the tools individually (setup,configuration etc) like kafka,es,kibana and then we will integrate all these tools to create single data pipeline.

icon
Quality Score

Content Quality
/
Video Quality
/
Qualified Instructor
/
Course Pace
/
Course Depth & Coverage
/

Overall Score : 50 / 100

icon
Course Description

The Elastic stack and Apache Kafka share a tight-knit relationship in the log/event processing realm. A number of companies use Kafka as a transport layer for storing and processing large volumes of data. In many deployments we've seen in the field, Kafka plays an important role of staging data before making its way into Elasticsearch for fast search and analytical capabilities. I'd like to shine more light on how to set up and manage Kafka when integrating with the Elastic Stack. Specifically, we'll discuss our experiences operating Kafka and Logstash under high volume.
We will create a single data pipeline to process huge data with the help of kafka,logstash,apache monitor and kibana. Once we implement this we just need to put input files into source folder/directory and data will automatically get ingested into Elasticsearch and we can search/visualize data on ES web interface that is called Kibana.Who this course is for:
  • Any one including students, professional who wants to learn real time data ingestion in elasticsearch. It's a very powerful approach to process any kind of data like log files etc and ingest into ES and then we can easily search on Kibana

icon
Instructor Details

placeholder

Hello everyone, I am having around 10 yrs of IT exp and from past around 5 years I am completely working on Big-Data/Hadoop side. I worked on almost all the flavors of Big-Data like MapReduce,PIG,Hive,Sqoop,Flume,Spark,Scala,Hbase etc. Currently I am associated with one of the company as a Big-Data Technical Lead. In my part time I use to write contents on Big-Data and also provides training to the students on Big-Data related stuff;s.

icon
Reviews

2.5

12 total reviews

5 star 4 star 3 star 2 star 1 star
% Complete
% Complete
% Complete
% Complete
% Complete

By John Auld

The presenter has a very strong accent and I am barely able to understand him.

By Anil Kumar

Nice explanation !

By Dcd Dcd

me esperaba que entrara mas en profunidad.

no se entiende muy bien a la persona que habla.

By Juan Aramis

What I love of this course is there is not waste of time in any part, just direct to the use case and its resolution. Entire pipeline without a lot of details.

Congratulations

By SANDEEP KUMAR CHOPPARA

not much info is provided

By Nikolai Ashanin

Worst course ever. I have added a note via my twitter. Worst accent ever. Can't explain basic things. And "OK" every 2 seconds. Please work on your speech before make a course. 12$ for nothing I have spent and my time as well...

The presenter has a very strong accent and I am barely able to understand him.

Nice explanation !

me esperaba que entrara mas en profunidad.
no se entiende muy bien a la persona que habla.

What I love of this course is there is not waste of time in any part, just direct to the use case and its resolution. Entire pipeline without a lot of details.
Congratulations

not much info is provided

Worst course ever. I have added a note via my twitter. Worst accent ever. Can't explain basic things. And "OK" every 2 seconds. Please work on your speech before make a course. 12$ for nothing I have spent and my time as well...