Complete ElasticSearch with LogStash, Hive, Pig, MR & Kibana (Udemy.com)
ELK Stack (ElasticSearch - LogStash - Kibana) including hands-on practicals with Apache Hadoop, Hive, PIG & MapReduce
Created by: DataShark Academy
Last updated December 2018
What you will learn
- Advance your career in Big data by learning how to integrate ElasticSearch on Hadoop Ecosystem and create real world data pipelines for your big data applications.
- Develop sound understanding of data ingestion, integration across systems, full text search & data analytics.
- Develop in demand skills for building Data Pipelines using Apache Hive, Pig, MapReduce (Java), & LogStash to index data into ElasticSearch clusters for quick data analytics and text searching.
- Advance your career by applying for an awesome job with great pay.
- Develop awesome data visualizations using Kibana.
Quality Score
Overall Score : 76 / 100
Course Description
Learn how to use ElasticSearch with Apache Hadoop and build various real world big data applications.
This comprehensive course focuses on building real world like data applications to move data from one system to another. A common practice for any data engineer today. No other course can cover so much ground as you will do in this one.
In this course you will learn:
Section 1 Ingestion Flows (Hadoop to ElasticSearch)
In this section of the course, you will learn to move data from various Hadoop applications (such as Hive, Pig, MR) & LogStash into an ElasticSearch index. This is an ideal business use case to prepare data for business analytics. Here are four major topics that will be covered in this section of the course:
- Learn how to install Apache Hive on your computer. Then read data from a hive table and load it into ElasticSearch
- Learn how to install Apache PIG on your computer and index data into ElasticSearch using Apache PIG
- Create a MapReduce program (Java code) and load data into an ElasticSearch index
- Learn how to move data using LogStash into an ElasticSearch index
Section 2 Egression Flows (ElasticSearch to Hadoop)
In this section of the course, you will learn to use indexed data from an ElasticSearch cluster and load it back into Hadoop cluster. After data is loaded back into Hadoop, you will learn how to directly import it into Hive, Pig, M/R or LogStash. Here are four major topics that we will cover under this section:
- Learn how to import an ElasticSearch index directly into Apache Hive table
- Learn how to import an ElasticSearch indexed data into Hadoop using Apache PIG scripts
- Learn how to import an ElasticSearch indexed data into Hadoop using Java MapReduce program
- Learn how to import an ElasticSearch indexed data using LogStash application
Section 3 Data Visualization (Business Intelligence)
In part of the course, you will learn how to use indexed data from an ElasticSearch cluster and create dynamic dashboards using Kibana.
This will be a very important lesson for Data Analysts and Data Scientists.
Section 4 Production Cluster Monitor tool (Administration)
No knowledge is complete without learning how to maintain an application in production. In this section of the course, you will learn how to monitor your ElasticSearch cluster using Marvel plugins. Here are few things that you will learn:
- Cluster Health monitoring at Index, Shard, Node levels
- Parsing ElasticSearch Cluster statistics using Linux utilities
- Setting up wait-for-trigger mechanism and much more
Section 5 - Searching an ElasticSearch Index
- Learn about awesome search capabilities offered by ElasticSearch
- How to search something from an ElasticSearch index in real time.
You will also get step by step instructions for installing all required tools and components on your machine in order to run all examples provided in this course. Each video will explain entire process in detail and easy to understand manner.
You will get access to working code for you to play with it and expand on it. All code examples are working and will be demonstrated in video lessons.
Windows users will need to install virtual machine on their PC to setup single node hadoop cluster. Detailed Instructions are available inside the course.Who this course is for:
- This will be an excellent course for anyone who wants to learn about Big Data technologies and how to use them together in order to create amazing Big Data applications.
- Big Data Developers, Architects, Data Scientists, Data Analysts and Students (with zero experience)
Instructor Details
- 3.8 Rating
74 Reviews
DataShark Academy
We provide the fastest route to Hadoop and Big Data Expertise.
Providing accelerated learning programs taught by professionals with years of expertise in Big Data technologies. A unique approach that focuses on maximum results in the shortest possible time. Quality lecture videos reinforced with instructional and hands-on lab videos and, review tests.
Don't waste hours of valuable time watching long boring videos only to find you are still not prepared for the job.
More courses by DataShark Academy
Mastering Apache SQOOP with Hadoop,Hive, MySQL (Mac & Win) (2018)
4.1 (44 Reviews)
Provider: Udemy
Time: 3.6h
$29.99
More Elastic Search courses
Elasticsearch Masterclass: ES|QL, Vector, and More (2025)
4.8 (1,037 Reviews)
Provider: Udemy
Time: 6.4h
$84.99
ElasticSearch as you have never known it before (2026)
4.7 (231 Reviews)
Provider: Udemy
Time: 5.8h
$49.99
Apache Kafka Series - Kafka Connect Hands-on Learning (2026)
4.6 (5,936 Reviews)
Provider: Udemy
Time: 4.5h
$94.99
Data Processing with Logstash (and Filebeat) (2021)
4.6 (3,371 Reviews)
Provider: Udemy
Time: 5.5h
$84.99
Elasticsearch 8, Kibana, Logstash, Beats: ELK Stack (2026)
4.6 (1,428 Reviews)
Provider: Udemy
Time: 3.1h
$74.99
Reviews
By Edwin Jerome
I loved it
By Sarika Israni
Great detailed information on topic. Explained Perfectly by instructor .Should be Priced high as its Worth is More than actually Priced.
By Roy Wasonga
I still don't much understand much yet.
By Johann Liang
Taking this course is very frustrating. The instructor breaks up sentences into individual sections, e.g., one of the sections is 14 seconds long! and almost all these sub-minute sections come with 5-10 seconds of silence at the end. Since Udemy automatically inserts 4 seconds of delay between sections, these long periods of silence adds up and keep interrupting and slowing down your thought process. Are these concepts so distinct that it is worth having 10+ 1-minute sections to form a chapter? Please consider combining those sub-minute/1-minute sections into longer ones and cutting out the moments of silence at the end.
By Ishana isha
This course is a brilliant training to be a please entrance for the elastic search.I can absolutely recommend for the trainees who haven't met with elastic search before.Contents are well designed and quite satisfied.This is a useful course for people interested in learning ElasticSearch. No fluff added, every single topic is valuable.
Thank you!
By Kannan Chith
Demo looks good and promising ..
By Sreekanth
Actually its 5 star so far, but I would like to go through the rest of the lessons.
It started well, but somehow the instructor assumed that the entire world works on Mac. His instructions for the installation of Hadoop etc are only for Mac users
He should have mentioned in the course title "For Mac users only".
This is unprofessional stuff.
By Pittala Venu
Very good explanation on each topic and I will revisit this videos ,need to do some practice, well done !!! Thanks.
By Amr
So far it's quite normal. I was expecting a more powerful slides with graphs support the audio instead of just couple of lines.
I mean by expecting powerful slides is expecting more examples to make sure the info has been swallowed by the audience.
Moreover, I received exceptions/responses while I followed the steps stated by the instructor; How can I share them with the instructor to help me?
Thanks :)
By Cássio Kawabata
Elasticsearch version 1.7??
Really?
Great detailed information on topic. Explained Perfectly by instructor .Should be Priced high as its Worth is More than actually Priced.







