Learn at your own pace! Lifetime access to all course videos and materials for this course, with a one-time payment.

Hadoop tutorial with MapReduce, HDFS, Spark, Flink, Hive, HBase, MongoDB, Cassandra, Kafka + more! Over 25 technologies. Includes 14.5 hours of on-demand video and a certificate of completion.

Also available at Udemy

Buy This Course

$29.99

Enroll

Course Information

Tracks: Big Data

Categories: Big Data

Tags: Certificate of completion, Copy of slides, English closed captions, Exclusive student forum, Lifetime video access, Priority support

The world of Hadoop and “Big Data” can be intimidating – hundreds of different technologies with cryptic names form the Hadoop ecosystem. With this Hadoop tutorial, you’ll not only understand what those systems are and how they fit together – but you’ll go hands-on and learn how to use them to solve real business problems!

Learn and master the most popular big data technologies in this comprehensive course, taught by a former engineer and senior manager from Amazon and IMDb. We’ll go way beyond Hadoop itself, and dive into all sorts of distributed systems you may need to integrate with.

  • Install and work with a real Hadoop installation right on your desktop with Hortonworks (now part of Cloudera) and the Ambari UI
  • Manage big data on a cluster with HDFS and MapReduce
  • Write programs to analyze data on Hadoop with Pig and Spark
  • Store and query your data with Sqoop, Hive, MySQL, HBase, Cassandra, MongoDB, Drill, Phoenix, and Presto
  • Design real-world systems using the Hadoop ecosystem
  • Learn how your cluster is managed with YARN, Mesos, Zookeeper, Oozie, Zeppelin, and Hue
  • Handle streaming data in real time with Kafka, Flume, Spark Streaming, Flink, and Storm

Understanding Hadoop is a highly valuable skill for anyone working at companies with large amounts of data.

Almost every large company you might want to work at uses Hadoop in some way, including Amazon, Ebay, Facebook, Google, LinkedIn, IBM,  Spotify, Twitter, and Yahoo! And it’s not just technology companies that need Hadoop; even the New York Times uses Hadoop for processing images.

This course is comprehensive, covering over 25 different technologies in over 14 hours of video lectures. It’s filled with hands-on activities and exercises, so you get some real experience in using Hadoop – it’s not just theory.

You’ll find a range of activities in this course for people at every level. If you’re a project manager who just wants to learn the buzzwords, there are web UI’s for many of the activities in the course that require no programming knowledge. If you’re comfortable with command lines, we’ll show you how to work with them too. And if you’re a programmer, I’ll challenge you with writing real scripts on a Hadoop system using Scala, Pig Latin, and Python.

You’ll walk away from this course with a real, deep understanding of Hadoop and its associated distributed systems, and you can apply Hadoop to real-world problems. Plus a valuable completion certificate is waiting for you at the end!

Please note the focus on this course is on application development, not Hadoop administration. Although you will pick up some administration skills along the way.

Knowing how to wrangle “big data” is an incredibly valuable skill for today’s top tech employers. Don’t be left behind – enroll now!

Andrew Corkill

This is an excellent course for someone looking to understand the Hadoop eco-system as a whole. While it covers a lot of different technologies, they are still covered in enough detail with working examples to gain sufficient understanding about the basics to get started (the hardest step), and also about what the problem the technology solves, and its strengths and weaknesses. The most valuable part of all this information for me was not just the information about when to use this technology, but the consistent comparison between the technology and other similar technologies, giving a great set of points to decide which to use in a given business case, and how to combine the technologies into a system. This was invaluable given the number of technologies around that all do similar things, and this really helped clear up decision making process. Good job Frank. A+

Bobby Baker

Frank is one of the best instructors on any platform! His clear explanations, obviously from years of hands on, real world experience, and course flow make it a pleasure to learn from Frank. I’m a 40 yr veteran of IT and always learn from Frank’s courses!

Jose Eduardo Thurler Tecles

Great course! I had no previous knowledge about Hadoop and I learned a lot. Very clear explanations, good hands-on practices.

Varun Tyagi

The instructor explained everything very very clearly. The best part is the hands-on work after introducing every technology. I would recommend this course to every aspiring Big Data Engineer or professional

Course Instructor

Frank Kane Author

Our courses are led by Frank Kane, a former Amazon and IMDb developer with extensive experience in machine learning and data science. With 26 issued patents and 9 years of experience at the forefront of recommendation systems, Frank brings real-world expertise to his teaching. His ability to explain complex concepts in accessible terms has helped over one million students worldwide gain valuable skills in machine learning, data engineering, and AI development.

Learn all the buzzwords! And install the Hortonworks Data Platform Sandbox.

If you have trouble downloading Hortonworks Data Platform…

Using Hadoop’s Core: HDFS and MapReduce

HDFS: What it is, and how it works.

Programming Hadoop with Pig

Introducing Ambari and finding old 5-star movies using Pig.

Programming Hadoop with Spark

Why Spark? and finding the movie with the lowest average rating.

Using relational data stores with Hadoop

What is Hive? and using Hive to find the most popular movie.

Using non-relational data stores with Hadoop

Why NoSQL? and importing movie ratings into HBase.

Feeding Data to your Cluster

Kafka explained and setting up Kafka, and publishing some data.

Analyzing Streams of Data

Spark Streaming: Introduction and analyzing web logs published with Flume using Spark Streaming.

Designing Real-World Systems

Review: How the pieces fit together and understanding your requirements.

Learning More

Books and online resources to continue your Learning Journey!