Streaming Big Data with Spark Streaming and Scala - Hands On

BY
Udemy

Mode

Online

Fees

₹ 475 1299

Quick Facts

particular details
Medium of instructions English
Mode of learning Self study
Mode of Delivery Video and Text Based

Course and certificate fees

Fees information
₹ 475  ₹1,299
certificate availability

Yes

certificate providing authority

Udemy

The syllabus

Getting Started

  • Tip: Apply for a Twitter Developer Account now!
  • Introduction, and Getting Set Up
  • [Activity] Stream Live Tweets with Spark Streaming!
  • Udemy 101: Getting the Most From This Course

A Crash Course in Scala

  • [Activity] Scala Basics
  • [Exercise] Flow Control in Scala
  • [Exercise] Functions in Scala
  • [Excercise] Data Structures in Scala

Spark Streaming Concepts

  • Introduction to Spark
  • The Resilient Distributed Dataset (RDD)
  • [Activity] RDD's in action: simple word count application
  • Introduction to Spark Streaming
  • [Activity] Revisiting the PrintTweets application
  • Windowing: Aggregating data over longer time spans
  • Fault Tolerance in Spark Streaming

Spark Streaming Examples with Twitter

  • [Exercise] Saving Tweets to Disk
  • [Exercise] Tracking the Average Tweet Length
  • [Exercise] Tracking the Most Popular Hashtags

Spark Streaming Examples with Clickstream / Apache Access Log Data

  • [Exercise] Tracking the Top URL's Requested
  • [Exercise] Alarming on Log Errors
  • [Exercise] Integrating Spark Streaming with Spark SQL
  • Intro to Structured Streaming
  • [Activity] Analyzing Apache Log files with Structured Streaming

Integrating with Other Systems

  • Integrating with Apache Kafka
  • Integrating with Apache Flume
  • Integrating with Amazon Kinesis
  • [Activity] Writing Custom Data Receivers
  • Integrating with Cassandra

Advanced Spark Streaming Examples

  • [Exercise] Stateful Information in Spark Streams
  • [Activity] Streaming K-Means Clustering
  • [Activity] Streaming Linear Regression

Spark Streaming in Production

  • [Activity] Packaging and running Spark code in production
  • [Activity] Packaging your code with SBT
  • Running on a real Hadoop cluster with EMR
  • Troubleshooting and Tuning Spark Jobs

You Made It!

  • Learning More
  • Bonus Lecture: More courses to explore!

Instructors

Mr Frank Kane

Mr Frank Kane
Founder
Freelancer

Trending Courses

Popular Courses

Popular Platforms

Learn more about the Courses

Download the Careers360 App on your Android phone

Regular exam updates, QnA, Predictors, College Applications & E-books now on your Mobile

Careers360 App
150M+ Students
30,000+ Colleges
500+ Exams
1500+ E-books