Apache Kafka A-Z with Hands on Learning

BY
Udemy

Obtain a practical understanding of the foundational concepts and procedures related to Apache Kafka.

Mode

Online

Fees

₹ 2699

Quick Facts

particular details
Medium of instructions English
Mode of learning Self study
Mode of Delivery Video and Text Based

Course overview

Apache Kafka is a distributed information store that is designed to accept and handle streaming information. This continuous inflow of data requires a streaming platform that can handle it progressively and sequentially. Apache Kafka A-Z with Hands-on Learning online certification is developed by Learnkart Technology Pvt Ltd - a virtual platform that offers a variety of courses, which is delivered by Udemy.

Apache Kafka A-Z with Hands-on Learning online course is intended for individuals who want to fully comprehend Apache Kafka so they can include it in their solutions frameworks. With more than 9.5 hours of digital lessons and 25 downloadable resources that follow industry best practices, Apache Kafka A-Z with Hands-on Learning online classes aims to help individuals design Apache Kafka and teach them how Apache Kafka is used to store and processing numerous uninterrupted streams of information more quickly and effectively.

The highlights

  • Certificate of completion
  • Self-paced course
  • 9.5 hours of pre-recorded video content
  • 25 downloadable resources
  • Assignments

Program offerings

  • Online course
  • Learning resources
  • 30-day money-back guarantee
  • Unlimited access
  • Accessible on mobile devices and tv

Course and certificate fees

Fees information
₹ 2,699
certificate availability

Yes

certificate providing authority

Udemy

What you will learn

Knowledge of kafka Web application development skills

After completing the Apache Kafka A-Z with Hands-on Learning certification course, individuals will be introduced to the advanced concepts of Apache Kafka and Apache Storm for developing applications. Individuals will explore various aspects of Kafka including consumer API, Producer API, brokers, partitions, and topics. Individuals will gain knowledge of the methods utilized by Kafka source, Kafka sink connectors, and Kafka schema registry. Additionally, individuals will learn about Flume agents for transferring data from Kafka to HDFS and gain knowledge on how to protect Kafka using SSL.

The syllabus

Course Introduction

  • Introduction

Lesson 1: Getting Started with Big Data and Apache Kafka

  • Learning Objective
  • Data Evolution Over Time
  • Big Data Overview
  • Big Data Analytics
  • Messaging System
  • Introduction and Features of Kafka
  • Kafka Usecases
  • Kafka Terminologies
  • Kafka Components
  • Kafka Architecture
  • Kafka Clusters
  • Kafka Industry Usecases
  • Demo - Install Zookeeper
  • Demo - Install Kafka
  • Demo - Setup a Single Node Single Broker Cluster
  • Demo - Setup a Multi Node Single Broker Cluster
  • Key Takeaway
  • Knowledge Check

Lesson 2: Kafka Producer

  • Learning Objective
  • Overview of Producer and It's Architecture
  • Kafka Producer Configuration
  • Kafka Producer Optional Configuration
  • Kafka Producer Configuration Objects
  • Demo - Create a Kafka Producer
  • Sending Messages
  • Serializers and Custom Serializers
  • Demo - Creating a Custom Serializer
  • Serializers Challenges and Serializing using Apache Avro
  • Demo - Serializing Using Apache Avro
  • Partitions
  • Demo - Setup Custom Partition
  • Key Takeaway
  • Knowledge Check

Lesson 3: Kafka Consumer

  • Learning Objective
  • Overview of Kafka Consumer
  • Consumer Groups
  • Partition Rebalance and Creating a Consumer
  • Poll loop and Its Functioning
  • Kafka Configuring Consumer - Part 1
  • Kafka Consumer Configuration - Part 2
  • Demo - Create Kafka Consumer
  • Commit and Offset
  • Ways of Commiting Offset - Automatic Offset
  • Ways of Commiting Offset - Commit Current Offset
  • Ways of Commiting Offset - Asynchronous Commit
  • Ways of Commiting Offset - Combining Synchronous and Asynchronous Commits
  • Ways of Commiting Offset - Commit Specified Offset
  • Rebalance Listeners
  • Consuming Records with Specific Offset
  • Deserializers
  • Demo - Create and Use Custom Deserializer
  • Key Takeaway
  • Knowledge Check

Lesson 4: Kafka Operations and Performance Tuning

  • Learning Objective
  • Kafka Internals Overview
  • Replication and Replica Types
  • Preffered Ladder, Request and Request Processing
  • Types of Requests
  • Partition Allocation, File Management and Segments
  • File Format, Index and Compaction
  • Kafka Reliability and Reliablity Methods
  • Broker Configuration for Replication
  • Producer in Reliable System
  • Consumer in Reliable System
  • Key Takeaway
  • Knowledge Check

Lesson 5: Kafka Cluster Architectures and Administering Kafka

  • Learning Objective
  • Cluster Mirroring
  • Multi Cluster Architecture - Hub, Spokes, and Active Active Architecture
  • Multi Cluster Architecture - Active-Standby Architecture and Strech Clusters
  • MirrorMaker Configuration
  • MirrorMaker Deployment and Tuning
  • Demo - Setting up MirrorMaker
  • Administering Kafka - Topic Operations
  • Administering Kafka - Consumer Group Operations
  • Dynamic Configuration Changes
  • Partition Management
  • Console Producer Tool
  • Console Consumer Tool
  • Key Takeaway
  • Knowledge Check

Lesson 6: Kafka Monitoring and Schema Registry

  • Learning Objective
  • Monitoring and Its Importance
  • Server or Infrastructure Monitoring and Application Monitoring
  • Kafka Monitoring
  • Kafka Broker Metrics - Under Replicated Partitions
  • Kafka Broker Metrics - Others
  • Topic and Partition Specific Metrics
  • Logging and Client Monitoring
  • Producer and Consumer Metrics
  • Quotas and Lag Monitoring
  • Monitoring Dashboard
  • Demo - Setting up Open Source Health Monitor
  • Kafka Schema Registry
  • Kafka Component and Architecture
  • Kafka Schema Registry - Internal working and Use-cases
  • Kafka Schema Registry Working
  • Demo - Using Kafka Schema Registry With Kafka
  • Key Takeaway
  • Knowledge Check

Lesson 7: Kafka Streams and Kafka Connectors

  • Learning Objective
  • Kafka Stream Overview
  • Kafka Stream
  • Kafka Stream Architecture and Working
  • Kafka Stream Components
  • Kafka Stream Architecture Tasks, Threading Model and Local State Store
  • Kafka Stream Architecture - Record Buffer
  • Memory Management and Streaming Data Pipeline
  • Kafka Stream DSL
  • K-Stream Operations
  • K-Table
  • K-Table Operations
  • Aggregation and Windowing
  • Processor Topology and Stream Processor
  • Stream and Processor APIs
  • Processor APIs - Create Topology
  • Kafka Connectors
  • Standalone and Sink Connector Configuration
  • Running Kafka Connect
  • Kafka Connector Distributed Mode
  • HTTP Rest Interface
  • Demo - Kafka Connector
  • Demo - Create an Application using Kafka Streams
  • Key Takeaway
  • Knowledge Check

Lesson 8: Integration of Kafka with Storm

  • Learning Objective
  • Apache Storm
  • Real-time Analytics
  • Apache Storm Architecture
  • Apache Storm Components
  • Apache Storm Topology Part - 1
  • Apache Storm Topology Part - 2
  • Kafka Spout
  • Integration of Apache Storm and Kafka
  • Demo - Simple Standalone Application using Kafka and Storm
  • Key Takeaway
  • Knowledge Check

Lesson 9: Kafka Integration with Spark and Flume

  • Learning Objective
  • Introduction to Spark
  • Spark Components
  • Resilient Distributed Dataset
  • RDD Operations - Transformation - Map, FlatMap and Filter
  • RDD Operations - Transformation - Join, Distinct, First and Take
  • RDD Operations - Actions
  • Data Sets and Spark Session
  • Data Sets and Spark Session Operations
  • Spark Stream
  • Spark Integration with Kafka
  • Demo - Running Small Standalone Application in Spark with Kafka
  • Flume
  • Flume Connectors
  • Flume Kafka to HDFS Configuration
  • Demo - Creating Flume agent Sending data from Kafka to HDFS
  • Key Takeaway
  • Knowledge Check

Lesson 10: Admin Client and Securing Kafka

  • Learning Objective
  • Admin Client
  • Demo - Perform Various Admin Tasks using Admin Client
  • Kafka Security
  • Kafka Security Component
  • SASL
  • Configure SSL in Kafka
  • Secure using ACLs
  • Key Takeway
  • Knowledge Check

Trending Courses

Popular Courses

Popular Platforms

Learn more about the Courses

Download the Careers360 App on your Android phone

Regular exam updates, QnA, Predictors, College Applications & E-books now on your Mobile

Careers360 App
150M+ Students
30,000+ Colleges
500+ Exams
1500+ E-books