Apache Kafka Certification Training

Course Content

Section 01 - Introduction to Apache Kafka

• Lesson 01 Course Introduction
  • Course Introduction
• Lesson 02 - Big Data Overview
  • Big Data Overview
• Lesson 03 - Big Data Analytics
  • Big Data Analytics
• Lesson 04 - Messaging System
  • Messaging System
• Lesson 05 - Kafka Overview
  • Introduction and Features of Kafka
  • Kafka Usercases
• Lesson 06 - Kafka Components and Architecture
  • Kafka Terminologies
  • Kafka Components
  • Kafka Architecture
• Lesson 07 - Kafka Clusters
  • Kafka Clusters
• Lesson 08 - Kafka Industry Usecases
  • Kafka Industry Usecases
• Lesson 09 - Demo: Install Kafka and Zookeeper
  • DEMO: Install zookeeper
  • Demo: Install Kafka
• Lesson 10 - Demo: Single Node Single-Multi Broker Cluster
  • DEMO: Setup A Single Node Single Broker Cluster
  • DEMO: Setup A multi Node Single Broker Cluster
• Lesson 11 - Key Takeaways
  • Key Takeaways

Section 02 - Kafka Producer

• Lesson 01 - Overview of Producer and Its Architecture
  • Learning Objectives
• Lesson 02 - Kafka Producer Configuration
  • Kafka Producer Configuration
  • Kafka Producer Optional Configuration
  • Kafka Producer Configuration Objects
  • Demo: Create a Kafka Producer
• Lesson 03 - Send Messages
  • Sending Messages
• Lesson 04 - Serializers
  • Serializers and Custom Serializers
  • Demo: Creating a Custom Serializer
  • Serializers Challenges and Serializing using Apache Avro
  • Demo: Serializing Using Apache Avro
• Lesson 05 - Partitions
  • Partitions
  • Demo: Setup Custom Partition
• Lesson 06 - Key Takeaways
  • Key Takeaways

Section 03 - Kafka Consumer

• Lesson 01 - Kafka Consumer - Overview, Consumer Groups and Partitioners
  • Overview of Kafka Consumers
  • Consumer Groups
  • Partition Rebalance and Creating a Consumer
• Lesson 02 - Poll Loop
  • Poll loop and it's functioning
• Lesson 03 - Configuring Consumer
  • 1.Kafka Consumer Configuration- Part One
  • Kafka Consumer Configuration- Part Two
  • Demo: Create Kafka Consumer
• Lesson 04 - Commit and Offset
  • Commit and Offset
  • Ways of Committing Offset - Automatic Offset
  • Ways of Commiting Offset - Commit Current Offset
  • Ways of Commiting Offset - Asynchronous Commit
  • Ways of Commiting Offset - Combining Synchronous and Asynchronous Commits
  • Ways of Commiting Offset - Commit Specified Offset
• Lesson 05 - Rebalance Listeners
  • Rebalance Listeners
• Lesson 06 - Consuming Records with Specific Offset
  • Consuming Records with Specific Offset
• Lesson 07 - Deserializers
  • Deserializers
  • Demo: Create and Use Custom Deserializer
• Lesson 08 - Key Takeaways
  • Key Takeaways

Section 04 - Kafka Operations and Performance Tuning

• Lesson 01 - Learning Objectives
  • Learning Objectives
• Lesson 02 - Replications
  • Replication and Replica Types
  • Preffered Ladder, Request and Request Processing
  • Types of Requests
• Lesson 03 - Storage
  • Partition Allocation, File Management and Segments
  • File Format, Index and Compaction
• Lesson 04 - Configuration in Reliable System
  • Kafka Reliability and Reliablity Methods
  • Broker Configuration for Replication One
  • Producer in Reliable System
  • Consumer in Reliable System
• Lesson 05 - Key Takeaways
  • Key Takeaways

Section 05 - Kafka Cluster Architecture and Administering Kafka

• Lesson 01 - Learning Objectives
  • Learning Objectives
• Lesson 02 - Multi Cluster Architecture
  • Hub and Spokes Architecture and Active Active Architecture
  • Active-Standby Architecture and Stretch Clusters
• Lesson 03 - MirrorMaker
  • MirrorMaker Configuration
  • MirrorMaker Deployment and Tuning
  • Demo: Setting up MirrorMaker
• Lesson 04 - Administering Kafka
  • Administering Kafka - Topic Operations
  • Administering Kafka - Consumer Group Operations
• Lesson 05 - Dynamic Configuration Changes
  • Dynamic Configuration Changes
  • Partition Management
• Lesson 06 - Console Producer Tool
  • Console Producer Tool
• Lesson 07 - Console Consumer Tool
  • Console Consumer Tool
• Lesson 08 - Key Takeaways
  • Key Takeaways

Section 06 - Kafka Monitoring and Schema Registry

• Lesson 01 - Monitoring
  • Learning Objectives
  • Server or Infrastructure Monitoring and Application Monitoring
  • Kafka Monitoring
  • Kafka Broker Metrics - Under Replicated Partitions
  • Kafka Broker Metrics - Others
  • Topic and Partition Specific Metrics
  • Logging and Client Monitoring
  • Producer and Consumer Metrics
  • Quotas and Lag Monitoring
  • Monitoring Dashboard
  • Demo: Setting up Open Source Health Monitor
• Lesson 02 - Kafka Schema Registry and Avro
  • Kafka Schema Registry
• Lesson 03 - Kafka Schema Registry Components
  • Kafka Component and Architecture
  • Kafka Schema Registry - Internal working and Use-cases
• Lesson 04 - Kafka Schema Registry Working
  • Kafka Schema Registry Working
  • Demo: Using Kafka Schema Registry With Kafka
• Lesson 05 - Key Takeaways
  • Key Takeaways

Section 07 - Kafka Streams and Kafka Connectors

• Lesson 01 - Kafka Stream Overview
  • Learning Objectives
  • Kafka Stream
• Lesson 02 - Kafka Stream Architecture, Working and Components
  • Kafka Stream Architecture and Working
  • Kafka Stream Components
  • Kafka Stream Architecture Tasks, Threading Model and Local State Store
  • Kafka Stream Architecture - Record Buffer
  • Memory Management and Streaming Data Pipeline
  • Kafka Stream DSL
  • KStream Operations
  • KTable
  • KTable Operations
  • Aggregation and Windowing
• Lesson 03 - Stream Concepts and Working
  • Processor Topology and Stream Processor
  • Stream and Processor APIs one
  • Processor APIs - Create Topology
• Lesson 04 - Kafka Connectors
  • Kafka Connectors
• Lesson 05 - Kafka Connector Configuration
  • Standalone and Sink Connector Configuration
  • Running Kafka Connect
  • Kafka Connector Distributed Mode
  • HTTP Rest Interface
  • Demo: Kafka Connector
  • Demo: Create an Application using Kafka Streams
• Lesson 06 - Key Takeaways
  • Key Takeaways

Section 08 - Integration of Kafka with Storm

• Lesson 01 - Apache Storm
  • Learning Objectives
  • Real-time Analytics
• Lesson 02 - Apache Storm Architecture and Components
  • Apache Storm Architecture
  • Apache Storm Components
• Lesson 03 - Apache Storm Topology
  • Apache Storm Topology
  • Apache Storm Topology - Execution Plan
• Lesson 04 - Kafka Spout
  • Kafka Spout
• Lesson 05 - Integration of Apache Storm and Kafka
  • Integration of Apache Storm and Kafka
  • Demo: Simple Standalone Application using Kafka and Storm
• Lesson 06 - Key Takeaways
  • Key Takeaways

Section 09 - Kafka Integration with Spark and Flume

• Lesson 01 - Introduction to Spark and It_s Components
  • Learning Objectives
  • Spark Components
• Lesson 02 - Basics of Spark - RDD, Data Sets, and Transformation and Actions
  • RDD
  • RDD Operations - Transformation - Map, FlatMap and Filter
  • RDD Operations - Transformation - Join, Distinct, First and Take
  • RDD Operations - Actions
  • Data Sets and Spark Session
  • Data Sets and Spark Session Operations
• Lesson 03 - Spark Stream
  • Spark Stream
• Lesson 04 - Spark Integration with Kafka
  • Spark Integration with Kafka
  • Demo: Running Small Standalone Application in Spark with Kafka
• Lesson 05 - Flume
  • Flume
  • Flume Connectors
• Lesson 06 -Flume Kafka to HDFS Configuration
  • Flume Kafka to HDFS Configuration
  • Demo: Creating Flume agent Sending data from Kafka to HDFS
• Lesson 07 - Key Takeaways
  • Key Takeaways

Section 10 - Admin Client and Securing Kafka

• Lesson 01 - Admin Client
  • Learning Objectives
  • Demo: Perform Various Admin Tasks using Admin Client
• Lesson 02 - Kafka Security
  • Kafka Security
• Lesson 03 - Kafka Security Components
  • Kafka Security Components
  • SASL
• Lesson 04 - Configure SSL in Kafka
  • Configure SSL in Kafka
• Lesson 05 - Secure using ACLs
  • Secure using ACLs
• Lesson 06 - Key Takeaways
  • Key Takeaways

What do I need to do to unlock my certificate?

Online Self-Learning:

• Complete 85 percent of the Kafka course
• Complete one simulation test with a minimum score of 60 percent

Who provides the certification and how long it is valid for?

The Kafka certification is provided by Confluent popularly known as Confluent Certified Developer for Apache Kafka (CCDAK) certification. The certificate expires after two years. You will be required to recertify every 2 years.

How to become a Kafka Developer?

You can take up the Simplilearn’s Apache Kafka certification training course which will help you acquire all the necessary skills required for becoming a Kafka Developer.

FAQs

• What is Apache Kafka?

  Apache Kafka is an open-source software platform for distributed stream-processing developed by LinkedIn and donated to the Apache Software Foundation, written in Scala and Java.

• Why you should learn Kafka?

  There are many reasons for learning this Apache Kafka open-source system because it is:

  • High scalability levels
  • Highly durable messaging system
  • Highly reliable messaging system
  • Amazing performance ability
  • Companion to business Hadoop infrastructure
• What do I need to do to unlock my certificate?

  Online Self-Learning:

  • Complete 85 percent of the Kafka course
  • Complete one simulation test with a minimum score of 60 percent
• How do I enroll in Apache Kafka online training?

  You can enroll in this training on our website and make an online payment using any of the following option

  • Visa Credit or Debit Card
  • MasterCard
  • American Express
  • Diner’s Club
  • PayPal

  Once payment is received, you will automatically receive a payment receipt and access information via email.