Working with Apache Kafka (for Developers)

Course Code: 1265

$1795

Overview
Schedule classes
What you'll learn
Outline
Prerequisites
Who should attend

Overview

This skill-centric two-day course comprises of 50% hands-on lab exercises and 50% lectures, and leads participants through a series of progressively advanced topics relating to working with Apache Kafka. Apache Kafka offers many significant benefits like high-scalability, fault tolerance, execution speed and fluid integration, making it an integral part of many enterprise data architectures. The course covers how to build effective streaming solutions using Kafka.

Schedule Classes

Looking for more sessions of this class?

Course Delivery

This course is available in the following formats:

Live Classroom
Duration: 5 days

Live Virtual Classroom
Duration: 5 days

What You'll learn

Overview of streaming technologies
Kafka concepts and architecture
Programming using Kafka API
Kafka streams
Monitoring Kafka
Tuning/troubleshooting Kafka

Outline

Module 1: Introduction to streaming systems

Fast data
Streaming architecture
Lambda architecture
Message queues
Streaming processors

Module 2: Introduction to Kafka

Architecture
Comparing Kafka with other queue systems (JMS/MQ)
Kafka concepts: Message topics, partitions, brokers, producers, commit logs
Kafka and Zookeeper
Producing messages
Consuming messages (Consumers and consumer groups)
Message retention
Scaling Kafka
Lab: Getting Kafka up and running; Using Kafka utilities

Module 3: Programming with Kafka

Configuring paramters
Producer API (Sending messages to Kafka)
Consumer API (Consuming messages from Kafka)
Commits, Offsets, Seeking
Schema with Avro
Lab: Writing Kafka clients in Java; Benchmarking producer APIs

Module 4: Kafka Streams

Streams overview and architecture
Streams use cases and comparison with other platforms
Learning Kafka streaming concepts (KStream, KTable, KStore)
KStreaming operations (transformations, filters, joins, aggregations)
Lab: Kafka streaming labs

Module 5: Administering Kafka

Hardware/software requirements
Deploying Kafka
Configuration of brokers/topics/partitions/producers/consumers
Security – How secure is the Kafka cluster
Secure client communications (SASL, Kerberos)
Monitoring tools
Capacity planning – estimating usage and demand
Troubleshooting – failure scenarios and recovery

Module 6: Monitoring and instrumenting Kafka

Monitoring Kafka
Instrumenting with Metrics library
Lab: Monitor Kafka cluster
Instrument Kafka applications and monitor their performance

Module 7: Case study

Build end-to-end application simulating web traffic and send metrics to Grafana

Prerequisites

Participants need to be experienced developers familiar with Java. They need to have experience working with databases. Participants must be able to navigate the Linux command line and have basic knowledge of Linux editors such as VI/nano for editing code.