Duration
Deep Dive into Apache Pulsar: Architecture, APIs and Best Practices
4 days
Overview
This course provides a comprehensive introduction to Apache Pulsar, a distributed pub-sub messaging system designed for high throughput, low latency, and scalability. The course will cover the core concepts of Pulsar, its architecture, key features, and practical use cases. Through a mix of lectures, hands-on labs, and real-world scenarios, you will gain the skills to install, configure, and operate Pulsar in production environments.
Target Audience
- Developers interested in building real-time applications
- Data engineers working with streaming data pipelines
- System administrators responsible for deploying and managing messaging systems
Course Prerequisites
- Basic understanding of distributed systems concepts
- Familiarity with programming languages (e.g., Java, Python)
Module 1: Introduction to Apache Pulsar
- Introduction to Messaging Systems
- What is Apache Pulsar?
- Key Features and Benefits of Pulsar (compared to other messaging systems)
- Use Cases for Apache Pulsar
Module 2: Pulsar Architecture
- Deep Dive into Pulsar Components:
- Brokers
- Bookies (Apache BookKeeper)
- ZooKeeper
- Clients (Producers and Consumers)
- Publish-Subscribe Model with Pulsar Topics and Queues
- Subscription Types (Exclusive, Shared, Failover)
- Message Delivery Semantics (At-most-once, At-least-once)
Module 3: Installation and Configuration
- Setting Up a Development Environment
- Installing Pulsar with Docker
- Standalone vs. Clustered Deployments
- Configuration Management (Broker Configuration, Security Settings)
Module 4: Working with Pulsar
- Creating and Managing Topics and Queues
- Producing and Consuming Messages (Command-line tools, Client Libraries)
- Schema Registry for Data Serialization
- Schema Validation and Evolution
Module 5: Advanced Features
- Pulsar Functions: Stream Processing on the Fly
- SQL Support with Pulsar SQL
- Geo-Replication for Disaster Recovery
- Security in Pulsar: Authentication and Authorization
Module 6: Monitoring and Performance Optimization
- Monitoring Pulsar with Pulsar Metrics
- Performance Optimization Techniques
- Scaling Pulsar for High Throughput
Module 7: Real-World Projects and Use Cases
- Building a Streaming Data Pipeline with Pulsar
- Integrating Pulsar with Apache Kafka (if applicable)
- Troubleshooting Common Pulsar Issues
Module 8: (Optional) Advanced Topics
- Pulsar Interceptors and Plugins
- Pulsar Connectors for Data Integration
- Pulsar in Cloud Environments
Programme scope, delivery arrangements and suitability are confirmed during enquiry.