User Guide

This section provides comprehensive guides for using Conveyor Streaming effectively.

Table of Contents

  • Tasks - Learn about single tasks, batch tasks, and their configuration options

  • Pipelines - Understand pipeline composition, chaining, and advanced patterns

  • Streaming - Master streaming patterns and consumption strategies

  • Error Handling - Implement robust error recovery and retry strategies

  • Side Inputs - Use external data sources in your pipelines

  • Best Practices - Production-ready patterns and recommendations

Overview

The user guide covers all aspects of building production-ready streaming pipelines with Conveyor:

  • Tasks: Learn about single tasks, batch tasks, and their configuration options

  • Pipelines: Understand pipeline composition, chaining, and advanced patterns

  • Streaming: Master streaming patterns and consumption strategies

  • Error Handling: Implement robust error recovery and retry strategies

  • Side Inputs: Use external data sources in your pipelines

  • Performance: Optimize your pipelines for maximum throughput

Each guide includes practical examples and best practices to help you build efficient, maintainable streaming applications.