Simplan - Documentation

Custom Processor

GitHub

Simplan - Documentation

GitHub

Home
Home
- Overview
- Implementations
  Implementations
  - Data Processing
    Data Processing
    
    Overview
    
    Spark
    
    Flink
    
    Presto
  - Orchestration
    Orchestration
    
    Overview
  - Console
Getting Started
Framework
Framework
- Overview
- Tasks
- Operators
- Task Ordering
- Logging and Monitoring
  Logging and Monitoring
Spark
Spark
- Simplan For Spark
- Getting Started
  Getting Started
  - Local Setup
  - Batch Processing Platform
    Batch Processing Platform
    
    Getting Started
    
    Custom Processor
    
    Shared Processor
    
    Sql Script
  - Superglue
    Superglue
    
    Superglue Launcher
- Contribution Guide
- System Configurations
  System Configurations
  - Spark Properties
- Operators
  Operators
  - Build Your Own
  - Sources/Sinks
    Sources/Sinks
    
    Batch Sources
    
    Batch Sinks
    
    Stream Sources
    Stream Sources
    
    Socket Streaming Source
    
    Kafka Streaming Source
    
    File Streaming Source
    
    Delta Table
  - Sinks
    Sinks
    
    Batch Sinks
    Batch Sinks
    
    CSV Sink
    
    JSON Sink
    
    AVRO Sink
    
    Parquet Sink
    
    Kafka Sink
    
    Stream Sinks
    Stream Sinks
    
    Socket Sink
    
    Kafka Sink
  - Transformations
    Transformations
    
    Spark SQL
    
    Filtering
    
    Projection
    
    Delta Merge Operator
- Qualified Params
  Qualified Params
  - Schema Param
Flink
Flink
- Overview
- Operators
  Operators
  - Build Your Own
  - Sources
    Sources
    
    Stream Sources
    Stream Sources
    
    Kafka
  - Sinks
    Sinks
    
    Stream Sinks
    Stream Sinks
    
    Kafka
  - Transformations
    Transformations
    
    Flink SQL
    
    Filtering
    
    Projection
    
    Hybrid Source
Release Notes

Simplan Spark on BPP

Create a custom BPP Processor