Architecture Overview

The technical foundation of the dataflows engine.
EVENT SOURCES
Webhook
Cron
API
dataflows-engine
Durable Execution
Active
fetch_user_data
Completed (Cached)
generate_report
Executing...
3
send_email
Pending
PERSISTENCE
WarehouseBusiness Data
JournalExecution Logs

Built on Open Source Giants

We don't reinvent the wheel. We orchestrate the best.

Design Philosophy

Reliability over Simplicity

We chose a strictly typed, code-first approach because drag-and-drop editors become unmaintainable at scale. By using TypeScript, we leverage existing CI/CD pipelines, code reviews, and testing frameworks.

The 'Durable' Promise

The core engine guarantees that once a workflow starts, it will complete, even if the server crashes or the API rate limits are hit. This is achieved through our event sourcing architecture and the 'Replay' mechanism.

Core Concepts

Core Engine Architecture
How dataflows executes workflows reliably at scale.
Data Layer & Warehouse
The schema that powers the dataflows context.
Security & Auth
How dataflows handles secrets, tokens, and permissions.