Skip to main content

Building Workflows

Documentation In Progress

This page is a stub. Full documentation for building workflows inside the Project editor is tracked in LAY-89.

For a hands-on tutorial, see Your First Workflow in the Quickstart.

What is a Workflow?

A Workflow is the core unit of a data pipeline in layline.io. It defines how data flows from an input source, through one or more processing steps, to an output destination.

Workflows live inside a Project and are assembled from three types of Assets:

Asset TypeRole
Input ProcessorsReceive data from a Source (file, queue, stream, etc.)
Flow ProcessorsTransform, route, enrich, or filter data in transit
Output ProcessorsSend processed data to a Sink

How Workflows Are Built

Inside a Project, you use the visual editor to:

  1. Add Processors — drag Input, Flow, and Output Processors onto the canvas
  2. Connect them — define the data flow between processors
  3. Configure each processor — set Source/Sink connections, Formats, Services, and processing logic
  4. Assign a Workflow Asset — wrap the pipeline in a Workflow Asset for deployment

Relationship to Other Concepts

  • Assets — the individual components (processors, services, formats) that make up a workflow
  • Deployment — once a Workflow is defined, you deploy it to a Reactive Cluster via a Deployment Asset
  • Project — the container that holds all your Workflows and their supporting Assets

See Also