Convert

Converts event data between formats.

Configuration

- convert:
    name: to_arrow
    target_format: arrow

Fields

FieldTypeDefaultDescription
namestringrequiredTask name.
target_formatstringavroTarget format: avro, json, arrow.
schemastring/resourceOptional schema for the conversion.
depends_onlistUpstream task names.
retryobjectRetry configuration.

Output

FormatCrateDescription
JSON / Arrow RecordBatch / Avrotarget formatConverted payload. Field values are preserved; only the serialisation format changes. Hyphens in JSON keys are replaced with underscores for Avro compatibility.

Example

- convert:
    name: json_to_arrow
    target_format: arrow
    schema:
      resource: schemas/orders.json