singer_sdk.batch.JSONLinesBatcher

class singer_sdk.batch.JSONLinesBatcher[source]

JSON Lines Record Batcher.

Writes raw JSON records to JSONL batch files, with one record per line. The batch files contain only the record data, not Singer protocol messages.

get_batches(records)[source]

Yield manifest of batches.

Creates JSONL batch files containing raw JSON records (one per line).

Parameters:

records (Iterator[dict]) – The raw record dictionaries to batch.

Yields:

A list of file paths (called a manifest).

Return type:

Iterator[list[str]]