Skip to content

ingestors

Usage:

$ ingestors [OPTIONS] COMMAND [ARGS]...

Options:

  • --version / --no-version: Show version [default: no-version]
  • --settings / --no-settings: Show current settings [default: no-settings]
  • --install-completion: Install completion for the current shell.
  • --show-completion: Show completion for the current shell, to copy it or customize the installation.
  • --help: Show this message and exit.

Commands:

  • ingest: Queue a local directory for ingest.
  • ingest-entities: Queue ingest a stream of entities
  • cache-clear: Delete ingest cache entries.

ingestors ingest

Queue a local directory for ingest.

Usage:

$ ingestors ingest [OPTIONS] {path}

Arguments:

  • path: [required]

Options:

  • -d, --dataset <str>: Name of the dataset [required]
  • -f, --foreign-id <str>: Foreign ID of the dataset
  • --languages <str>: 3-letter language code (ISO 639)
  • --resume: Skip the files listed in the lakehouse documents crawl export (requires OPENALEPH_LAKEHOUSE=1)
  • --help: Show this message and exit.

ingestors ingest-entities

Queue ingest a stream of entities

Usage:

$ ingestors ingest-entities [OPTIONS]

Options:

  • -d, --dataset <str>: Name of the dataset [required]
  • -i <str>: Input uri, default stdin [default: -]
  • -f, --foreign-id <str>: Foreign ID of the dataset
  • --languages <str>: 3-letter language code (ISO 639)
  • --help: Show this message and exit.

ingestors cache-clear

Delete ingest cache entries.

Usage:

$ ingestors cache-clear [OPTIONS]

Options:

  • <str>: Only delete entries with the given prefix (e.g: 'ocr:', 'pdf:').
  • --help: Show this message and exit.