Skip to main content

Module ingestion_worker

Module ingestion_worker 

Source
Expand description

Document Ingestion Worker Pool

Uses prometheus_parking_lot WorkerPool for scalable document ingestion. This ensures CPU-bound document processing doesn’t block the async HTTP server.

Structs§

DocumentIngestionExecutor
Executor for document ingestion jobs.
DocumentIngestionJob
A document ingestion job to be processed by the worker pool.
IngestionResult
Result from processing a document.
IngestionWorkerPool
High-level wrapper around the prometheus_parking_lot WorkerPool for document ingestion.