ContextPipeline | API | Crawlee for Python · Fast, reliable Python web crawlers.
Index
Methods
- async __call__(crawling_context, final_context_consumer): None
Parameters
crawling_context: BasicCrawlingContext
final_context_consumer: Callable[[TCrawlingContext], Awaitable[None]]
Returns None
- __init__(*, _middleware, _parent): None
Parameters
optionalkeyword-only_middleware: Callable[[TCrawlingContext], AsyncGenerator[TMiddlewareCrawlingContext, Exception | None]] | None = None
optionalkeyword-only_parent: ContextPipeline[BasicCrawlingContext] | None = None
Returns None
Parameters
middleware: Callable[[TCrawlingContext], AsyncGenerator[TMiddlewareCrawlingContext, None]]
Returns ContextPipeline[TMiddlewareCrawlingContext]