StorageClient | API | Crawlee for Python · Fast, reliable Python web crawlers.
Index
Methods
- async create_dataset_client(*, id, name, alias, configuration): DatasetClient
Parameters
optionalkeyword-onlyid: str | None = None
optionalkeyword-onlyname: str | None = None
optionalkeyword-onlyalias: str | None = None
optionalkeyword-onlyconfiguration: Configuration | None = None
Returns DatasetClient
- async create_kvs_client(*, id, name, alias, configuration): KeyValueStoreClient
Parameters
optionalkeyword-onlyid: str | None = None
optionalkeyword-onlyname: str | None = None
optionalkeyword-onlyalias: str | None = None
optionalkeyword-onlyconfiguration: Configuration | None = None
Returns KeyValueStoreClient
- async create_rq_client(*, id, name, alias, configuration): RequestQueueClient
Parameters
optionalkeyword-onlyid: str | None = None
optionalkeyword-onlyname: str | None = None
optionalkeyword-onlyalias: str | None = None
optionalkeyword-onlyconfiguration: Configuration | None = None
Returns RequestQueueClient
- get_rate_limit_errors(): dict[int, int]
Returns dict[int, int]
- get_storage_client_cache_key(configuration): Hashable
Parameters
configuration: Configuration
Returns Hashable