feat: add an internal `HttpClient` to be used in `send_request` for `PlaywrightCrawler` using `APIRequestContext` bound to the browser context by Mantisus · Pull Request #1134 · apify/crawlee-python

After discussions with @janbuchar in Slack, we came to the decision that this approach is best for PlaywrightCrawler. The requests will be closer to the browser context, and will use the same proxies that were set when the context was opened.

However, there is a problem. Playwright does not propagate the headers set with set_extra_http_headers to the request context. This results in the request context not receiving fingerprint headers.

It relevant #1055

Refactoring would be required to pass the headers set when opening the browser context to the crawling context. Or wait for Playwright to do something about it on their end