Two Critical Issues with Crawlee Project Creation and Deployment
Issue 1: Playwright Template Creation Fails
Description
When attempting to create a new Crawler project with Playwright template using the command:
crawlee create my_crawler
The creation fails with a template not found error for the Playwright configuration.
Error Message
TemplateNotFound: 'routes_playwright.py' not found in search paths: '.', '../templates'
Expected Behavior
The crawlee create command should successfully create a project with the Playwright template, similar to how it works with BeautifulSoup template.
Issue 2: Docker Build Fails for BeautifulSoup Template
Description
When following the standard deployment guide with an unmodified BeautifulSoup template, the Docker build process fails during apify push command.
Steps to Reproduce
- Create new project using BeautifulSoup template
- Follow standard deploy guide
- Run
apify init - Run
apify push
Error Message
2025-02-10T17:29:47.053Z WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
Reading package lists...
Building dependency tree...
Reading state information...
E: Unable to locate package git
---> Removed intermediate container 0acf324350f8
ACTOR: ERROR: Docker image build failed: The command '/bin/bash -o pipefail -c apt install -yq git && rm -rf /var/lib/apt/lists/*' returned a non-zero code: 100
Environment
- Command:
crawlee create my_crawler - Template: BeautifulSoup (default)
- Date of occurrence: February 10, 2025
Additional Notes
- The BeautifulSoup template creation works, but fails during deployment
- The Docker build error suggests an issue with the base image or package repository configuration
- using crawlee=0.5.4