Two Critical Issues with Crawlee Project Creation and Deployment

Issue 1: Playwright Template Creation Fails

Description

When attempting to create a new Crawler project with Playwright template using the command:

crawlee create my_crawler

The creation fails with a template not found error for the Playwright configuration.

Error Message

TemplateNotFound: 'routes_playwright.py' not found in search paths: '.', '../templates'

Expected Behavior

The crawlee create command should successfully create a project with the Playwright template, similar to how it works with BeautifulSoup template.

Issue 2: Docker Build Fails for BeautifulSoup Template

Description

When following the standard deployment guide with an unmodified BeautifulSoup template, the Docker build process fails during apify push command.

Steps to Reproduce

  1. Create new project using BeautifulSoup template
  2. Follow standard deploy guide
  3. Run apify init
  4. Run apify push

Error Message

2025-02-10T17:29:47.053Z WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

Reading package lists...
Building dependency tree...
Reading state information...
E: Unable to locate package git

---> Removed intermediate container 0acf324350f8
ACTOR: ERROR: Docker image build failed: The command '/bin/bash -o pipefail -c apt install -yq git && rm -rf /var/lib/apt/lists/*' returned a non-zero code: 100

Environment

  • Command: crawlee create my_crawler
  • Template: BeautifulSoup (default)
  • Date of occurrence: February 10, 2025

Additional Notes

  • The BeautifulSoup template creation works, but fails during deployment
  • The Docker build error suggests an issue with the base image or package repository configuration
  • using crawlee=0.5.4