GitHub - palewire/git-scraper-example: A example of a git scraper that download, lints, commits and archives a data set

This repository was archived by the owner on Jul 31, 2024. It is now read-only.

git-scraper-example

A example of a git scraper that downloads, commits and archives a data set.

The source for this demonstration is the list of liquor stores in the state of Iowa. The scraping routine is automated by the scrape.yaml workflow.

Clone the repository

git clone git@github.com:palewire/git-scraper-example.git

Move into the directory

Install the Python tools

Run the downloader

pipenv run python src/download.py

A example of a git scraper that download, lints, commits and archives a data set