semyont - Overview

View semyont's full-sized avatar

Semyon semyont

Block or report semyont

Pinned Loading

  1. Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

    Python 18.7k 2.5k

  2. A full modbus protocol written in python

    Python 2.7k 1k

  3. ⚠️(OBSOLETE) Curated applications for Kubernetes

    Go 15.4k 16.4k

  4. large timeseries csv streaming upser... large timeseries csv streaming upsert bulk elasticseach #index #pandas #bigdata #csv #upsert #elasticsearch #progressbar #example #bulk #stream #dataops #dataengineer #timeseries

    4

    from elasticsearch import Elasticsearch

    5

    from elasticsearch import helpers
  5. 5

    from prometheus_client import start_http_server, Counter, Histogram
  6. 2

    # These parameters control core luigi behavior, such as error e-mails and

    3

    # interactions between the worker and scheduler.

    5

    default-scheduler-host: localhost