arookieds - Overview

View arookieds's full-sized avatar

Lior Gefen arookieds

Organizations

@Time-of-Data

Block or report arookieds

Lior Gefen

Data Engineer | Infrastructure Automation | Cloud-Native Data Systems

Building reliable data infrastructure that eliminates manual processes and scales with business needs.

🔧 Technical Focus

Data Orchestration & Pipelines

  • Dagster, Apache Airflow
  • Batch & streaming architectures (Kafka, PySpark, Flink)

Cloud & Infrastructure

  • Kubernetes, Docker
  • AWS, Azure
  • Infrastructure-as-code (Terraform)

Data Engineering Stack

  • Python (Apache Polars, Ibis, Pandas)
  • PostgreSQL, QuestDB, time-series databases
  • Data modeling & transformation

💼 Experience Highlights

  • 7+ years data engineering across healthcare, fintech, legal tech, crypto
  • PhD Aeroacoustics - Research background in computational analysis
  • Specialized in eliminating FTE-equivalent manual work through intelligent automation

🚀 Current Projects

Building financial data infrastructure on Kubernetes (homelab):

  • Dagster orchestration platform deployment
  • Real-time crypto market data pipelines
  • Self-service analytics architecture

📫 Connect

Pinned Loading

  1. Extraction and transformation of crypto data, orchestrating jobs using Dagster

    Python

  2. Dagster instance deployment to kubernetes

    Nushell