Live data pipelines — running 24/7
Senior Data Engineer
End-to-end data platform on a homelab — Kafka streams, Airflow DAGs, dbt models, ClickHouse OLAP and live Grafana dashboards. Everything you see is real data.
25M+
Binance trades
6
API sources
99.9%
Uptime
16 GB
RAM homelab
Data Pipeline Architecture
LiveCoinGecko
REST API
NBK Kazakhstan
Forex rates
Tengrinews
Web scraping
LIVE
Binance WS
25M+ trades
Open-Meteo
Weather API
Apache Kafka
Message streaming
Apache Airflow
Orchestration
dbt Core
Transformations
PostgreSQL
Neon cloud
ClickHouse
OLAP / homelab
Grafana
Dashboards
Superset
BI analytics
Portfolio Web
gabyer.dev