I build production-oriented data pipelines that don't break silently. My focus is on quality, observability, and deterministic execution.
Validate early β Fail loudly β Monitor continuously
- π§ Data quality enforcement using robust schema validation rules
- π Deterministic and reproducible execution across all environments
- π§ͺ Clear observability and failure signals to eliminate silent pipeline drops
- π Testable and maintainable data workflows built for long-term scalability
A production-style DataOps pipeline designed to prevent silent data corruption and stale data issues.
What it demonstrates:
- ποΈ Medallion Architecture (Bronze β Silver β Gold)
- π Schema validation using Pydantic
- π Idempotent pipeline execution
- π§Ή Data cleaning & transformation with Pandas
- ποΈ SQL-based storage & querying
- π§ͺ Automated testing with Pytest
- π³ Containerized execution with Docker
- π· CI pipeline via GitHub Actions
- π§± Orchestration with apache-Airflow
I focus on building systems that are predictable, debuggable, and production-ready.
- β Validate data before processing
β οΈ Handle edge cases and invalid inputs- βοΈ Write tests for transformations
- π Keep pipelines deterministic
- π’ Surface failures clearly
Actively seeking a remote EU/UK DataOps or Data Engineering role β contract or full-time.
I build reliability into pipelines from the ground up: schema validation, idempotency, and observability baked in rather than bolted on afterward.
- π― Role Focus: Data Engineer / DataOps Engineer β Open to remote & on-site (relocation with sponsorship), full-time or contract
- π Availability: Full-time, overlapping with CET/CEST business hours
- π§© What I bring: Production-minded pipeline design, strong test coverage, fast onboarding
- π‘οΈ Approach: Fail loudly, validate early, keep systems debuggable under pressure