Skip to content

Latest commit

 

History

13 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Stock Price Data Warehouse Platform

Overview

This project demonstrates an end-to-end data engineering platform for stock market data using Apache Airflow, CeleryExecutor, PostgreSQL, and Docker.

ETL Pipeline Architecture

architecture

Data Warehouse Design

Data Pipelines

  • Raw ingestion from stock market APIs
  • Transformation into dimensional model
  • Data quality validation
  • Analytics-ready warehouse

Tech Stack

  • Apache Airflow 3.x (CeleryExecutor)
  • PostgreSQL & PgAdmin
  • Docker & Docker Compose
  • GreatExpectation
  • Jupyter Notebook

How to Run

docker-compose up -d
bash

Author

Jumponpatha Chaimongkonrojna Data Engineer | AI Engineer (Data Infrastructure)

About

An ETL pipeline to Data Warehouse (Airflow, PostgreSQL, PowerBI)

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages