Project information
- Category: Data Engineering
- Client: Research
- Project date: 13 Nov, 2023
- Project URL: Project Link
Project Description
- Main aim of the project develope an end-to-end data Engineering pipeleine using AWS and OpenWeather API.
- The objective of this project is to extract transform and load the data , store it in AWS RDS and Visualize the analysis.
- The data is ingested from open weather api to AWS S3 bucket, ETL and data modelling is done using python
- The Loaded data is moved to AWS RDS and later used Power BI to visualize the data, the whole pipeleine is orchestrated using Airflow