Project information

  • Category: Data Engineering
  • Client: Research
  • Project date: 13 Nov, 2023
  • Project URL: Project Link

Project Description

  • Main aim of the project develope an end-to-end data Engineering pipeleine using AWS and OpenWeather API.
  • The objective of this project is to extract transform and load the data , store it in AWS RDS and Visualize the analysis.
  • The data is ingested from open weather api to AWS S3 bucket, ETL and data modelling is done using python
  • The Loaded data is moved to AWS RDS and later used Power BI to visualize the data, the whole pipeleine is orchestrated using Airflow