Advanced Data Analysis of Air Pollution data

Requirement

The European-based IoT device company seeks to enhance air pollution monitoring by collecting data from vehicles through their devices. Their primary objective is to effectively structure this data to make it meaningful and actionable. This involves categorizing the data based on various parameters such as location, time, and types of pollutants measured. Additionally, they aim to provide insightful visualizations derived from the structured data, which will enable Government Organizations and NGOs to gain valuable insights into air quality trends and patterns. To achieve this, the company plans to deploy an API that will allow seamless access to the structured data and visualizations, empowering stakeholders to make informed decisions and take necessary actions to address air pollution concerns effectively.

Our approach

We Collected data from different sources is stored in S3 bucket for Data cleaning. We extracted s3 bucket data using python and boto3.Extracted data from s3 bucket was cleaned and stored as data frame and pushed to amazon redshift for Advanced Data Analysis.

The entire process was done with the help of lambda function and cloud 9. We collected third party data using postman.