Creativity Surpasses Wisdom 

A Terraform powered AWS setup with two VPCs—Ingestion and Analytics—designed for secure, scalable data engineering. It uses public/private subnets, VPC peering, and avoids NAT Gateways for tighter control and cost-efficiency.

This project involves extracting job listing data from the LinkedIn API, processing and storing it in S3 buckets, and ultimately loading it into a Redshift data warehouse using AWS Lambda and Apache Airflow. Additionally, a copy of the processed data is sent via email.