Dileep Vangapandu
Albany,NY
Summary
Pursued a master’s in applied mathematics (Data Science) at State University of New York at Albany. Certified AWS Data Engineer with around 4 years of extensive IT experience, Expertise in DevOps and Cloud Engineering & Linux Administration. Exposed to all aspects of Software Development Life Cycle (SDLC) such as Analysis, Planning, Developing, Testing, and implementing and post-production analysis of the projects and methodologies such as Agile, SCRUM.
Overview
4
4
years of professional experience
1
1
Certification
Work History
AWS Data Engineer
Mayo Clinic
05.2023 - Current
- Built and deployed secure serverless architectures on AWS using Lambda, API Gateway, and DynamoDB
- Developed robust ETL pipelines bringing down 60% of the run time
- Migrated old SQLite data pipeline to a new solution using S3 data Lake and utilized Glue Crawler and Athena for processing
- Collaborated with cross-functional teams translating data-driven insights into actionable strategies
- Optimized code performance and managed deployments
- Designed data models for complex analysis, extracted and transformed data with ETL pipelines, and aggregated Adobe data using PySpark on AWS Glue
- Automated cloud infrastructure with CloudFormation and Terraform, managing services like SNS, SQS, EC2, and VPC for high availability and performance
- Involved in CI/CD with Jenkins, SonarQube, and automated tasks with Python and Terraform, and tackled complex build/deployment issues
- Provided code-level application security on AWS with IAM and encryption, ensuring compliance in regulated environments
- Skilled in various AWS services like S3, Redshift, EC2, RDS, and Athena, along with Splunk.
AWS Data Engineer
Capgemini Technology Services
01.2022 - 08.2022
- Created air flow dags for automatic data flow from different data sources to snowflake data warehouse
- Automate the process of sending emails to source owners regarding the data availability SLA
- Continuous data loading, bulk loading, data management and transformations
- Cloud warehouse management using snowflake
- Created stage, raw and inspection models in DBT which helps business users to analyze
- Created flow from sftp to s3 using AWS file transfer family
- Created interactive and highly informative Power BI reports using advanced DAX queries
- Experience working with SQL servers and databases
- Ensure accuracy and timelines of assigned deliverables
- Maintaining and adhering to quality management system Working with cross-functional teams, bringing best practices and helping each other to meet deadlines to meet deliverables.
Data Engineer
Intellisoft Private Limited
03.2021 - 01.2022
- Turning business requirements into SQL queries to fetch the records to be migrated to newer instances of Salesforce
- Implementing transformation logic and data mapping through optimized stored procedures for moving migration records from FOX to sales cloud stage database in SQL server Continuous data loading, bulk loading, data management Developed and updated data model as per the requirement and generated DDL and deployed it using SQL server
- Worked on DBT for transformations.
Associate Software Engineer
Cognizant Technology Solutions
10.2019 - 03.2021
- Worked on DBT in transforming the tables into business requirements
- Writing python scripts to automate the export and import the scripts
- Experienced in building pipelines using ETL tools
- Written Manual and Automation Scripts
- Setup Linux Servers on Amazon (EC2, EBS, ELB, SSL, Security Groups, RDS, and IAM)
- Setup VPC, Subnets; make the connection between different zones; blocking suspicious
- IP/subnet via ACL
- Create buckets on S3 and store DB and logs backup, upload images for CDN server
- Worked on snowflake to get data into Warehouse using snowpipe from AWS s3 bucket
- Experienced in writing lambda script to automatically update the s3 bucket for certain
- Intervals.
Education
Master of Science - Data Science
State University of New York At Albany
Albany, NY12.2023
Bachelors -
RVR&JC College of Engineering
India04.2019
Skills
- Business Analytics
- Data Analytics
- Data Engineering
- AWS
- Devops
- Microsoft PowerBI/Tableau
- MS Excel
- SQL / Snowflake
- Python
- OracleBI
- ETL
- Data Modeling Techniques
- Data Curating
- Data Migration Strategies
- Agile Methodologies
- Data Lake Management
- Data Pipeline Development
- SQL Querying
Certification
- AWS Certified Cloud Practitioner
- AWS Certified Solutions Architect - Associate
Timeline
AWS Data Engineer
Mayo Clinic
05.2023 - Current
AWS Data Engineer
Capgemini Technology Services
01.2022 - 08.2022
Data Engineer
Intellisoft Private Limited
03.2021 - 01.2022
Associate Software Engineer
Cognizant Technology Solutions
10.2019 - 03.2021
Master of Science - Data Science
State University of New York At Albany
Bachelors -
RVR&JC College of Engineering