Sonia Pandita
Summary
With 5 years of hands-on experience, I specialize in using Python to build and manage data pipelines, automate processes, and perform complex data transformations. I also have strong expertise in Snowflake, where I handle data warehousing, integration, and analytics. My goal is to create efficient, scalable data solutions that drive insights and support business decisions.
Overview
5
5
years of professional experience
1
1
Certification
Work History
Data Engineer
Factset Research Systems
06.2022 - Current
- Worked on migrating the data from MSSQL to Snowflake
- Developed a scalable and efficient data migration tool that ultimately copied 8 TB of data from MSSQL to Snowflake utilizing Python, AWS S3, Snowflake External Staging and warehousing, MSSQL BCP
- Split the input files into smaller chunks to make the COPY INTO Snowflake faster
- Developed and maintained data warehouse solutions on Snowflake, ensuring efficient data storage
- Saved the team thousands of dollars by creating the migration tool in-house for no additional cost, as opposed to using a paid third-party solution (i.e AWS Database Migration Service).
Data Engineer
SpringML
06.2019 - 06.2022
- Developed a web application using Angular for front-end and Python for backend
- Responsible for writing APIs in python using Flask Framework
- The front-end application uses these APIs to communicate with GCP Services like BigQuery and Firestore
- Responsible for deploying the application in Google App Engine
- Also automated the deployment process using Cloud Build.
- Worked on Migrating around 1TB of data from PostgresDB to Snowflake.
Education
BTech - Computer Science
Indian Institute of Information Technology, Sricity (IIITS)
05-2019
Skills
- Python
- Flask Framework
- Snowflake (Warehouse, SQL)
- ETL Processes (External Stages)
- Data Warehousing and Modeling
- SQL
- Web technologies: Frontend - Angular JS, Backend - Python
- Google Cloud Services such as Big Query, Cloud Functions, Firestore, App Engine, Cloud SQL
- AWS S3, Lambda
- Good programming skills
Certification
- Snowflake SnowPro Certification, Snowflake, 2023
- Professional Data Engineer, Google Cloud, 2021
- Associate Cloud Engineer, Google Cloud, 2019
Timeline
Data Engineer
Factset Research Systems
06.2022 - Current
Data Engineer
SpringML
06.2019 - 06.2022
BTech - Computer Science
Indian Institute of Information Technology, Sricity (IIITS)