Professional Data Engineer with 9 years of industry experience including around 2.5 years of experience in Big Data technologies. Expertise in SQL, SSIS, SSRS, ETL, Snowflake , Snow Park, Py Spark, Python development experience, Health Care life cycle of software design process. Outstanding communication skills, dedicated to maintain up-to-date IT skills and industry knowledge.
Overview
8
8
years of professional experience
1
1
Certification
Work History
Data Engineer
CitiusTech Healthcare Technology Private
12.2019 - Current
Migrated the existing data from Green Plum/SQL Server to Snowflake Data base and perform ETL operations on it.
Designed and Implemented incremental imports, delta imports on tables without primary keys and dates by using Stream and appends directly into Snowflake Warehouse.
Converted SQL scripts/components of the ETL process (transformations) to Snow Spark API.
Worked with Avro and Parquet file formats and used various compression techniques to leverage the storage in HDFS.
Preparation and participation in POCs and demos.
Technical documentation preparation: detailed data workflow description, solution design and architecture, technical requirements specification.
Designed and developed ETL workflow using Snowflake SQL and automated them using Snowflake Task.
Technical documentation preparation: detailed data workflow description, solution design and architecture, technical requirements specification
Worked on on-call production issues - scrubbing, resolve complex query issues, workaround for defects within SLA duration.
Ability to prioritize and make effective estimations.
Data Engineer
Hexaware Technologies
04.2018 - 12.2019
Developed SSIS ETL packages for extracting the data from source systems.
Extracted data from various sources like Oracle, Excel and Text file from client servers.
Participated in performance optimization of SQL queries and stored procedures.
Designed SSRS reports.
Involved in writing stored procedures and functions and also views to handle database automation tasks.
Involved in creation/review of functional requirement specifications and supporting documents for business systems, experienced in database design process and data modeling process.
Software Developer
LTI
12.2015 - 03.2018
Created packages which includes a variety of transformations, for example slowly changing dimensions, look up, derived column, conditional split, multicast and data conversion.
Involved in creation/review of functional requirement specifications and supporting documents for business systems, experienced in database design process and data modeling process.
Monitored full/incremental/daily loads and supported all scheduled ETL jobs for batch processing.
Implemented and delivered MSBI platform solutions to develop and deploy ETL, analytical, reporting and scorecard dashboards.
Education
Bachelor of Engineering - Computer Science Engineering
University of Mumbai
Mumbai
05.2012
Skills
Snow Pipe, Snow SQL, Python, Avro, Parquet, Kafka
Apache Spark : Data frames, Spark SQL, Snow Spark Streaming
Programming Languages : SQL, PL/SQL, Snowflake
Automation Tools : Python, Autosys
ETL and Reporting tools : SSIS, SSRS Reports
Certification
SnowPro Core Certified Developer for Snowflake
Timeline
Data Engineer
CitiusTech Healthcare Technology Private
12.2019 - Current
Data Engineer
Hexaware Technologies
04.2018 - 12.2019
Software Developer
LTI
12.2015 - 03.2018
Bachelor of Engineering - Computer Science Engineering