PULAK SRIVASTAVA

• Bulk loading from external stage (AWS S3), internal stage to snowflake cloud using COPY command.
• Developed complex SQL queries and stored procedures in Snowflake to extract, transform, and load data from various sources.
• Used FLATTEN table function to produce lateral view of VARIANT column for JASON files.
• Used SNOW PIPE for continuous data ingestion from S3 bucket.
• Created clone objects to maintain zero-copy cloning.
• Performed data quality/Sanity checks which ensure credibility of data.
• Used COPY, LIST, PUT and GET commands for validating internal stage files.
• Experience with AWS cloud services: EC2, S3, EMR, Lambda and Athena.
• Perform troubleshooting analysis and resolution of critical issues

Client

MEDICAL AESTHETIC DATA INTEGRATION - ABBVIE (LIFE SCIENCE)

• Designed and developed Informatics Mappings and Sessions based on business user requirements and business rules to load data from diverse sources such as source flat files and oracle tables to target tables.
• Realtime experience of using snowflake features like Zero Copy Clone ,Time-Travel and Copy Command.
• Using Synchronization and Replication Task in CDI in IICS .
• Building CDC logic /incremental loading using MAD5 and Current Flag logic .
• Loading semi structured data into Snowflake STAGE from S3 using Snow Pipe.
• Implementing SCD Type 1 ,Type 2 and Type 3 in ETL mappings.
• Worked on various kinds of transformations like Expression, Aggregator, Lookup, Filter, Joiner, Rank, Router.
• Involved in monitoring workflows and in optimizing load times. Used Change Data Capture (CDC) to simplify ETL in data warehouse applications.

• Supporting production jobs , taking care of failures and resolving it
• Good expertise in impact analysis/Data analysis due to new deployment or source issue.
• Creating Production documents like Mapping Sheet, Run Book etc.
• Performing data quality check and ensuring data credibility.
• Creating P1/P2 Incidents and escalating issues with cross teams so that SLA's are not breached.