BMSDocs Integration Support Lead Role(Onsite- From Dec 2023)-
- Responsible for monitoring and analysing/resolving any issues with the production jobs running on EDLI(Enterprise Data Lake Integration) framework for different integrations.
- Requirement gathering and clarification/co-ordination with the client, various stakeholders and different teams involved for any production issues or new requirements.
- Responsible for providing estimates for production issue fix and enhancements/new requirements.
Nationwide DHF(Onsite- April 2023 till October 2023)-
- Maintaining and enhancing/adding features to Data Harmonization Framework used for Data Ingestion, Harmonization, Curation and Warehouse Sync Jobs.
- Added features for data quality checks in DHF framework for file-based ingestion through DHF Autoloader.
- Providing support to users for Data Ingestion, Harmonization, Curation process through DHF Framework.
- Making users aware of the new features of the framework by conducting Show and Tell for large users.
Nationwide Hercules(Offshore- August 2021 till March 2023)-
- Responsible and owned Data ingestion for various source systems using Databricks Autoloader from s3 bucket to delta. Ingested data for various file types like .csv, .dat, .xml, .parquet etcand data ingestion to delta for SQL server source system using stream sets tool.
- Developed Databricks Autoloader code for ingesting XML.
- Designing Developed and guiding team in delivering/developing solutions for different use cases as per requirement.
- Leading team of 4-5 resources in solutioning delivery work.
- Code deployment in production, data validation and monitoring of prod jobs.
- Hands on experience on AWS services S3, SQS, SNS services.
SAMS Club GRS to GCP migration(Offshore- March 2021- July 2021)-
- Conversion of Teradata SQL to equivalent Google Big Query SQLs.
- Unit Testing in dev and SIT in higher environments and data validation.
- Conducting code review for team.
- Handling team size of 8 members and responsible for assignment of tasks and status tracking as per project deadlines.