Cloud Architect | Lead Data Engineer with 16 plus years of experience in the Information Technology Industry with specialization in leading projects related to Artificial Intelligence, Data Warehouse, Snowflake, Business Intelligence, Data Lake, Data Migration, AWS Cloud and Big Data Space
Design and Built Modernization of legacy tech applications which are on-prem and plan ETL development activities using open source technology like Apache Spark to deploy to AWS cloud using AWS EMR, EC2, Lambda, Glue, CloudWatch, Secrets Manager, CloudFormation/Terraform, SNS and S3 and load data to Snowflake.
Well Versed in writing Complex SQL queries and query optimization
Designed and implemented the migration of the historical data from On-Premise Teradata to Snowflake and performed row level and record level validation across environment using framework created in Python
Experience in designing and developing cloud based ETL applications using Spark, Python and Scala leveraging AWS Cloud services like EC2's, EMR's, ECS, RDS, Load Balancer, S3, IAM, KMS, AWS Config, CloudWatch, Lambda, Step Function, Athena, Glue and Databases like Snowflake, Teradata and Postgres
Strong knowledge in Snowflake architecture and concepts.
Strong working experience in Snowflake using warehouses, stored procedures, streams, snow pipes, tasks, stages, storage integration, ingestion frameworks and tools etc.
Sound Knowledge around data recovery by using time travel feature within Snowflake
Experience in data governance to segregate GDPR and CCPA data by creating roles and views within Snowflake
Ability to develop ELT/ETL pipelines to move data to and from Snowflake data store using combination of Python and Snowflake SnowSQL.
Experience in setting up and deploying end to end cloud based infrastructure solution on AWS
Well versed in deploying process on Cloud using CI/CD pipeline leveraging Code Build, Code Commit, GitHub and Gitlab
Experience working in Cloud Migration, Legacy Modernization on Cloud, Data Lake, Big Data on Cloud using AWS services and open source tools.
Good experience and understanding in Data Warehousing concepts, Dimensional Modeling, Data Modeling, Data Integration, ETL Process, Business Intelligence, Data Mart, OLAP and OLTP systems
Sound knowledge of all stages of SDLC including requirements gathering, High Level Design, Low Level Design, application development, testing ,knowledge transition, implementation and post-implementation support
Personal strengths include excellent communication skills, commitment to quality, value added solutions and enthusiasm to achieve results
Overview
18
18
years of professional experience
Work History
Engineer Sr
Elevance Health
Richmond, VA
06.2023 - Current
Roles and Responsibility
Leading the support team to migrate the on-prem ETL process to AWS Cloud, leveraging EMR, Glue, Snowflake, Airflow, and other AWS services.
Designed and implemented the data validation process in the cloud and on-premises as part of the migration for different applications' ETL processes from a support perspective.
Performed internal workshops for different teams to help bring them up to speed on the AWS services as part of the cloud migration effort within the organization.
Working on onboarding, deployment, and support of an internally hosted AI platform to help the enterprise team speed up their AI journey by creating infrastructure on AWS Kubernetes.
Working with the Cloud Platform team to create infrastructure across AWS services for Multiple applications leveraging Terraform.
Providing application-level production support for ETL and API-related processes for multiple applications within the Digital org.
Documented all engineering activities according to established procedures.
Cloud Architect
Amazon
Richmond, VA
01.2022 - 06.2023
Roles and Responsibility
Worked on delivering modern technology stacks using AWS cloud and Infrastructure-as-Code for the customers
Work hand in hand with our customers to understand their requirements
Responsible for Prototype new projects and then mature them into long term solutions
Implemented CI/CD pipeline for multiple AWS customers using Code Build, Code Commit, Code Deploy and Code Pipeline
As security bar raiser performed deliverable security review for the infrastructure code and guided team to help achieve the security best practices
Graduated as CIA Security Subject Matter Expert which is an internal Security Program
Graduated as Security Area of Depth which is an internal Security Program
Completed Security Bar Raiser program and performed Quality Deliverable Security for the customer
Worked with different customers to represent AWS and drive discussions around infrastructure and security topics with senior stakeholders
Performed various workshops with different customer to help understand the new AWS services and how it can be leveraged within customer environment
Worked on creating Narrative for 2023 AWS Prescriptive Guidance
Wrote multiple AWS blogs related to experience working on new solutions across customers
Helped mentoring new AWS resource as part of AWS Awesome Builder Program
Conducted multiple technical and leadership principle interviews for new AWS hires
Participated as Panelist for multiple Awesome Builder programs
Lead Data Architect
Envestnet
Richmond, VA
10.2021 - 01.2022
Roles And Responsibility
Analyze,Design, Develop, Test and Implement ETL based applications, modules and systems to specific business requirements on AWS cloud
Work closely with business customers to understand the Business/Functional Requirements and convert it to a detailed technical design for development
Developed CI/CD pipeline using Gitlab to deploy process on AWS Cloud
Worked with engineers and developers to coordinate effective design solutions for current system components
Sr. Data Engineer | CLOUD ARCHITECT
Capital One
Richmond, VA
06.2012 - 10.2021
Roles And Responsibility
Analyze,Design, Develop, Test and Implement ETL based applications, modules and systems to specific client requirements on AWS cloud
Design and Built Modernization of legacy tech applications which are on-prem and plan ETL development activities using open source technology like Apache Spark to deploy to AWS cloud using AWS EMR, EC2, Lambda, CloudWatch, CloudFormation, SNS and S3 and load data to Snowflake which is than consumed by our DA's and Business partners to do further analysis
Work closely with business customers to understand the Business/Functional Requirements and convert it to a detailed technical design for development
Worked with engineers and developers to coordinate effective design solutions for current system components
Coding and Unit Testing using languages like Python, UNIX Shellscript and Scala for developing ETL applications to Extract and Reformat data from heterogeneous source and load it into target databases like Snowflake and publishing the data to DataLake
Worked on implementing DevOps on cloud to enable CI/CD,Automated Infrastructure Provisioning and Configuration Management
Responsible for creating CI/CD process to move all CEMP applications to One-Pipeline as part of enterprise initiative
Worked closely with One-Pipeline Dev-Ops team to fix issues as we were first application within the org to migrate the same
Design and built event based ServerLess scheduler on cloud to automate execution of batch jobs on AWS EMR's and EC2's using AWS services Lambda, S3 and CloudWatch thus reducing the need of infrastructure to be up and running all time, this helped in reducing the overall maintenance and cost of project
Performed rehydration and admin activities on AWS EC2instances hosting internal web applications on a monthly basis in order to be in compliance with Capital One standards
Leveraged Docker container to deploy Node Js application on ECS leveraged by business to push file to S3
Performed upgrades and patching for Microsoft SQL server 2012 and Microsoft SQL server 2016
Performed data back and restore of Microsoft SQL Server and Postgres database as part of a disaster recovery activity
Migrated Tables and data for CEMP application from Teradata to Snowflake Ware house as part of Cloud Migration
Created a python framework to perform row level and column level validation to make sure data format between Teradata and Snowflake is consistent for all migrated data
Worked on writing SQL queries to extract data from Snowflake leveraging PySpark as part of ETL process
Build and Executed multiple queries on snowflake for business team as part of data analytics
Created Tables and Warehouse for CEMP applications within snowflake by working along with DBA team
Worked on designing highly available, cost effective, and fault tolerant system for internally hosted static web applications using S3, Elastic Load Balancer and Route 53
Perform periodic code review with the team for new enhancement or features and followed the best practices and standards as part of ETL process development
Designed and implemented the migration of the historical data from On-Premise Teradata to Snowflake and performed row level and record level validation across environment using framework created in Python
Implemented Business Intelligence solutions using COTS based BI tools like Metric Insights to create internal Metric Reports and Dashboards which are leveraged by Business users to make decisions
As a producer of data on Cloud and as part of enterprise requirement worked on moving all application dataset to Onelake which is built on top of S3 i.e. acting as a centralized place for massive amounts of raw data or true source data for downstream analysis
Work closely with the QA team during the testing phase and fix the defects
Documented policies, procedures, and technical standards to support disaster recovery planning and performed DR activity on semi annual basis to move all our batch process and internal hosted web applications from AWS east to AWS west and test the same
Performed root cause analysis for recurring issues and Major Incidents
Troubleshooted hardware issues, perform upgrades and maintenance support
Oversaw the integration of different products to achieve the proper functionality and meet the specific requirements of each system
Worked on enhancement, support and deployment of a internal web application developed in NodeJs, this application is leveraged by DA's and Business users on Daily basis to push files to S3
Developed and maintained common services, repositories, and utility components for enterprise
Conducted Technical Interviews, assisted onboarding and mentoring new team members
Senior ETL Developer
Travelers
Hartford, CT
06.2007 - 06.2012
Roles and Responsibility
Created ETL jobs using Ab Initio tool that runs daily, weekly and on monthly basis to extract data from various systems and loads the data in SQL Server database according to business logic which is then represented using COGNOS reports to business users
Performed conversion of the existing DataStage jobs to Ab Initio graphs and conducted end to end testing on newly created ETL process against the existing DataStage jobs
Work closely with business customers to understand the
Business/Functional Requirements and converting it to a detailed technical design for IT
Coordinated with Offshore Counterparts in getting the requests assigned/completed and also providing support/ technical guidance to the team
Reviewing/Unit Testing all the work products as part of support/enhancement requests before Implementation
Responsible for release management for production implementation of the developed projects and coordinate with the support and release teams to release the project into production
Created Autosys jobs for scheduling the Ab Initio process in production
Performed Production support of ETL jobs and participated in
Troubleshooting, debugging and resolving issues identified as part of acceptance test
Created BI reports in Cognos 8.4 for business users
Education
Bachelor of Engineering Technology - Electronics And Telecommunications