A Sr IT Professional with decades of experience in Data Engineering/ Business Intelligence/SQL Development/ETL Development/Report Development.
Overview
11
11
years of professional experience
Work History
Data Engineer/SR SQL Developer
Amsive
05.2022 - Current
Designed and Developed Azure Synapse Pipelines to load the data from different sources including Azure Data warehouse
Automated ETL applications like Azure Pipelines, SSIS
Developed many python functions to be used on synapse pipelines
Developed pyspark notebooks to execute marketing campaigns of different healthcare clients
Utilized spark sql API within pyspark to extract, transform and load, perform sql queries
ETL from different source systems to Azure storage services using a combination of azure pipelines, TSQL and Spark SQL
Support different Financial and healthcare clients for marketing their products
Leverage Pyspark for efficient processing of campaigns for healthcare clients
Database Developer
TEXAS EDUCATION AGENCY
03.2020 - 05.2022
Involved in the ETL of state of Texas student, staff information From ODS into PDM (Data Mart), involved in writing complex procedures to validate the data
Created Jasper reports, developed SSIS packages and written 100s of complex procedures in PLSQL
Involved in writing procedures to validate business rules and generate reports when the data does not conform to validation rules.
Conducted tests to identify issues and make necessary modifications.
Identified issues within databases, performed troubleshooting and implemented effective solutions.
Documented and communicated database schemas using accepted notations.
Data Engineer /SR SQL Developer
INFOSYS
03.2019 - 03.2020
Involved in the development of ETL Packages using SSIS to load data from multiple source into PDW Server
Develop Power BI Dashboards from Datawarehouse
Designed Power BI Reports utilizing cross tabs, scatter plots, pie bar, map charts and density charts, Used DAX queries for computed columns in Power BI
Created Financial Power BI Dashboard for the stake holders and Product owners for business decision making
Developed many python functions for transforming data to be used within Azure data factory
Designed and Developed Azure Data Factory(ADF) Pipelines to load the data from different sources including Blobs, SharePoint List, Azure Data warehouse, Oracle, DB2, SAP, Hadoop etc
Automated ETL applications like ADF Pipelines, SSIS.
Senior ETL Database Developer/Data Engineer
VONNASYS
09.2018 - 03.2019
Loading Source Data from Oracle into SQL Tables to load into Microsoft AX
Fetch the Source data from Oracle, perform data cleansing, transformation before loading into the final destination tables
Created SSIS Packages for each entity that includes Customer Bank Account, Vendor Bank Account, Subscription billing, Sales Partner etc
Developed various T-SQL stored procedures, triggers, views and adding/changing tables for data load, transformation and extraction
Cleansed data using DQS cleansing component, fuzzy lookup and lookup transformations in SSIS packages
Designed Azure Database and Created SSIS Package to load into Azure
Created various Power BI Dashboards utilizing scatter plots, pier bar etc
Used Power BI, Power Pivot to develop data analysis prototype, and used Power View to visualize reports.
Conducted tests to identify issues and make necessary modifications.
Senior Database Consultant
LARSON AND TOUBRO INFOTECH
02.2017 - 07.2018
Extracted the Data from Claims which is in Oracle, convert into Acord XML and do incremental load into IEV XTM database, ensuring the data goes smoothly from XTM database into TDS and from TDS into ODS
Used complex query statements like sub queries, correlated queries, derived tables, CASE functions to insert the data depending on the criteria into the tables
Wrote T-SQL queries, created dynamic Stored Procedures by using input values
Loading the accord xml from the Oracle CA into IEV XTM using script task (C#.NET)
Extracting Data from AS400 and loading into Sapiens using SSIS Package
Extracting Data from Claims and loading into Sapiens using SSIS Package
Create SSIS Package according to the business requirement to process claims and policy information into Sapiens database
Created SSIS package to find exceptions after loading claims and wins file into SSIS, then email the file to different team members of Sapiens team
Senior ETL Database Associate
COGNIZANT TECHNOLOGY
01.2015 - 07.2016
Involved in the design and development of CDW Database for data migration from HCN Oracle database which belongs to Coram since CVS merged with Coram
Managed all indexing, debugging, optimization and performance tuning using SQL Profile and SQL Server Agent
Created 1 Master package, 1 Receipt package, 14 validation packages, 14 loading packages, 1 archival package and 1 acknowledgment package using Visual Studio Data tool.
Senior BI Developer/SQL Developer
HEXAWARE TECHNOLOGY
06.2014 - 01.2015
nvolved in Production support
Involved in creating various complex stored procedures, views, functions, triggers, tables etc
Involved in reverse engineering using ER studio
Created Stored procedures to load raw data into xraw tables, then filters out bad data using temporary tables and then loads to raw tables, and from the raw tables, finally good records will be loaded to Allocation and Block trade tables
Created documentation on the all the tables, stored procedures, views and user defined functions
Debugging to find errors occurred while loading data from OMS to CTR which is in sql server
Loaded Trades Obtained from State Street in CTR within the UNIX environment
Involved in debugging and testing stored procedures, functions, views, triggers during production support.
Senior BI Developer/SQL Developer
VSQUARE INFOTECH
08.2013 - 03.2014
Developed Logical and physical data model using ER Studio and mapped the data into database objects
Developed complex logical and Physical data model using ER studio
Designed General Ledger Reporting Data ware house using ER studio
Developed complex Views for different visualization for Spot fire reports
Worked extensively on query optimization and performance Tuning
Wrote T-SQL statements for retrieval of data and involved in performance tuning of TSQL queries
Created documentation on the all the tables, stored procedures, views and user defined functions
Created ETL packages with different data sources (SQL Server, Flat files, Excel source files, Oracle) and loaded the data into target tables by performing different kinds of transformations using SSIS
Developed logging for ETL load at the package level and task level to log number of records processed by each package and each task in a package using SSIS.