Summary
Overview
Work History
Education
Skills
Websites
Certification
Personal Information
Technical Summary - Skills
Timeline
Generic

Anil Puppala

Boston,USA

Summary

Dynamic Azure Data Engineer with a proven track record at HarbourVest Partners, specializing in data pipeline development and performance tuning. Expert in Azure SQL and ETL processes, I excel in transforming complex data into actionable insights while fostering collaboration and effective communication within teams. Passionate about leveraging technology to drive business success.

Overview

16
16
years of professional experience
1
1
Certification

Work History

Azure Data Engineer - Architect

HarbourVest Partners
Boston, USA
08.2021 - Current
  • Provide data solutions using Azure tech stack to Analyze, Design and develop data consumption ETL/ELT pipelines using the source files in different formats from various vendors like Bloomberg, Pitchbook, Preqin, eFront etc.
  • Written Python applications using SPARK libraries in Azure Databricks for Data Curation, transformations and loading the huge datasets into the Azure SQL database.
  • Created and designed the Azure SQL Databases and developed complex stored procedures to do the ETL process and Table valued Functions to extract the data.
  • Worked on Azure Data Factory to create, publish and scheduled the pipelines as an ETL/ELT process to execute in tandem the python programs in Azure databricks and SQL Procedures in Azure SQL.
  • Responsible for the monitoring, troubleshooting and performance tuning of the Spark Applications by leveraging on the parallelism, memory tuning, batches and cluster types.
  • Responsible for the performance tuning of the Azure SQL Procedures and Table Valued Functions using Query Store.
  • Experienced in deploying the Azure Databricks, Azure data factory and Azure SQL objects to higher environments using the Azure DevOps, GITHUB and Visual Studio.

MSBI (SSIS, SSAS & SSRS), T-SQL, PL-SQL, ETL Developer

State Street Bank
Boston, USA
03.2018 - 07.2021
  • Involved in Technical discussions and decisions for Business requirements, Interaction with Business Analysts, Client team and Development team.
  • Experienced in database design process and data modeling process.
  • Analyzed the Data quality, Data validating, Data Mapping to migrate data to SQL Server database.
  • Designed SQL Server Database and Table Design with Schemas, Constraints and Views.
  • Extracted data from various sources like DB2, VSAM, SQL Server 2014/2012/2008 R2, .CSV, Microsoft Excel and Text file from Client servers.
  • Analyzed business requirements and implemented data mart solutions for data mining and reporting.
  • Created SSIS packages which involved a variety of transformations such as Slowly Changing Dimension, look up, Aggregate, Derived Column, Conditional Split, Multicast, Union All, Merge, Merge Join, and Data Conversion before loading the data into Data Warehouse.
  • Created a report model on SSAS cubes and used Multi- Dimension Expressions (MDX), Data-Analysis Expressions (DAX) and Data Mining Expressions (DMX).
  • Designed the data model based on star schema and created the tables and indexes and developed the scripts to load the data mart tables.
  • Identified issue and developed a procedure for correcting the problem which resulted in the improved quality of critical tables by eliminating the possibility of entering duplicate data in a Data Warehouse.
  • Developed, Code Reviewed, fixed bugs, tested and deployed SSIS packages using SQL Server 2014/2012/2008 R2 Business Intelligence Development Studio.
  • Gathered Report Requirements and designed Reports, Matrix, Table Reports with Drilldowns, Map Reports, Dashboards, Gauge and Subscription reports using SSRS and Power BI.
  • Strong knowledge of Data Warehousing methodologies, concepts and implementation of star schemas, snowflakes schemas, facts & dimensions.
  • Developed reports with consistent drill-down functionality including Drilldown report and Summary report.
  • Ensured constraints and writing triggers/linked server scripts to apply the business rules. Performance Tuning, Backing Up & Restoring User Databases.
  • Developed and optimized database structures, stored procedures, Dynamic Management views, DDL triggers and user-defined functions.
  • Deployed and Tested (UAT) Reports in Multi User Environment. Created RSConfig Files and Ensure Report Security with Keys.
  • Involved in Installation, Configuration and Deployment of Reports using SSRS with Scale-Out topology.
  • Worked closely with QA team and helped them come up with test scenarios.
  • Environment: SQL Server 2014/2016/2017, T-SQL, Visual Studio, SSIS, SSAS (MDX), SSRS, Power BI, Oracle Exadata – 12c, PL-SQL, Excel, Agile/SCRUM Methodologies and AZURE Environment.

Sr. Consultant (MSBI/T-SQL/PL-SQL/ETL Developer)

State Street Bank
Boston, USA
02.2017 - 02.2018
  • Interacted with Business Analysts and stake holders to gather business requirements.
  • Transferred data from various data sources/business systems including DB2, MS Excel, MS Access, Flat Files etc. to SQL Server using SSIS Packages and using various features like Excel source, Flat file source, transformation etc. Created derived columns from the present columns for the given requirements.
  • Used SQL Server to load tables in support of de-coupled, pluggable architecture to manage data flows between service providers and LIPA.
  • Created SSIS packages to get data from different sources, consolidated and merged into one single source.
  • Created detailed design and requirements documents with logic to help team members understand the requirements and design.
  • Designed and implemented relational databases, data marts and developed reports to allow users to easily access data.
  • Developed reports with consistent drill-down functionality including Drilldown report and Summary report.
  • Used SSRS to create, execute, and deliver tabular, matrix, and charts reports.
  • Involved in usage of various SSIS components like Slowly Changing Dimension, Conditional Split, Merge, Merge Join, Multicast, Union All, Sort, Derived column, SQL execution task, Variables, and Error Handling before loading data into the Data warehouse.
  • Designed custom Dimensions and Facts Tables to extend data warehouse.
  • Worked on the project that involved development and implementation of a data warehouse.
  • Created SSIS packages and involved in Package Configurations and deployments between Development and QA and Production servers so that various properties like variables, connection managers could be changed when moving the Package from one environment to another.
  • Involved in Code Review, Unit testing, logging and Custom Logging in SSIS Packages, Query verification in SSIS and Stored Procedures.
  • Conducted system tests, troubleshoot customer issues and correct database defects.
  • Worked on Exception Handling with @@error and with Try/catch and resolving locking/deadlocks.
  • Use customer requirements to improve functionality (speed, performance / usability).
  • Created, tested and implemented SQL backup strategy based on the business needs, utilize the combination of full, differential and transactional log backup to ensure all necessary business data is properly backed up.
  • Provided back-end support for functional testing and performance testing. Developed scripts to migrate data from multiple sources to desired destination using ETL tools.
  • Modified SSIS ETL packages for changed business requirements to load data from different source files to SQL Server tables in data warehouse.
  • Worked on knowledge transfer and documentation of various jobs developed and deployed into production.
  • Coordinated/Involved in deployment/migration of change requests to testing (System Integration Testing) and production environment.
  • Supported performance related issues in production database and optimized stored procedures/queries with the help of different Microsoft tools.
  • Environment: SQL Server 2012/2014, SSIS, SSRS, T-SQL, Oracle Exadata – 12c, SQL Server Management Studio, Visual Studio 2010, TortoiseSVNv1.7.11, Windows Server 2003, Agile/SCRUM.

Technical Consultant (MSBI/T-SQL/PL-SQL/ETL Developer)

Union Bank
San Francisco, USA
10.2016 - 01.2017
  • Developed ETL jobs like data transformation using Microsoft SQL Server Integration services.
  • Created SSIS packages, staged data from different data sources into a SQL Server Database using SQL Server Integration Services.
  • Designed and created SQL Databases, tables, indexes, and views, User Defined Functions, Stored Procedures, and Triggers to support business applications.
  • Developed SQL Server reports on daily performance of databases using SQL Server Reporting Services.
  • Administered minor databases of the facility using SQL Management Studio.
  • Performance Tuning and Maintenance plan for consistency checks, backup/restore and Rebuild Indexes.
  • Wrote stored procedures using T-SQL & PL-SQL and implemented them for data movement from Oracle to SQL Server through scheduled SSIS Packages.
  • Worked with various business groups while developing their applications, assisting in database design, phasing from development to QA and to Production environment.
  • Environment: SQL Server 2014, T-SQL/SSIS/SSAS/SSRS, Oracle 11g, PL-SQL, Excel, Import/Export tools, jQuery, JavaScript, Any Charts, PL/SQL,SQL Developer, SQL LOADER, Windows XP.

Senior Software Engineer

Royal Bank of Canada
Hyderabad, India
04.2014 - 12.2014
  • Project Name: Mortgages
  • Environment: SQL Server 2014 (T-SQL/SSIS/SSAS/SSRS), Oracle 11g PLSQL, JQuery/AJAX.

Senior Software Engineer

TMX Finance, Advance Financial, CheckMate
Hyderabad, India
01.2011 - 03.2014
  • Project Name: Title Loans and Installment Loans
  • Environment: SQL Server 2005 R2/2008 (T-SQL/SSIS/SSAS/SSRS), Oracle 11g PLSQL & Oracle DBA.

Senior Software Trainee

State Bank of India
Hyderabad, India
12.2009 - 12.2010
  • Project Name: State Bank of India – Training Portal
  • Environment: Oracle 10g DBA & PLSQL, Java.

Education

Data Streaming with Apache Kafka and Spark – Nanodegree -

Udacity
01.2021

Master’s - Computer Science

Lamar University
Texas, USA
01.2016

Bachelor’s - Computer Science

JNTU
India
01.2009

Skills

  • Azure SQL
  • Azure Data Factory
  • Azure Databricks
  • Azure Data Lake
  • Azure DevOps
  • PowerShell
  • Python
  • Pandas
  • Numpy
  • PySpark
  • Dash
  • Plotly
  • BDD
  • Matplotlib
  • PyTest
  • Apache Kafka
  • Apache Spark
  • SQL Server
  • MSBI
  • SSIS
  • SSAS
  • SSRS
  • MDX
  • DAX
  • Oracle
  • SQL
  • PL-SQL
  • DBA
  • Data Visualization
  • Tableau
  • Microsoft Power BI
  • R-ggplot2
  • HTML
  • CSS
  • XML
  • JavaScript
  • JQuery
  • AJAX
  • MongoDB
  • Azure Cosmos DB
  • AWS DynamoDB
  • Windows Server
  • UNIX
  • MS-DOS
  • Docker
  • Kubernetes
  • Amazon Web Services
  • S3
  • EC2
  • IAM
  • Data pipeline development
  • Azure data integration
  • ETL process design
  • Azure SQL management
  • Data transformation
  • Database performance tuning
  • Data modeling
  • Data quality analysis
  • Business requirement gathering
  • Cloud computing
  • Version control
  • Team collaboration
  • Effective communication
  • Problem solving
  • Agile methodologies
  • Technical documentation
  • Verbal communication
  • Teamwork and collaboration
  • Problem resolution
  • Project planning
  • Supervision and leadership
  • Leadership
  • Data management
  • Active listening

Certification

Confluent Certified Developer for Apache Kafka

Personal Information

Work Permit: GC

Technical Summary - Skills

  • Azure SQL
  • Azure Data Factory
  • Azure Databricks
  • Azure Data Lake
  • Azure DevOps
  • PowerShell
  • Python
  • Apache Kafka
  • Apache Spark
  • SQL Server
  • MSBI
  • Oracle
  • Data Visualization
  • MongoDB
  • Docker
  • Kubernetes
  • AWS

Timeline

Azure Data Engineer - Architect

HarbourVest Partners
08.2021 - Current

MSBI (SSIS, SSAS & SSRS), T-SQL, PL-SQL, ETL Developer

State Street Bank
03.2018 - 07.2021

Sr. Consultant (MSBI/T-SQL/PL-SQL/ETL Developer)

State Street Bank
02.2017 - 02.2018

Technical Consultant (MSBI/T-SQL/PL-SQL/ETL Developer)

Union Bank
10.2016 - 01.2017

Senior Software Engineer

Royal Bank of Canada
04.2014 - 12.2014

Senior Software Engineer

TMX Finance, Advance Financial, CheckMate
01.2011 - 03.2014

Senior Software Trainee

State Bank of India
12.2009 - 12.2010

Data Streaming with Apache Kafka and Spark – Nanodegree -

Udacity

Master’s - Computer Science

Lamar University

Bachelor’s - Computer Science

JNTU

Similar Profiles

CREATE PROFILE
Anil Puppala