Summary
Overview
Work History
Education
Skills
Timeline
Generic

NANDINI PANUGANTI

Cumming,GA

Summary

Experienced Data Engineer with over 9+ years of experience in managing large data teams and leading complex data projects. Skilled in designing and implementing data infrastructures, creating ETL pipelines, managing big data platforms, Collecting, and sorting data in Government Finance and non - government client like Telecommunication, banking, Air Lines, and HealthCare. Having deep knowledge in Azure cloud services, T-SQL, and SQL, Relation database, database design, and data modeling, performance tuning, Designed and implemented SSIS packages, SSRS Reports, Designer and development lifecycle and practices. Proven ability to deliver high-quality solutions on time and within budget. Passionate about using data to drive business decisions and improve customer experiences.

Overview

12
12
years of professional experience

Work History

Lead Data Engineer

AT&T
Atlanta, GA
02.2022 - Current
  • Worked closely with cross-functional teams to identify data requirements and create data solutions that meet business needs
  • Developed and implemented data governance policies and procedures to ensure data quality, security, and compliance
  • Designed and managed big data platforms using Hadoop, Spark, and other big data technologies
  • Bulk Loading from the external stage (ADLS), internal stage to snowflake using the Copy command
  • Designed and implemented ETL processes using azure services such as Databricks and Data factory
  • Extensively worked on Azure databricks Delta lake
  • Designed various ingestion and processing patterns based on use cases in Delta lake
  • Handled Schema mismatch and bad data very efficiently
  • Conducted performance tuning and optimization of data pipelines and platforms to improve efficiency and reduce costs
  • Writing Complex snowsql scripts in snowflake cloud data warehouse to business analysis and reporting
  • Preformed data quality using snow SQL by building analytical warehouse on snowflake
  • Led the adoption of new technologies and tools to improve data processing and analytics capabilities
  • Mentored and coached team members to develop their skills and advance their careers.

Senior Data Engineer

PWC
Tampa, FL
03.2021 - 02.2022
  • Designed and developed ETL pipelines for ingesting and processing large volumes of data from multiple sources
  • Built data warehouses and data marts to support business intelligence and analytics initiatives
  • Conducted data modeling and schema design to ensure data quality and consistency
  • Convert Talend Joblets to support the snowflake functionality
  • Developed and maintained data integration solutions using APIs and web services
  • Designed and implemented ETL pipelines using Apache Kafka for real-time data streaming
  • Orchestrated complex data workflows using Apache Airflow, ensuring data accuracy and timely processing
  • Developed Python scripts to automate data transformations, resulting in reduced processing times
  • Redesigned the views in snowflake to increase the performance
  • Unit tested the data between Azure SQL and snowflake
  • Worked closely with data analysts and data scientists to provide data insights and support data-driven decision making
  • Conducted code reviews and implemented best practices for code quality and maintainability
  • Developed and maintained data pipelines for ETL processes, resulting in a 15% increase in efficiency
  • Developed and maintained data models using ERD diagrams and implemented data warehousing solutions using Snowflake
  • Conducted ad-hoc analysis and provided insights to stakeholders.

Data Engineer

EClinicalWorks
Westborough, MA
09.2019 - 09.2020
  • Developed ETL pipelines and data processing workflows using PySpark, SQL, and other tools
  • Designed and implemented data solutions for various business units, including sales, marketing, and finance
  • Conducted data profiling and data cleansing to ensure data quality and accuracy
  • Built data visualization dashboards using Tableau and other BI tools
  • Assisted with data migration and system integration projects
  • Served as the primary expert for Azure based solutions to Implementation and Sales teams
  • Understood customer’s difficulties and business objectives
  • Extrapolated mission critical applications to their technical needs
  • Produced a complete implementation plan for all parts of the solution which I’m responsible for, identified which departments or employees are needed for tasks and assisted in completing their tasks
  • Produced documentation that allows other staff members to understand the deployment and maintain and troubleshoot it
  • Acted as liaison between departments to ensure all tasks are understood and completed properly
  • Implementing compute, storage and network services on AWS / Azure cloud platforms
  • Worked on JavaScript and frameworks like jQuery, AngularJS
  • Implemented Cassandra on AWS/Private cloud for multiple applications
  • Service-oriented platform development using .NET, WAP, Azure Stack, AWS, and OpenStack Cloud
  • Represent The Atlantic at Industry events related to programmatic and new ad tech
  • Ramp-up fast on relevant technologies as dictated by ongoing project and engineering priorities, including (but not limited to) other Microsoft products and services such as Azure SQL Database, SQL DW, Document DB as well as Open Source Big Data products such as Elastic Search, Mongo Db and Cassandra.

Senior SQL Developer

MEDES
Miami, FL
10.2015 - 08.2018
  • Converted complex algorithms into store procedure using T-SQL as per the business needs for purpose of application needs
  • Migrated Legacy Shore – Pre - Cruise Planning system into Relation Database system for better maintenance and easy processing of payments
  • Used Temp Tables / Table Variable to avoid cursors in the database
  • Worked on Query Optimization to improve the performance of Queries
  • Involved in weekly compliance meetings and discussed with other team leads and managers about how new Processes effect the environment in performance and compliance perspective
  • Building UAT and Test environments using Production backups for proactive testing of patches and hot fixes
  • Created SSIS Packages to migrate the data from database to flat files, Excel Files and XML files
  • Wrote SSIS package to create text file from the Survey data and push it to SFTP/FTP servers
  • Developed 60+ report for business with help of tables, sub report and charts using SSRS
  • Generated Reports using SSRS with different criteria to fulfill the client requirement
  • Deployed and generated reports on to the server using the Reporting Services Report Manager
  • Experience in Unit Testing, Functional Testing, System Integration Testing, Review Test Cases and Test Results
  • Understanding and implementing the process followed by Microsoft
  • Resolve database access and performance issues
  • Setting up alerting system by using performance counters for monitoring system performance
  • Creating and scheduling SQL jobs for application specific data maintenance tasks and data purging strategies
  • Preparing scripts and scheduling maintenance tasks
  • Collaborated with Planning and implementing team for SQL clustering and stand by servers for minimizing system downtime
  • Constantly updating the tickets that are assigned to me in JIRA
  • Developed java application with FOP (Formatting Objects Processor) for converting XML data into PDF with helps of XSLT and loaded into the database.

SQL Server Developer

TCS/British Airways
Chennai, India
03.2012 - 01.2015
  • Successfully migrated T-SQL source code from SQL Server 2000 to SQL Server 2005 to SQL Server 2012 to SQL Server 2014 to SQL 2016 on Development, Testing and production Environment
  • Implemented Business solution to support application running on .Net
  • Monitoring Scheduled jobs and alerts
  • Implementing Data warehouse and created data marts
  • Implemented SSIS package for Data Extraction, Transform and Load (ETL) to supply data for frontend applications
  • Used SQL COMPARE/TFS tool to compare the structures between databases in order to synch them
  • Used SQL Monitor and LogRhythm tools to spot trends and issues occurring in SQL servers and resolve them before they become a problem
  • Responsible for enhancing database objects including Tables, Indexes, and Stored Procedures and SQL jobs
  • Working with development team to optimize application specific database operations and implement security restrictions
  • Wrote complex Store Procedures and helped developers in writing store proc and using the latest enhancements available in SQL Server 2016/2014/2012
  • Designed and implemented scheduled Database maintenance plans and back up procedures to enhance over all database performance and disaster recovery
  • Implemented database policies and procedures to ensure the integrity and availability of Databases and their accompanying software
  • Involved in creating Schemas, Logins, Tables, Clustered and Non-Clustered Indexes, Views, Functions and Stored Procedures
  • Prepared the project management and technical documentation
  • Unit Testing the SSIS packages with respect to its flow and performance issues
  • Solving the Bugs Reflected by the Testing team
  • Rebuilding the indexes at regular intervals for better performance
  • Monitored and modified Performance using execution plans and Index tuning
  • Rebuilding the indexes at regular intervals for better performance
  • Extensively worked on DBCC commands and Dynamic Management Objects
  • Export or Import data from other data sources like flat files using Import/Export through DTS, SSIS
  • To analyze long running slow queries and tune the same to optimize application and system performance.

Education

Bachelors - Computer Science

JNTU
Anantapur
04-2011

Skills

  • Data warehousing and ETL (SSIS, Talend, Dell Boomi)
  • Big data technologies (Hadoop, Spark, etc)
  • Cloud Computing (Azure, Snowflake, AWS)
  • Data governance and security (Azure Purview, Erwin)
  • Data modeling and schema design (Toda Data Modeler, Erwin)
  • Azure SQL
  • Azure Synapse
  • Azure Purview
  • Azure Data Lake (Gen1, Gen2)
  • Azure Data Factory
  • Databricks
  • Integration Runtime
  • Azure Cosmos DB
  • Azure Monitor Service
  • Azure Functions
  • Snowflake
  • T-SQL Programming
  • System Analysis & Design
  • Application Development using SSIS and SSRS
  • Data Modeling & Relational Database Design
  • Data warehouse
  • Pyspark
  • Performance Tuning
  • GitHub
  • CICD

Timeline

Lead Data Engineer

AT&T
02.2022 - Current

Senior Data Engineer

PWC
03.2021 - 02.2022

Data Engineer

EClinicalWorks
09.2019 - 09.2020

Senior SQL Developer

MEDES
10.2015 - 08.2018

SQL Server Developer

TCS/British Airways
03.2012 - 01.2015

Bachelors - Computer Science

JNTU

Similar Profiles

CREATE PROFILE
NANDINI PANUGANTI