Lalitha Nandiki
Arlington,Texas
Summary
Data engineer experienced in working across the different stages of the data pipeline, including acquisition, integration, ODS and real-time data marts. Adept in working quickly and efficiently in close collaboration with analytic, engineering and other stakeholders.
Overview
5
5
years of professional experience
1
1
Certification
Work History
Data Engineer
- Artificial Inventions, LLC.
Charlotte, NC
06.2024 - Current
- Worked closely with stakeholders across departments to design, build and deploy various initiatives within the data platform
- Developed, deployed and maintained data services using Snowflake
- Prepared and presented reports, analysis and presentations to various stakeholders including executives
- Designed best practices to support continuous process automation for data ingestion and data pipeline workflows
- Increased the efficiency of data pipelines that processed over 100 TB of data daily.
Data Engineer
- Excelon Solutions
Carrollton, TX
07.2023 - 05.2024
- Designed and implemented data solutions best suited to deliver on our customer needs
- Provided excellent leadership by recommending the right technologies and solutions for a given use case
- Completed software development life cycle experience including design, documentation, implementation, testing and deployment
- Continually explored new technologies in an effort to always grow and uncover better ways to solve problems
- Developed an updated ETL System using Python 3.10.
Jr.Data Engineer
- TCS
Hyderabad, Telangana
06.2019 - 07.2021
- Developed stored procedures to populate fact and dimension tables within Azure SQL Data Warehouse.
- Created intricate queries tailored to business needs using PySpark and SparkSQL in Azure Databricks.
- Served as the primary contact for production support, overseeing the implementation of a new framework utilizing Azure Data Factory and Azure Databricks.
- Managed the migration of on-premises data from SQL Server to Azure Data Lake Store (ADLS) using Azure Data Factory (ADF).
- Analyzed complex HiveQL queries to troubleshoot and resolve data errors or mismatches between source systems and destination reports, ensuring accurate validation for end-users.
Education
Master of Arts - Information Technology Management
Webster University
San Antonio05.2024
Bachelor of Science - Civil Engineering
Geethanjali College of Engineering And Technology
Hyderabad05-2021
Skills
- Azure Databricks
- Apache Spark
- Dashboard
- Data Extraction
- Data Governance
- Data Ingestion
- Data Integrity
- Data Pipeline
- Data Processing
- Data Quality
- Data Security
- Data Validation
- Extract Transform Load (ETL)
- SparkSQL
- Performance Analysis
- Power BI
- Pyspark
- Python
- SQL
Certification
Azure Data Engineer Associate
(01/2024 - 01/2025)
(https://learn.microsoft.com/en-us/users/lalithanandiki-7327/credentials/33989ad241ccc982?ref=https%3A%2F%2Fwww.linkedin.com%2F)
Languages
- English
Projects
Project Title: COVID-19 Data Dashboard Development
May 2020
● Automated data ingestion and integration processes, reducing manual effort and ensuring timely updates of COVID-19 statistics.
● Optimized data pipelines for scalability and performance, handling large volumes of real-time data efficiently.
● Implemented rigorous data validation and quality checks to maintain data integrity and reliability.
Project Title: Formula 1 Performance Analysis Platform
April 2023
● Engineered robust ETL pipelines to streamline data extraction, transformation, and loading processes, improving data accuracy and efficiency.
● Optimized SQL queries and database schema to handle complex joins and aggregations, enabling fast retrieval and analysis of large-scale race data.
Developed interactive Power BI dashboards with drill-down capabilities, providing stakeholders with insights into team strategies, driver performance trends, and season outcomes.
Timeline
Data Engineer
- Artificial Inventions, LLC.
06.2024 - Current
Data Engineer
- Excelon Solutions
07.2023 - 05.2024
Jr.Data Engineer
- TCS
06.2019 - 07.2021
Master of Arts - Information Technology Management
Webster University
Bachelor of Science - Civil Engineering
Geethanjali College of Engineering And Technology
Azure Data Engineer Associate
(01/2024 - 01/2025)
(https://learn.microsoft.com/en-us/users/lalithanandiki-7327/credentials/33989ad241ccc982?ref=https%3A%2F%2Fwww.linkedin.com%2F)
Similar Profiles
Lalitha NandikiLalitha Nandiki
Data Engineer at - Artificial Inventions, LLC.Data Engineer at - Artificial Inventions, LLC.
Samuel HemkerSamuel Hemker
Manager, Talent Solutions at Simplify Inventions, LLCManager, Talent Solutions at Simplify Inventions, LLC
Samuel HemkerSamuel Hemker
Manager, Talent Solutions at Simplify Inventions, LLCManager, Talent Solutions at Simplify Inventions, LLC