Lokesh Reddy Thipparthi
South Lyon,MI
Summary
Adept Data Engineer with a proven track record at Krithi Cybersoft Pvt. Ltd, where spearheaded the development of scalable data solutions, reducing data latency significantly. Expert in ETL development, Big Data technologies, and Agile methodologies, Coordinated excel in optimizing data processes and enhancing team efficiency. Successfully delivered actionable insights, leveraging skills in Python and SQL to drive data integrity and performance.
Overview
4
4
years of professional experience
Work History
Data Engineer
Krithi Cybersoft Pvt. Ltd
01.2019 - 08.2022
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- .Fine-tuned query performance and optimized database structures for faster, more accurate data retrieval and reporting.
- Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
- Streamlined complex workflows by breaking them down into manageable components for easier implementation and maintenance.
- Supported efficient data migration processes by designing and implementing robust ETL procedures, ensuring minimal downtime during transitions.
- Implemented proactive monitoring mechanisms for detecting potential system bottlenecks and taking preemptive action to prevent downtime or reduced performance.
- Applied Agile methodologies, facilitated weekly Sprints and conducted stand-up meetings to support iterative development.
- Implemented Python, SQL, and PL/SQL-based data processing to enhance data integrity and minimize errors.
- Demonstrated expertise in optimizing distributed storage and processing capabilities for enhanced scalability and performance using Hadoop and HDFS.
- Designed and developed efficient data ingestion pipelines with Scala, Apache Spark, Apache Kafka, and PL/SQL for ETL into Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and Azure Database for MySQL.
- Created interactive and visually appealing dashboards in Tableau, utilizing complex datasets to deliver actionable insights to stakeholders.
- Designed and implemented scalable data solutions, leading to a substantial reduction in data latency.
- Ensured higher data quality by maintaining consistent data models across multiple databases
- Developed efficient and scalable backend systems in Java and PL/SQL to enhance data processing and analysis.
- Designed, implemented, and maintained high-performing RESTful APIs for efficient data exchange between systems.
- Enabled seamless collaboration in the development lifecycle by implementing GitLab CI for continuous integration.
- Implemented cloud-based Snowflake solution to optimize data storage and analytics capabilities in Azure Cloud environment.
- Orchestrated end-to-end CI/CD pipelines for automated testing, deployment, and collaboration in on-premises and cloud environments using GitLab CI.
- Developed complex PL/SQL packages, procedures, and functions for business applications utilizing advanced features such as collections, nested tables, ref cursors, materialized views, and dynamic SQL.
- Performed SQL tuning, database application design, and developer support for efficient and optimized database operations.
- Developed detailed design documents to enhance communication and documentation of system architectures and implementation specifics.
Education
Master of Science - Information Sciences
Trine University
Angola, IN05.2024
Bachelor of Science - Computer Science
JNTUH
Hyderabad08.2020
Skills
- ETL development
- Data Modeling
- Big Data Technologies : Hadoop Ecosystems , Snowflake, Cloudera, Hortonworks, Microsoft Azure/Cloud Services, Denodo
- Scripting Languages : SQL, Shell / Unix, Python
- Programming Languages : Python, PL/SQL, Scala, R, Java, CI/CD(YAML)
- Database : MySQL, MS SQL Server Database, Oracle
- Operating Systems : Linux , Windows XP/7/8/10/11, Mac
- Software Life Cycle: SDLC and Agile models
- Utilities / Tools : Talend ETL, GitLab CI, Excel PowerPivot
- Data Visualization Tolls : Tableau, Spark, Power BI
Timeline
Data Engineer
Krithi Cybersoft Pvt. Ltd
01.2019 - 08.2022
Master of Science - Information Sciences
Trine University
Bachelor of Science - Computer Science
JNTUH
Similar Profiles
Venkata Naresh Babu ThalapaneniVenkata Naresh Babu Thalapaneni
Finance & Accounts Manager at Krithi Motor Bikes LLP & Arihant MotorsFinance & Accounts Manager at Krithi Motor Bikes LLP & Arihant Motors
Dhanush Chandra JabbuDhanush Chandra Jabbu
Software Developer at NEW HORIZONS CYBERSOFT LtdSoftware Developer at NEW HORIZONS CYBERSOFT Ltd
Samantha FraySamantha Fray
Project Manager - Implementation Specialist at Cybersoft PrimeroedgeProject Manager - Implementation Specialist at Cybersoft Primeroedge