Summary
Overview
Work History
Education
Skills
Projects
Timeline
Generic

SIVARAMI REDDY

Marietta,GA

Summary

Experienced Junior Data Engineer with over 1 year of hands-on experience in Python, SQL, and BigQuery. Skilled in deploying advanced analytics tools such as Vertex AI, Pandas, NumPy, Scikit-learn, and PySpark to optimize data workflows and deliver actionable insights. Proficient in designing and implementing ETL pipelines for efficient data processing and integration. Dedicated to improving data infrastructure and ensuring high data quality to support informed decision-making. Strong collaborator with cross-functional teams, focused on driving organizational growth through innovative data-driven solutions.

Skilled Associate Data Engineer with background in designing, building and maintaining data processing systems. Familiarity with identifying patterns and trends in large datasets adds to ability to deliver innovative solutions for complex business challenges. Demonstrated strengths include teamwork, problem-solving skills, and proficiency in SQL, Python, and Hadoop. Previous roles have involved enhancing data collection procedures to improve overall data reliability and quality.

Overview

1
1
year of professional experience

Work History

Junior Data Engineer

Silverpop Systems
Hyderabad, Telangana
12.2020 - 05.2022
  • Developed and maintained ETL pipelines using Python and PySpark, ensuring efficient data processing and transformation
  • Utilized SQL and BigQuery to query and manipulate large datasets, improving data accessibility and reliability
  • Implemented machine learning models in Vertex AI, achieving [specific achievements or improvements]
  • Collaborated with cross-functional teams to optimize data infrastructure and improve data quality and reliability
  • Conducted data analysis using Pandas and NumPy, providing insights for business decision-making
  • Contributed to the development of scalable data solutions, focusing on performance and scalability
  • Tested new features before release by writing unit tests and validating results against expected outcomes.
  • Configured replication tasks in MySQL and PostgreSQL databases to replicate changes across environments.

Real-time Data Processing Pipeline

Real-time Data Processing Pipeline
  • Designed and implemented a real-time data processing pipeline to handle streaming data from IoT devices
  • The pipeline involved ingestion, transformation, and storage of data using Apache Kafka for message queuing, PySpark for data processing, and BigQuery for storage and querying
  • Tools Used: Python, PySpark, Apache Kafka, BigQuery
  • Achievements: Reduced data processing latency by 30% and improved overall system throughput by implementing optimized data partitioning and parallel processing techniques
  • Analyzed customer feedback surveys for trends in customer satisfaction levels.
  • Monitored network performance and troubleshoot any issues that may arise.
  • Maintained a detailed logbook of all activities related to data processing operations.
  • Assisted in the development and implementation of new software applications for data processing purposes.
  • Updated existing databases with newly acquired information or changes made by user requests.

Education

Bachelor of Science - Computer Science

Vignan's Foundation For Sceince And Technology
Guntur, AP
05-2020

Skills

  • Python
  • SQL
  • BigQuery
  • Vertex AI
  • Pandas
  • NumPy
  • Scikit-learn
  • PySpark
  • Problem-solving
  • Analytical mindset
  • Collaboration
  • Communication
  • Presentation

Projects

Real-time Data Processing Pipeline, Designed and implemented a real-time data processing pipeline to handle streaming data from IoT devices. The pipeline involved ingestion, transformation, and storage of data using Apache Kafka for message queuing, PySpark for data processing, and BigQuery for storage and querying., Python, PySpark, Apache Kafka, BigQuery, Reduced data processing latency by 30% and improved overall system throughput by implementing optimized data partitioning and parallel processing techniques.

Timeline

Junior Data Engineer

Silverpop Systems
12.2020 - 05.2022

Real-time Data Processing Pipeline

Real-time Data Processing Pipeline

Bachelor of Science - Computer Science

Vignan's Foundation For Sceince And Technology
SIVARAMI REDDY