Summary
Overview
Work History
Education
Skills
Websites
Personal Information
Projects
Timeline
Generic

Nithin Reddy

Boston,MA

Summary

Highly skilled Data Engineer with 3 years of experience in designing, developing, and maintaining robust data pipelines and architectures. Proficient in transforming complex datasets into actionable insights through data modeling, ETL processes, and advanced analytics. Demonstrated expertise in utilizing SQL, Python, and big data technologies such as Hadoop and Spark. Proven ability to collaborate with cross-functional teams to drive data-driven decision-making and support business objectives. Adept at optimizing data workflows for performance, scalability, and reliability in fast-paced environments. Strong problem-solving skills with a keen eye for detail and a commitment to continuous learning and improvement. Certified in Microsoft Azure Data Engineer.

Overview

4
4
years of professional experience

Work History

Data Engineer

Galderma
01.2023 - Current
  • Developed and optimized data pipelines using Python and Pyspark, handling large-scale data processing tasks and ensuring efficient data transformation and integration
  • Designed and implemented data storage solutions on AWS, utilizing S3 for storage, Redshift for data warehousing, and RDS for relational database management
  • Leveraged AWS Glue to automate the ETL (Extract, Transform, Load) process, improving data processing efficiency by 30%
  • Implemented data validation and quality checks using SQL queries to ensure data integrity and accuracy across various stages of the data pipeline
  • Conducted performance tuning and optimization of SQL queries and Spark jobs, reducing data processing times by up to 40%
  • Proven ability to optimize Snowflake queries and data warehouse configurations for enhanced performance and scalability
  • Collaborated with cross-functional teams to define data requirements, develop analytical models, and deliver actionable insights for business decision-making
  • Deployed machine learning models on AWS Sage Maker, integrating predictive analytics into the data pipeline to enhance business forecasting
  • Utilized AWS Lambda for serverless data processing, enabling real-time data ingestion and transformation
  • Documented project workflows and technical processes, ensuring knowledge transfer and maintaining project continuity
  • Working on CI/CD solutions using Git and Jenkins to set up and configure the big data architecture on the AWS cloud platform.

Data Engineer

Credit Suisse
09.2020 - 12.2021
  • Designed and setup Enterprise Data Lake to provide support for various uses cases including Storing, processing, Analytics and Reporting of voluminous, rapidly changing data by using various AWS Services
  • Extracted data from multiple source systems S3, Redshift, RDS and Created multiple tables/databases in Glue Catalog by creating Glue Crawlers
  • Written Pyspark job in AWS Glue to merge data from multiple tables and in Utilizing Crawler to populate AWS Glue data Catalog with metadata table definitions
  • Leveraged Spark SQL for the preprocessing, cleansing, and joining of large datasets, ensuring data quality and readiness for analysis
  • Designed and Developed Scala workflows for data pull from cloud-based systems and apply transformations to them
  • Worked on modeling, Dimensional Modeling (Star Schema, Snowflake Schema), Data warehousing, and OLAP tools
  • Automated routine data processing tasks using Python scripts and cron jobs
  • Designed and implemented scalable data pipelines using Python and Apache Airflow
  • Integrated Apache Airflow with AWS to monitor multi-stage ML workflows with the tasks running on Amazon Sage Maker
  • Committed to continuous learning and staying updated with the latest trends and technologies in data engineering and Python development
  • Optimized SQL queries and Python code for better performance and reduced latency
  • Developed a Power BI dashboard to visualize key business KPIs, resulting in a weekly time savings of 10 hours on manual reporting tasks
  • Designed SSIS Packages to transfer data between servers, load data into the database on SQL Server environment, and deploy the data.

Education

Master of Science - Computer And Information Sciences

Rivier University
Nashua, NH
05.2023

Bachelor of Science - Electrical Engineering

JBIT
Hyderabad , India
05.2021

Skills

  • Python
  • Scala
  • SQL
  • NoSQL
  • MySQL
  • PostgreSQL
  • Agile
  • Client Engagement
  • Communication
  • Client Collaboration
  • Client Satisfaction
  • Leadership
  • Problem Solving
  • Troubleshooting
  • Growth Mindset
  • Collaborative
  • Technical Acumen
  • PyCharm
  • Jupyter Notebook
  • Pandas
  • NumPy
  • Kafka
  • AWS (EC2, S3 Bucket, Amazon Redshift, Lambda, IAM, Kinesis, AWS Glue, EMR, AWS Athena)
  • Azure (Azure Data Lake Storage, Azure Data Factory, Azure SQL databases, Azure Databricks)

Personal Information

Title: Data Engineer

Projects

Machine Learning Models from Scratch - Gender Classification, Engineered and implemented machine learning models for gender classification without relying on external libraries. Developed K-Nearest Neighbors (KNN), Deep Learning, Logistic Regression, Decision Tree, and other models from scratch., Achieved an 85% accuracy rate in gender classification through the implemented models. Optimized model performance, reducing processing time by 20% through algorithmic enhancements., Python, NumPy, Pandas, Statistical Analysis, K-Nearest Neighbors (KNN), Deep Learning, Machine Learning, Decision Trees, Logistic Regression Database Design for University Management - Project Doctoral, Led design and implementation of 'Doctoral' database, utilizing Oracle8i for efficient storage. Developed Java console app for CRUD operations, achieving a 25% reduction in query response time., Python, Data Modeling, Database Design, SQL, ERD, Data Optimization

Timeline

Data Engineer

Galderma
01.2023 - Current

Data Engineer

Credit Suisse
09.2020 - 12.2021

Master of Science - Computer And Information Sciences

Rivier University

Bachelor of Science - Electrical Engineering

JBIT

Similar Profiles

CREATE PROFILE
Nithin Reddy