Priyansh Shah
Columbus,GA
Summary
Results-driven junior data engineer at Soft Standard Solutions with expertise in data pipeline development and ETL processes. Proven track record in automating data collection and improving data quality through SQL and collaborative analysis. Proficient in Python and agile methodologies, delivering solutions that enhance performance and reliability.
Overview
6
6
years of professional experience
1
1
Certification
Work History
Jr. Data Engineer
Soft Standard Solutions
Remote, GA
06.2024 - Current
- Performed ETL operations with Apache Spark to cleanse, enrich and integrate data from multiple sources into a single repository.
- Developed data pipelines to automate data collection from multiple sources.
- Utilized SQL for querying and managing large datasets efficiently.
- Collaborated with teams to identify actionable insights from data trends and patterns.
- Participated in code reviews to uphold data quality standards and enforce best practices.
- Engaged in agile development processes to facilitate on-time delivery of project updates.
Software Developer Intern
Stack Industry
Vadodara, India
11.2020 - 10.2021
- Reduced bugs by 20% by achieving 95% code coverage in automated testing using pyTest and Selenium, ensuring industry-grade performance and reliability.
- Developed software solution with Python data visualization libraries like Seaborn and Matplotlib to represent sensor data from 50+ industrial sensors.
- Integrated third-party APIs with existing systems using RESTful services to enhance system capabilities.
- Optimized SQL and NoSQL databases to decrease latency by 30% for quicker data storage and retrieval.
Education
MS - Computer Science
University of Massachusetts Boston
Boston, United States05-2024
B.E - Computer Engineering
Babaria Institute of Technology
Vadodara, India04-2021
Skills
- Data pipeline development
- ETL processes
- SQL querying
- Data automation
- Data analysis
- Python programming
- AWS services
- Apache Airflow
- Database management
- Container orchestration
- Git, Jenkins
- Bash, PowerShell
- Data governance
- Data lake management
Projects
- Highly Scalable Ecommerce Platform, 09/23, 12/23, Conceptualized and constructed a highly responsive user interface, transitioning from Figma to an interactive UI using React JS., Established a comprehensive user experience by integrating a Firebase-based Admin portal and a Stripe Payment Gateway system., Decreased stockout risks by 25% through the integration of Google Analytics and real-time inventory tracking using a Firebase database.
- Multi-Threaded Data Processing and Analysis of Boston City Datasets, 10/23, 11/23, Analyzed a database of over 10,000 Boston employee earnings to extract key insights, including maximum, minimum, and average earnings, as well as identifying the top 10% highest overtime earners., Optimized resource utilization by concurrently processing three streams of data using multithreading, ensuring accurate data synchronization from each thread., Enhanced data parsing efficiency with regex patterns, significantly improving data extraction accuracy and processing speed. And effectively filtered, sorted, and aggregated data using the Java Stream API.
- Global Weather Tracker with PHP, 01/22, 03/22, Developed a robust Global Weather Tracker with PHP, providing real-time weather updates and forecast insights for over 1,000 cities worldwide., Integrated third-party weather API - Weatherstack, ensuring accurate weather data with a 99% success rate in API calls., Utilized MySQL to efficiently store and manage user preferences and weather data, improving data access speed.
Certification
- AWS: Amazon Certified Cloud Practitioner
- JAVA 17 Masterclass
Languages
- Java
- Python
- JavaScript
- C++
- SQL
- Kotlin
- HTML
- CSS
Timeline
Jr. Data Engineer
Soft Standard Solutions
06.2024 - Current
Software Developer Intern
Stack Industry
11.2020 - 10.2021
MS - Computer Science
University of Massachusetts Boston
B.E - Computer Engineering
Babaria Institute of Technology