Summary
Overview
Work History
Education
Skills
Accomplishments
Awards
Projects
Timeline
AdministrativeAssistant
Shubham Naphade

Shubham Naphade

Data Engineer
Pune,India

Summary

Experienced Data Architect well-versed in defining requirements, planning solutions and implementing structures at the enterprise level. Analytical problem-solver with a detail-oriented and methodical approach. Prepared to offer 3+ years of related experience to a dynamic new position with room for advancement.

Overview

3
3
years of professional experience
5
5
years of post-secondary education

Work History

Data Engineer

AgreeYa Solutions India Pvt. Ltd
Pune, India
06.2021 - Current
  • Designed and develop configurable end-to-end Big Data Pipeline solutions using Composer, BigQuery & Cloud Storage
  • Worked on dynamic Airflow Dag generation using Jinja template
  • Developed BigQuery Stored procedure for data transformation and cleansing
  • Designed different file operation services using Cloud Function and Cloud Run services
  • Data Management using BigQuery to retrieve the data efficiently for data analysis and reporting
  • Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
  • Generated detailed studies on potential third-party data handling solutions, verifying compliance with internal needs and stakeholder requirements.
  • Identified and remediated single points of failure and security risks.
  • Collaborated with development and operations teams to develop practical automation solutions and custom modules.

Programmer

Bitwise Solutions Pvt. Ltd
Pune, India
06.2019 - 06.2021
  • Design, build, and maintain infrastructure and software platforms within cloud based environments i.e
  • Worked as technical leader alongside customers and infrastructure team and contributed to business development.
  • GCP using public cloud service models infrastructure-as-a-service and platform-as-a-service offerings
  • Directed data transformations and transitions using Google Dataflow and BigQuery
  • Migrate existing on-premises data from physical data centers to cloud using cloud migration and automation tools
  • Designed data models for complex analysis needs
  • Write shell scripts to automate operations and server management
  • Created and implemented database designs and data models
  • Validated warehouse data structure and accuracy
  • Developed and modified programs to meet customer requirements
  • Cooperated fully with product owners and enterprise architects to understand requirements
  • Selected methods and criteria for warehouse data evaluation procedures
  • Conducted deep-dive hands-on training sessions to transfer knowledge to customers considering or already using GCP.
  • Performed first-level incident response and service resolution for cloud systems.
  • Monitored costs and optimized cloud deployment expenses against business needs.

Education

Bachelor of Engineering - Computer Engineering

Sinhgad Institute of Technology
Pune
04.2016 - 04.2019

Diploma - Computer Engineering

Government Polytechnic, Amravati
Amravati
01.2014 - 01.2016

Skills

BigQuery

undefined

Accomplishments

  • Achieved efficient file decompression by introducing GKE based solution.
  • Achieved dynamic Airflow DAG generation using Jinja and JSON Configuration stored in BigQuery.
  • Resolved product issue through consumer testing.

Awards

  • Extra Mile Award, AgreeYa Solutions -13/12/2021

For showing excellent skills and performance exceeding customer's expectations


  • Excellence Award, Bitwise Solutions - 30/10/2020

For Demonstrating Passion & Excellence in Collaboration


  • V Award, Bitwise Solutions - 30/10/2020

For achieving Customer Satisfaction & High Efficiency

Projects

  • Hadoop Migration, Bitwise Solutions, Client - Global Payments

Migration of On-Premise Hadoop processes and data to Google Cloud Platform.


Role: Developer

Contributions:

- Convert Hive SQLs to BigQuery compatible SQLs
- Developed Airflow DAGs for Orchestrations

- Developed Linux Shell Scripts for data ingestion jobs

Tecnologies: BigQuery, Google Cloud Storage, Dataproc, Airflow, Dataflow, Java, Python


  • Netezza Migration, Bitwise Solutions, Client - Global Payments

Migrate existing analytics processes from IBM Netezza to Google Cloud Platform


Role: Developer

Contributions:

- Developed Dataflow jobs as per client's requirements
- Converted existing netezza logic to Dataflow and BigQuery

- Developed Batch and Streaming data processing jobs using Dataflow to migrate data to BigQuery

Technologies: Dataflow, Pub/Sub, BigQuery, Airflow, Shell Scripting, Google Cloud Storage

- Developed Linux Shell Scripts for data ingestion jobs

Tecnologies: BigQuery, Google Cloud Storage, Dataproc, Airflow, Dataflow, Java, Python

Timeline

Data Engineer

AgreeYa Solutions India Pvt. Ltd
06.2021 - Current

Programmer

Bitwise Solutions Pvt. Ltd
06.2019 - 06.2021

Bachelor of Engineering - Computer Engineering

Sinhgad Institute of Technology
04.2016 - 04.2019

Diploma - Computer Engineering

Government Polytechnic, Amravati
01.2014 - 01.2016

Similar Profiles

CREATE PROFILE
Shubham NaphadeData Engineer