Shubham Singh
Bangalore
Summary
Highly effective and self-driven data engineer with expert level working knowledge with 5+ years of experience in big data, data analytics, machine learning, Databricks and cloud computing. Offering hands-on expertise in advanced SQL, T-SQL, Python Notebooks, Databricks Workflows, Azure DF, ADLS, and relevant data engineering tools. Looking for career opportunities to work in an organization that offers an opportunity to work in an enterprise level projects that matches my skills and challenges my ability to develop business critical data products based on cloud technologies. Proven capacity to establish and collaborate with technology experts as well as end-users to provide creative and valuable workflow strategies.
Overview
5
5
years of professional experience
Work History
Senior Data Engineer
USEFUL BI CORPORATION
05.2022 - Current
- Responsible for providing the technical solution for data movement, cloud migration and successful handover of projects to support and development teams, also play lead role for project deliverables.
Python Developer
COGITATE TECHNOLOGY SOLUTIONS, INC.
06.2019 - 05.2022
- Provides solution to build multiple Machine learning models for insurance domain projects and various tools for business team to get leads from social platforms.
Education
BE - CSE -
Institute of Engineering and Science, IPS Academy - Indore
01.2019
Senior Secondary School -
Kendriya Vidyalaya - Prayagraj
01.2014
Skills
- Git Version Control
- ETL development
- Big Data Processing
Skillset
Advanced SQL, T-SQL, Python, PySpark, Spark SQL, C, C++, Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Azure Key Vault, Pandas, NumPy, SciPy, Matplotlib, Scikit-Learn, NLP, classification, Regression, Neural Network, Open CV
Personal Information
Title: Senior Data Engineer
References
- Anand Amirtharaj (Solution Architect at Useful BI Corporation)
- Ashish Nair (Vice President - Product Development at Cogitate Technology Solutions)
Projects
USEFUL BI CORPORATION, EBP-BMS, This is a project which includes migration of multiple data objects from different data sources into cloud with some transformation and orchestration and scheduling the regular job to make it work for live data, 5, 8 Months, Lead Data Engineer, responsible for team's delivery, Azure Databricks, Python Notebooks, PySpark, SparkSQL, SQL/TSQL,ADF USEFUL BI CORPORATION, Symphony, It is a data orchestration tool which is used to take the data from different RDBMS and file based sources and move the data into federal data lake tables, 4, 11 Months, Data Engineer, responsible for creating Data Models in RDBMS, Advanced SQL/TSQL., Azure Databricks, PySpark, ADF COGITATE TECHNOLOGY SOLUTIONS, INC, Claim Fraudulent Network Analysis, Trained the Machine Learning Model on historical claims to predict the probability of fraudulence in claims, 4, 9 Months, Python Developer, responsible for creating ML Models, Python, Pandas, scikit learn COGITATE TECHNOLOGY SOLUTIONS, INC, Demand Assist Classifier, Developed the Classifier using Natural Language Processing to classify the documents into demand and no demand documents, 4, 7 Months, Python Developer, responsible for creating ML Models, Python, Pandas,scikit learn, NLP, pytesseract COGITATE TECHNOLOGY SOLUTIONS, INC, Desk Appraisal, Trained the model to detect the damaged part of the vehicle and predicts the severity of damage and which part is damaged in the vehicle, 3, 7 Months, Python Developer, responsible for creating ML/DL Models, Python, Pandas,scikit learn, Keras, Open-CV COGITATE TECHNOLOGY SOLUTIONS, INC, LinkedIn Crawler, Developed the web crawler to get the data of decision makers of different insurance companies from LinkedIn, 2, 3 Months, Python Developer, responsible for creating the tool to scrap the information from social platform, Python, Pandas,tkinter, Selenium, BeautifulSoup
Timeline
Senior Data Engineer
USEFUL BI CORPORATION
05.2022 - Current
Python Developer
COGITATE TECHNOLOGY SOLUTIONS, INC.
06.2019 - 05.2022
BE - CSE -
Institute of Engineering and Science, IPS Academy - Indore
Senior Secondary School -
Kendriya Vidyalaya - Prayagraj
Similar Profiles
MARCUS DAVISMARCUS DAVIS
Substance Abuse Counselor at Bi-Bett CorporationSubstance Abuse Counselor at Bi-Bett Corporation
Joshua AguayoJoshua Aguayo
Bookkeeper / Data Analyst at Bi-MartBookkeeper / Data Analyst at Bi-Mart
Olga ChernyakOlga Chernyak
Clinical Trial Operations Specialist at Boehringer Ingelheim (BI)Clinical Trial Operations Specialist at Boehringer Ingelheim (BI)
Muskan JainMuskan Jain
Associate – Bid Management at Subex Ltd.Associate – Bid Management at Subex Ltd.
Lakshmi Durga KogantiLakshmi Durga Koganti
Technical Writer at Cisco Systems Inc. Ltd.Technical Writer at Cisco Systems Inc. Ltd.