Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

Rajesh Yadav

Brookshire,TX

Summary

Rajesh is a seasoned Business Intelligence/Data Engineering/Data Science/Big Data consultant and Architect with knack to understand the Core system and perform system analysis and use hands down approach to shape the system architecture, implement and deliver measurable business values and tangible outcomes. In his career he is responsible for business requirement analysis, Client Engagement and Coordination with team, prepare technical and functional manuscript to meet business requirement and involve in end-to-end SDLC process. Engaged with Marketing Directors and Business PM’s as a Data consultant and generating the IT needs and its execution delivery. Having 16+ Years of IT Experiences in Data Modelling, Data Mart Development & Maintenance of Data Warehousing and Client server Application with Banking & Finance, Manufacturing with expertise in MS SQL Server 2005/2008 R2/2012 and products like SSAS, SSIS, SSRS, Multidimensional (MDX), Data Analysis Expressions(DAX), Tabular Model, Power BI, SharePoint, .NET(C#, VB, ASP), WCF Services, Web Services, Microsoft Azure Services, Azure Data Lake, Azure Data Factory, Crystal Report., Informatica, Rest API Integration, Dell Boomi, HIVE, SPARK, Python, SCALA, AZURE DATABRICKS, STREAMING, KAFKA, EVENT HUB, NoSQL, MONGODB, COSMOSDB, ELASTICSEARCH, AZURE SYNAPSE ANALYTICS, SNOWFLAKE, ML. Architected and implemented Data Science Infrastructure using Microsoft Azure Cloud and designed and implemented the VNET based architecture. Architected and designed the model creation and deployment strategy for Data Science projects. Experienced in Data Extraction, Migrations, Transformation and Loading (ETL) between Homogenous and Heterogeneous Systems using DTS and SSIS of MS SQL Server 2008 R2/2012/2014/2017 respectively. Expert in Creating, Configuring and Fine-tuning ETL workflows designed in DTS and MS SQL Server Integration Services (SSIS). Experiences in various types of tasks control flow and data flow in SSIS. Good Experience in Implementing Checkpoint, Transactions in SSIS. Experienced in generating On-demand and Scheduled reports for Business Analysis or Management decisions using MS SQL Server Reporting Services 2005/2008 R2/2012 (SSRS). Strong Experience in Creating Different Reports like Drill through Dashboard Reports, Drill down Report , Matrix Reports, Sub Reports, Ad hoc Reports, Tabular Reports, and Chart Reports. Strong experience in Stored Procedure/TSQL coding, Performance tuning, and Query Optimization. Highly proficient in the use of T-SQL for developing complex Stored Procedures, Triggers, Tables, User Defined Functions, Relational Database models and Data integrity, and SQL joins. In-depth knowledge of working and implementation of WCF services and Web Services. Worked on all phases of software development life cycle including Analysis, Design, Development, Testing, Peer Code Review and Support. Having Good knowledge of Big data, Hadoop and Microsoft Windows Azure concepts and tools, technologies. Good knowledge of Cloud integration using SSIS and Dell Boomi. Drafting business proposal and architecture for various projects. Good knowledge on Private Banking, Investment Banking, Leasing and Manufacturing Process. Good knowledge on IOT and Azure Services. Good understanding of OOAD and OOP’s concepts. Versatile Solutions Architect adept at working with stakeholders to enable and enhance technical development efforts and accomplish business goals. Well-organized project and team manager with a tactical and test-oriented approach. Ready to bring 16+ years in IT and pursue a new professional challenge.

Overview

16
16
years of professional experience
1
1
Certification

Work History

Data Analytics Solutions Architect

Medical Solutions
03.2021 - Current
  • As Data Analytics Solutions Architect, designed solutions with layered architecture using configuration driven approach to support multiple requirements
  • Led a team of data engineers in designing and implementing data integration solutions across multiple source systems, significantly improving data quality and accessibility
  • Developed and optimized ETL processes using SSIS and Azure Data Factory, enhancing data analytics capabilities
  • As SA and Senior Data Engineer, designed solutions with layered architecture using configuration driven approach to support multiple requirements
  • Developed robust data pipelines using Databricks, Delta Lake, and Apache Spark, facilitating data ingestion, cleansing, transformation, and aggregation from diverse sources into the Lakehouse with high throughput and low latency
  • Led a team of data engineers and collaborated with cross-functional teams (including Data Scientists, Business Analysts, and IT Security) to align the Lakehouse project with business objectives and security requirements
  • Participating in strategic discussions, requirement workshops, business process descriptions, use case scenarios and workflow analysis
  • Provide consulting and cloud architecture on Microsoft Azure platform for high availability of services and low operational costs
  • Azure Databricks Delta Lake implementation Azure Log Analytics and reporting for smooth product support
  • Data platform design and development for ingesting data from multiple sources NoSQL design strategy and implementation for consistent query performance and scalability using Atlas MongoDB Designed Technical data flow with specs and diagrams and lead team to deliver the solutions based on specs
  • Gathering requirements from business and performing data analysis on requirement and provide the business reports
  • Designed and developed batch processing mechanism to process tons of records on daily basis where you can control the batch processing with ease
  • Engaged with business to understand their pain point and give solutions
  • Created complex Azure Data factory and Azure Databricks pipelines to integrate data from multiple sources
  • Created PySpark Notebooks to integrate and process data from Data lake
  • Worked on migration of entire ADF/ADB pipelines to Azure Data Lake GEN2 from Azure Data Lake GEN1 Plan solution architecture to create cloud-based Azure big data solution using Azure services and components
  • Build Big Data Solutions to Acquire, Prepare, Process, Predict, Visualize Data Insights using services like Azure Data Factory, Azure Storage, Azure Data Lake, Apache Spark Clusters Azure Databricks, Power BI, Microsoft BI Stack, Azure Python Provided architectural guidance on Azure Data flow and its implementation
  • Implemented security using Azure Key vault
  • Also worked on and supported Azure Devops (CI/CD pipelines) for continuous integration and deployments
  • Agile/Scrum methodology used in the project, performed pivotal role in planning and developing and aligning with sprints
  • Migration strategy from SQL (Relational) to NoSQL Used Python to build databricks notebooks to refine data
  • Used Python to notebooks to build migration logic from SQL to MongoDB (NoSQL) Developed and operationalize ML solutions.

Principal Software Engineer

GEP
09.2019 - 03.2021
  • As Principal Software Engineer, designed solutions with layered architecture using configuration driven approach to support multiple requirements
  • Participating in strategic discussions, requirement workshops, business process descriptions, use case scenarios and workflow analysis
  • Provide consulting and cloud architecture on Microsoft Azure platform for high availability of services and low operational costs
  • Azure Databricks Delta Lake implementation Azure Log Analytics and reporting for smooth product support Data platform design and development for ingesting data from multiple sources NoSQL design strategy and implementation for consistent query performance and scalability using Atlas MongoDB Designed Technical data flow with specs and diagrams and lead team to deliver the solutions based on specs
  • Gathering requirements from business and performing data analysis on requirement and provide the business reports
  • Designed and developed batch processing mechanism to process tons of records on daily basis where you can control the batch processing with ease
  • Engaged with business to understand their pain point and give solutions
  • Created complex Azure Data factory and Azure Databricks pipelines to integrate data from multiple sources
  • Created PySpark Notebooks to integrate and process data from Datalake
  • Worked on migration of entire ADF/ADB pipelines to Azure Data Lake GEN2 from Azure Data Lake GEN1 Plan solution architecture to create cloud based Azure big data solution using Azure services and components
  • Build Big Data Solutions to Acquire, Prepare, Process, Predict, Visualize Data Insights using services like Azure Data Factory, Azure Storage, Azure Data Lake, Apache Spark Clusters, Azure Databricks, Power BI, Microsoft BI Stack, Azure Python Provided architectural guidance on Azure Data flow and it’s implementation Implemented security using Azure Key vault Also worked on and supported Azure Devops (CI/CD pipelines) for continuous integration and deployments
  • Agile/Scrum methodology used in the project, performed pivotal role in planning and developing and aligning with sprints
  • Migration strategy from SQL (Relational) to NoSQL Used Python to build databricks notebooks to refine data Used Python to notebooks to build migration logic from SQL to MongoDB(NoSQL)

Tech Lead

Wipro Ltd.
07.2012 - 09.2019
  • As a Tech Lead, designed solutions with layered architecture using configuration driven approach to support multiple requirements
  • Plan solution architecture to create cloud-based Azure big data solution using Azure services and components
  • Participating in strategic discussions, requirement workshops, business process descriptions, use case scenarios and workflow analysis
  • Build Big Data Solutions to Acquire, Prepare, Process, Predict, Visualize Data Insights using services like Azure Data Factory, Azure Storage, Azure Data Lake, Apache Spark Clusters, Azure Databricks, Power BI, Microsoft BI Stack, Azure python Provide consulting and cloud architecture on Microsoft Azure platform for high availability of services and low operational costs
  • Designed Technical data flow with specs and diagrams and lead team to deliver the solutions based on specs
  • Gathering requirements from business and performing data analysis on requirement and provide the business reports
  • Designed and developed batch processing mechanism to process tons of records on daily basis where you can control the batch processing with ease
  • Engaged with business to understand their pain point and give solutions
  • Created complex ADF pipelines to integrate data from multiple sources
  • Created complex dashboard and reports using Power BI for directors and Executives
  • Agile/Scrum methodology used in the project, performed pivotal role in planning and developing and aligning with sprints
  • Interact with different stake holders like Business Analysts, Supply Chain Managers, Store Managers to create plan to meet their business requirements
  • Conduct Technical Reviews and Code Reviews to adhere to the development guidelines as per the industry standards at all stages of software development process such as requirements gathering, designing architecture, development, testing and deployment Plan solution architecture to create cloud-based Azure big data solution using Azure services and components
  • Build Big Data Solutions to Acquire, Prepare, Process, Predict, Visualize Data Insights using services like Azure Data Factory, Azure Storage, Azure Data Lake, Apache Spark Clusters, Azure Databricks, Power BI, Microsoft BI Stack, Azure Machine Learning using Python Functions as a technical lead in Cloud computing space using Azure and act as a Primary coordination point for all projects in Devices Supply Chain Management Data Sciences Team
  • Evaluate option of using solutions on PAAS vs IAAS vs SAAS models
  • Plan and Implement solutions using Azure services, Components and Microsoft Tools
  • Implement solution on BI/DW environment on Azure/On Premise using the Azure Analysis Service, Azure SQL Data warehousing, SQL Server and MSBI Stack
  • Design ETL/ ELT pipelines using Azure Data Factory with Data Lake/Azure Storage for Data Storage, Azure Data Analytics / Apache Spark for Data Processing, Azure Machine Learning for Predictive Analytic’s.

Senior Software Engineer

SOCIETE GENERALE (SOCGEN), France
02.2008 - 07.2012
  • Involved in Requirement gathering and Business design
  • Requirement review and preparing design document, Technical Specification, Unit Test Cases
  • Worked with cross-functional teams to define the scope of project and to define the customer requirements
  • Deploying the Cubes, Dimensions and Partitions in DEV, UAT and Production/Live servers
  • Creating Tables, Views/Index Views with relationships in the MS SQL Server
  • Integration of data using SSIS
  • Configure the ETL packages, Cubes in Jobs and Scheduling the Jobs Using SQL Server
  • Coding / Implementation (developing various GUI and Backend Coding) Component testing and peer code review
  • Involved in Performance Tuning and Demoralization Engine Development for the application
  • Worked on Regression testing strategy for the application.

Education

Master of Science - Computer Science

University of Calcutta
Calcutta, India
07-2007

Skills

  • Data Modeling
  • Cost Estimation
  • Improving processes
  • Leading meetings
  • Customer Relations
  • Technical architecture
  • Software Development Lifecycle
  • Requirements Gathering
  • Selecting products
  • Performance Optimization
  • Solution Optimization
  • Stakeholder Management
  • Customer Satisfaction
  • Strategy implementation
  • Coaching and Mentoring
  • Vendor Negotiations
  • Vendor Partnerships
  • Program Leadership

Certification

  • Academy Accreditation - Generative AI Fundamentals Databricks
  • SP800-Az: Getting Started with Apache Spark DataFrames (Azure Databricks)

Timeline

Data Analytics Solutions Architect

Medical Solutions
03.2021 - Current

Principal Software Engineer

GEP
09.2019 - 03.2021

Tech Lead

Wipro Ltd.
07.2012 - 09.2019

Senior Software Engineer

SOCIETE GENERALE (SOCGEN), France
02.2008 - 07.2012

Master of Science - Computer Science

University of Calcutta
Rajesh Yadav