Harsha Vardhan
Eden Prairie,MN
Summary
Dynamic Azure Data Engineer with over 2 years of experience in designing and implementing robust data solutions on Microsoft Azure. Demonstrated expertise in architecting end-to-end data pipelines using Azure Data Factory, Azure Databricks, Azure Blob Storage, and Azure SQL Database. Skilled in leveraging cloud-based technologies to ingest, transform, and load data from various sources, enabling efficient data processing and analysis. Strong background in SQL, Python, and Spark, with a proven track record of delivering high-quality solutions to meet complex business requirements. Experienced in collaborating with cross-functional teams, providing technical guidance, and driving successful project outcomes. Passionate about leveraging emerging technologies to optimize data workflows, enhance data-driven decision-making, and drive business growth.
Overview
2
2
years of professional experience
1
1
Certification
Work History
Azure Data Engineer
Transol Systems
07.2020 - 08.2022
- Designed and implemented scalable architectures using Azure Data Factory, Data Lake, and Databricks to address business challenges, resulting in improved data processing efficiency by 30%
- Developed MuleSoft APIs to connect to Azure Data Lake Storage for data transfer, ensuring compliance with governance standards and achieving seamless data integration across systems.
- Created JSON scripts for deploying pipelines in Azure Data Factory, incorporating SQL activities for data processing and transformation, automating data workflows, and reducing manual errors.
- Integrated Axon into data pipelines using APIs for metadata management and data lineage documentation, ensuring data quality and regulatory compliance.
- Developed Spark applications in Python and Spark-SQL for data extraction, transformation, and aggregation from multiple sources, enabling real-time data analysis and insights generation.
- Implemented Hive bucketing and partitioning for efficient data storage and querying, optimizing performance and reducing query execution time by 40%.
- Utilized Azure Data Catalog for data organization and maximizing value from existing investments, improving data discoverability and accessibility for stakeholders.
- Analyzed SQL scripts and optimized performance using PySpark SQL transformations, improving query execution speed by 50% and enhancing overall system performance.
Education
Master of Science - Information Technology Management
Concordia University, St. Paul
Saint Paul, MN12.2023
Bachelor of Science - Electronics Communications And Engineering
Kalasalingam Academy Of Research And Education
Krishnankoil,Tamil Nādu05.2020
Skills
- Azure Data Factory
- Azure Databricks
- Python
- Data Pipeline Design
- SQL
- PYSPARK
- AWS
- Azure SQL Database
HOBBIES
Anchoring On Stage.
Dance.
Cooking.
Watching Movies.
Languages
English
Full Professional
Telugu
Full Professional
Tamil
Full Professional
Certification
Completed Several Internal Trainings and Certifications on Azure.
Completed Multiple Online Training Programs From Udemy on SQL and Python.
Timeline
Azure Data Engineer
Transol Systems
07.2020 - 08.2022
Master of Science - Information Technology Management
Concordia University, St. Paul
Bachelor of Science - Electronics Communications And Engineering
Kalasalingam Academy Of Research And Education
Similar Profiles
RAM NAMALARAM NAMALA
Front End Developer at TRANSOL SYSTEMS Pvt .LtdFront End Developer at TRANSOL SYSTEMS Pvt .Ltd
Shiva Prasad Reddy GadeShiva Prasad Reddy Gade
SAP Security Consultant at Payroll Company - Transol Systems Pvt LimitedSAP Security Consultant at Payroll Company - Transol Systems Pvt Limited
Balasaheb BandeBalasaheb Bande
Manual and Automation Test Engineer at TRANSOL SYSTEMS PVT.LTDManual and Automation Test Engineer at TRANSOL SYSTEMS PVT.LTD