JAYASANKAR K
Irving,TX
Summary
As an accomplished Azure Data Engineer with 7+ years experience in the field, I possess a proven track record of designing, implementing, and optimizing data solutions on the Microsoft Azure platform. My skill set includes creation of scalable pipelines, adeptly managing data lakes, and conducting insightful analysis on extensive datasets. Backed by a history of successful project deliveries, I bring strong problem-solving abilities to the table.
Overview
7
7
years of professional experience
1
1
Certification
Work History
Azure Data Engineer
cloudsol Technologies
07.2022 - Current
- Refined Databricks notebooks, employing advanced techniques such as cluster configuration tuning, repartitioning, and caching to significantly boost performance
- Employed Databricks SQL and Spark APIs to execute efficient manipulation and processing of extensive datasets
- Formulated and executed the design of database elements.
- Elevated and fine-tuned multiple SQL stored procedures to rectify performance bottlenecks, showcasing a prowess for optimization.
- Conceived and implemented database tables, views, indexes, and diverse stored procedures, seamlessly integrating them with Azure Data Factory.
- Established automated monitoring and alerting systems for Databricks jobs, fortifying proactive issue detection and resolution capabilities.
- Optimized Azure Data Factory pipelines through parallel processing and delta reads, harnessing Azure SQL Database for warehousing with meticulously crafted data models and schema.
Data Engineer
VA Solutions
07.2017 - 12.2019
- Ensured the seamless integration of Azure Key Vault services with Azure Databricks and Azure Data Factory, thereby contributing to a secure and efficient key storage environment
- Orchestrated the setup of necessary libraries, configurations, and integrations for smooth development and collaboration within Databricks
- Fine-tuned ADF pipelines for optimized parallel processing and facilitated delta reads from varied sources
- Attained excellence in Spark operations within Databricks notebooks, adhering to best practices for join types, memory settings, and caching.
- Played a key role in the end-to-end design, implementation, and maintenance of ETL pipelines across Azure Data Factory, Databricks, and Azure Logic Apps
- Identified and resolved performance bottlenecks in existing Databricks jobs, showcasing proficiency in strategic troubleshooting and optimization of data processing workflows.
Education
Master of Science - Business Analytics
Texas A&M University
Commerce, TX12.2021
Skills
- Azure Data Factory
- Azure Databricks
- Azure Synapse Analytics
- Azure Datalake Storages
- Azure Key Vault Services
- Azure SQL DB
- Python
- PySpark
- Git
- MS SQL Server
- Azure DevOps
Certification
Azure Data Engineer Associate - DP-203
Timeline
Azure Data Engineer
cloudsol Technologies
07.2022 - Current
Data Engineer
VA Solutions
07.2017 - 12.2019
Master of Science - Business Analytics
Texas A&M University
Similar Profiles
Prashanth Reddy NPrashanth Reddy N
Senior DevOps/Cloud Engineer at CloudSol TechnologiesSenior DevOps/Cloud Engineer at CloudSol Technologies
Zain TahirZain Tahir
Account Officer at CloudSolAccount Officer at CloudSol
Venkata Nagaraju InakolluVenkata Nagaraju Inakollu
Technical Lead(System Design) at Relysys Technologies Pvt Ltd (now Invendis Technologies pvt ltd)Technical Lead(System Design) at Relysys Technologies Pvt Ltd (now Invendis Technologies pvt ltd)