Over 11+ years of experience in the IT industry, specializing in leveraging Azure tools and services, including Azure ADLS GEN2, Azure Blob Storage, Azure Synapse Analytics, Azure Data Factory, Azure Functions, Azure Stream Analytics, Azure Logic Apps and Azure Cosmos DB. Utilized Azure ADLS GEN2 for creating datalake, and triggered Azure Functions upon file changes. Effectively managed the Azure Data Lake Storage, overseeing metadata management for efficient organization of tables, partitions, and databases. Led the migration of on-premises data to Azure Synapse Analytics, optimizing data storage and streamlining analytics processes, resulting in a 20% reduction in query response times. Implemented real-time analytics solutions on Azure Databricks, providing stakeholders with timely insights and improving decision-making processes by 20%. Successfully implemented a real-time data processing solution using Azure Stream Analytics, creating producers and consumers for data publication and processing within Azure Event Hubs. Designed and implemented a scalable delta lake architecture using Azure Databricks. Enhanced query performance by optimizing SnowSQL scripts in Snowflake, resulting in a 30% reduction in query execution time and improved data accessibility. Implemented Snowpipes in Snowflake for real-time data ingestion, reducing data latency by 50% and streamlining the staging process for faster analytics. Transformed data modeling with DBT, optimizing data pipelines and increasing analytics accuracy, resulting in streamlined insights and informed decision-making. Led Snowpark integration in Snowflake for complex data transformations, enhancing ETL efficiency and enabling advanced analytics within Snowflake's virtual data warehouse. Achieved a secure Azure Virtual Machine environment by configuring Network Security Groups, implementing Azure Active Directory roles, and regularly updating and patching instances. Implemented advanced access controls in Azure Active Directory, defining policies with conditions based on IP address, time, and Virtual Network, enhancing security and compliance measures. Employed Azure Monitor to collect, store, and analyze Azure services and application logs efficiently. Attained low-latency performance by leveraging Azure Cosmos DB's indexing and partitioning for data retrieval. Enhanced flexibility, expertly selecting and managing diverse database engines on Azure SQL Database; MySQL, PostgreSQL, Oracle, SQL Server, for optimal performance. Proficient in developing and optimizing large-scale Spark applications with PySpark, utilizing RDDs, DataFrames, and Spark SQL for efficient analytics and processing. Experienced in architecting data pipelines with Azure Event Hubs, managing partitions and topics, seamlessly integrating with Azure Stream Analytics for continuous analysis of streaming data. Optimized T-SQL query efficiency by implementing data partitioning and indexing, significantly reducing data scanning and enhancing overall query performance. Utilized Azure SQL Database for operational needs, crafting complex SQL queries with Joins, Window functions, and indexing to optimize performance. Experienced in No-SQL databases like Azure Cosmos DB and Cassandra, proficient in schema design, data modeling, and query optimization, enabling scalable and high-performance storage and retrieval of unstructured data. Successfully automated workflows with Azure Logic Apps, ensuring security, scalability, and task orchestration. Implemented Snowflake for data warehousing, enhancing SQL-based analytics capabilities, and improving data accessibility for cross-functional teams, boosting overall data-driven decision-making efficiency. Successfully implemented Power BI solutions, collaborating with Data Analysts to create visualizations. Developed and implemented optimized data processing pipelines on Azure Databricks, resulting in a 30% reduction in processing time and improved overall system efficiency. Skilled in Azure DevOps version control, adept at branching, merging, and conflict resolution, ensuring code integrity. Proficient in Azure DevOps CI/CD pipelines, automating software build, test, and deployment for continuous integration and delivery. Streamlined project workflows using Git, BitBucket, JIRA, Confluence, and Notion, fostering transparent collaboration and accelerating project delivery. Expert in Agile, leading cross-functional teams through sprint planning, stand-ups, and retrospectives for software delivery.