Experienced Data Engineer/Data Analyst with 4+ years specializing in cloud-based platforms like Azure and AWS. Expertise in designing and implementing ETL pipelines with Azure Data Factory, Databricks, and AWS Glue. Proficient in PySpark, Spark SQL, and Hive for data processing. Skilled in data modeling, schema design, and integrating diverse data sources. Strong background in Big Data technologies including Hadoop, Kafka, and Snowflake. Hands-on experience in query optimization and ensuring data quality. Proficient in developing Power BI reports, automating CI/CD pipelines, and collaborating in Agile environments.
Environment: Azure, Azure Data Factory, Snowflake, performance tuning, ADLS gen2, dataflow jobs, copy activity, lookup activity, Data Flow, linked services, Stream Sets, Databricks, Snow pipe, Confluent Kafka, Scala, SQL PySpark, Python, Azure Key Vaults, JIRA, GitHub.
Environment: ERWIN, ETL, SQL, Power BI, SSIS, SSRS, Python, OLAP, OLTP, T-SQL, Oracle.
Environment: ETL,MySQL, SSIS, SSRS, SQL, EXCEL, TABLEAU.
Financial Data Analysis and Modeling
Technical Tools:Microsoft Excel, Python, Statistical Analysis (SAS), SQL
Interactive Dashboard Development for Education Trends,
Technical Tools:Power BI, SQL, Data Visualization, DAX Calculations