Experienced Data Engineer with over 4 years in designing and optimizing data pipelines and architectures. Proficient in Python, SQL, and modern data engineering tools, with a focus on cloud platforms. Specializes in developing scalable ETL/ELT workflows, data lakes, and real-time streaming solutions to enhance data processing efficiency and support data-driven decisions.
Environment:
Python, SQL, AWS Glue, Amazon Redshift, Snowflake, SQL Server, Apache Spark, Hadoop, AWS EMR, AWS Lambda, AWS Kinesis, Amazon S3, Jenkins, AWS Code Pipeline, AWS Code Build, AWS CloudWatch, AWS CloudTrail, Tableau, and Power BI.
Environment:
Python, SQL, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), Azure Synapse Analytics, Snowflake, SQL Server, Oracle, Azure Databricks, Apache Spark, Delta Lake, Azure DevOps, GitHub Actions, Power BI, Azure Event Hubs, and Azure Monitor.
Python, SQL, Apache Airflow, Apache Spark, Hadoop, Apache Kafka, Apache Flink, Spark Streaming, SQL Server, Oracle, MySQL, Tableau, Power BI, Looker, Jenkins, GitHub Actions, Terraform, Ansible, Prometheus, Grafana, ELK Stack.