Software Developer with five years of experience designing and implementing scalable, cloud-native data pipelines and ETL workflows. Built real-time and batch data ingestion systems using MySQL, Apache Kafka, and AWS Glue with Py Spark, reducing data latency and improving pipeline performance. Orchestrated complex workflows using Apache Airflow, integrating Amazon S3, Py Spark, and Pandas to automate data processing and reduce manual effort. Optimized SQL queries and performed schema migrations to enhance database efficiency and support analytics. Developed Python scripts to analyze application and pipeline log files for error detection and anomaly identification. Created monitoring dashboards using Splunk and Mosaic to maintain data quality and provide operational transparency. Experienced in containerizing applications with Docker, managing Kubernetes clusters, and automating CI/CD pipelines with Jenkins to ensure reliable and maintainable data infrastructure.
AWS Glue, Apache Kafka, Apache Airflow, Amazon S3, Python, Pandas,Py Spark, Java, SQL, MySQL, SQL Server Management Studio (SSMS), Redis, Docker, Kubernetes, Jenkins, Git, Selenium, Splunk,Mosaic, SSRS, Postman, Spring Boot ,ETL Development, Data Warehousing, CI/CD Pipelines, REST API Development,Cloud Computing, Big Data Processing, Data Modeling
undefinedAWS Database Specialist
AWS Database Specialist
AWS Certified Developer Associate AWS