Experienced Data Engineer with over 5 years in designing, building, and developing Python-based applications. Proficient in Python, Azure SQL, and Angular with hands-on experience in full-stack development, system integration, and automation. Adept at troubleshooting, performance tuning, and delivering high-quality solutions in Agile environments.
• Developed and optimized Spark applications using Scala and Python for large-scale data processing.
• Secured network communication on the cluster using Kerberos authentication.
• Integrated and automated data systems using Python, enhancing data flow and processing efficiency.
• Led troubleshooting and performance tuning efforts for Python applications and SQL queries in Azure SQL.
• Worked with Azure services including Key Vault for secure data handling.
Programming: Python, C, Java, JavaScript, HTML, CSS, SQL
Frameworks: Angular, Django, Flask
Data Management: Azure SQL, Hadoop, Spark, Pandas, NumPy, Scikit-learn
Cloud Platforms: Azure, AWS, GCP
Tools: Tableau, Power BI, Git, Jenkins, PySpark, Kafka, Hive
Operating Systems: Windows, Linux
Methodologies: Agile, SDLC