Data Engineer with 12+ years of professional experience in Java/J2EE, Python with expertise in Azure Data Lake, Big Data, Big Data Security and DevOps.
Extensive programming experience in Hadoop ecosystems of technologies including MapReduce, HDFS, Hive, YARN, Sqoop, Pig and PySpark.
Expertise in implementing server-side solutions managing scalability and concurrency, ingesting Big Data using batch processing and real time jobs, and deploying and administrating servers.
Experience in building Big Data pipelines using Apache Airflow. Experience with DevSecOps and working with CI/CD pipelines and source control branching strategies.
Proficient in building sophisticated distributed systems using REST and SOA.
Experience in working with and managing distributed teams in different time zones.
Deeply passionate about solving challenging technical problems.