Big Data Platform Engineer (Kafka & Druid)
SYMANTRIX INC
02.2020 - Current
- Worked as a Kafka & Druid Engineer to install, configure and maintain different Tier level clusters as per Application requirement
- Build and Support Dev, QA and Production Apache Druid Open Source cluster
- Maintained a huge number (40+) of small, medium to large scale critical Hortonworks Kafka & Open Source clusters hosting its eco system services in Production
- Broker and Zookeeper configuration setup as per issues reported
- Creating Operational Acceptance Criteria (OAC) document based on the production release and follow that guideline across all production clusters
- Debugging and fixing critical production issues (ISR Shrinks, under replicated and unavailable partitions etc.) in real time
- Working on monitoring and implementing alert mechanisms for both Druid and Kafka clusters through Grafana
- Planning and performing infrastructure activities including cluster upgrade, node re-allocations, Qualys scanning, TSR exception handling etc
- Working with all the team members closely to guide them on day-to-day activities and critical production issues
- Worked on Incident & Change Management for Production Issues and Implementation
- Working with the team members closely to guide and work on day-to-day activities and production issues.
- Contributed to internal activities for overall process improvements, efficiencies and innovation
- Prepared written summaries to accompany results and maintain documentation.
