Infrastructure Development
- Led successful design and implementation of highly secure MFT/SFTP server on Google Compute Engine, reducing data transfer time by 50% and enhancing file sharing capabilities for team of 100+ users.
- Result: Reduced file transfer latency by 20% and improved security compliance, enabling replacement of outdated third-party service, saving estimated $25000 in annual licensing costs.
Pipeline Migration and Automation
- Streamlined and executed end-to-end transition of product pipeline from Bash Script to Google Composer, resulting in 30% increase in data processing efficiency and significant reduction in operational costs.
- Result: Achieved 25% increase in efficiency for product team by automating B2B product deliveries, saving estimated 20 hours of manual work per week.
Airflow DAG Optimization
- Developed Airflow DAG generator with Jinja Templating, streamlining workflow orchestration.
- Result: Reducing errors in DAG creation and maintenance.
- Reduced deployment time by 50%, resulting in faster project delivery.