Arun Kumar Ramadevan
Bonney Lake
Summary
Experienced Lead Data Engineer with over 18 years of expertise in designing, developing, and optimizing complex data pipelines and ETL processes. Proven ability to lead cross-functional teams, drive data-centric projects, and architect robust, scalable data solutions. Skilled in collaborating with stakeholders to understand business requirements, translating them into technical solutions, and ensuring high-quality data product delivery. Seeking a lead role to drive innovation, mentor team members, and shape strategic data engineering initiatives for maximum business impact.
Overview
19
19
years of professional experience
Work History
Data Engineer II
Amazon LLC
06.2020 - Current
- Scalable Data Solution: Architected a scalable data pipeline and reporting solution using AWS Redshift, State Machines, and Glue catalog. Achieved a 33% reduction in data processing time, enhancing data availability for critical business decisions
- Cost-Efficient Data Innovation: Designed and created optimized data pipelines for historical reporting, resulting in an annual cost reduction of $840,000 while maintaining infrastructure integrity
- Automation for Efficiency: Led & Engineered an automated process for including and updating business rules, saving 60-100 developer hours per month and realizing substantial annual cost savings of1200-1500 developer hours
- Seamless Reporting Transition: Migrated over100 MicroStrategy reports to Tableau Cloud, streamlining reporting processes and enhancing data visualization capabilities
- Team Leadership and Strategic Delivery: Led a proficient data engineering team, delivering high-quality insights across various metrics
- Managed team dynamics, set strategic objectives, and ensured successful project execution
- Cross-Functional Collaboration: Championed collaboration across teams, playing a pivotal role in requirements gathering, data model design, developing data pipelines to feed ML and AI Models
- Mentorship for Growth: Nurtured the professional development of junior data engineers through mentorship and guidance, conducting comprehensive code reviews and sharing insights on best practices
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- .Fine-tuned query performance and optimized database structures for faster, more accurate data retrieval and reporting.
Senior Software Engineer (Data Warehouse/Reporting)
Expedia Group
06.2015 - 05.2020
- Pipeline Optimization for Efficiency: Revamped and optimized existing data pipelines, generating annual savings surpassing $300K in developer hours
- Efficient Automation for Support Hours Reduction: Automated data publishing workflows to reporting servers, significantly reducing weekly support hours by40
- Enhanced Reporting SLA: Implemented performance optimization techniques in data-mart transformations, resulting in a28% improvement in report refresh SLA
- GDPR Compliance and Data Security: Spearheaded the process implementation for identifying Personally Identifiable Information (PII) within the Data Warehouse, enforcing GDPR guidelines
- Cloud Migration: Orchestrated the seamless migration of the Data Warehouse from MSSQL Server to AWS Cloud, enhancing scalability, performance, and reducing maintenance complexity
- Self-Service Reporting Transition: Migrated and crafted over70 self-service reports using QlikSense and Tableau, transitioning from SSRS platform and empowering users with advanced data exploration capabilities
- Standardization for Excellence: Established comprehensive best practice standards and guidelines across design, development, support, and analytics domains
Sr SDE (DW Lead with Microsoft)
Ramp Technology Group LLC
09.2013 - 05.2015
- Strategic Data-Mart Enhancements: Developed and implemented critical changes within the data-mart, optimizing performance and relevance for Microsoft Sales operations
- Legacy System Overhaul for Efficiency: Revitalized a legacy file consumption system, enhancing its efficiency and robustness to meet modern requirements
- Efficient Regression Testing Automation: Automated over200 regression test cases using Microsoft Test Manager, ensuring streamlined and efficient testing processes
- UI-Driven Self Services Tool Development: Contributed to the development of a UI-based Self Services Acquisition ETL tool, facilitating intuitive and efficient data acquisition
- Team Performance Enhancement and Mentorship: Conducted performance evaluations and provided career mentoring for team members, fostering growth and proficiency
- Global Team Leadership and Collaboration: Led a global team of4-6 engineers, ensuring seamless collaboration and successful project delivery across various time zones
Technology Lead (Data Warehouse/Reporting)
Infosys Limited
07.2006 - 08.2013
- Dev Team Contributor and Tool Development: Contributed to the development of an SSIS-based ETL tool named METaL, playing a vital role within the core development team
- ETL Pipeline Design and Data Warehouse Creation: Led the design and development of ETL pipelines, steering the creation of a data warehouse for the Enterprise Services Scorecarding system
- Performance Reporting and SSRS Expertise: Crafted SSRS reports to communicate performance and customer satisfaction metrics, providing valuable insights for decision-making
- Team Leadership for Deliverables: Led a team of3 developers, ensuring timely delivery of customer-centric solutions and achieving project objectives
Education
Bachelor's Degree - Mechanical Engineering
Anna University
01.2006
Skills
- Scripting Languages: C#, Python, Scala, Typescript
- Databases: MSSQL, PYSQ
- Cloud Services: AWS S3, EMR, EC2, Redshift, Aurora, Athena, Dynamodb, Glue, Lambda, StepFunctions, SNS, SQS, Cloudwatch
- Data Visualization: Tableau, Qlikview, Qliksense, QuickSight
- Testing and Project Management Tools: TestLink, TestRail, JIRA
- Version Control: Git, Perforce, VSTF
- Data modeling
- Data pipeline design
- Data warehousing
- ETL development
- Big data processing
- Performance tuning
- Real-time analytics
- Data quality assurance
- Data pipeline control
- Business intelligence
Timeline
Data Engineer II
Amazon LLC
06.2020 - Current
Senior Software Engineer (Data Warehouse/Reporting)
Expedia Group
06.2015 - 05.2020
Sr SDE (DW Lead with Microsoft)
Ramp Technology Group LLC
09.2013 - 05.2015
Technology Lead (Data Warehouse/Reporting)
Infosys Limited
07.2006 - 08.2013
Bachelor's Degree - Mechanical Engineering
Anna University
Similar Profiles
Angel CazarezAngel Cazarez
Warehouse Forklift Operator/ Coordinator at Amazon LLCWarehouse Forklift Operator/ Coordinator at Amazon LLC
Staci BridgesStaci Bridges
Administrative Assistant/Team Leader at Amazon LLCAdministrative Assistant/Team Leader at Amazon LLC
Adelaine MunsonAdelaine Munson
DSP Driver at Amazon LLCDSP Driver at Amazon LLC