Megha Harplani

Genie and Orion

Project Description: The objective of this project is to collect input preferences provided by the Guests using Experience app, process them by Machine learning model to provide the recommendations as the outcome. Real time inputs are being captured by Kinesis Firehose and delivered to S3 buckets as a source raw data, which is then being processed and loaded into snowflake tables and layers.

Responsibilities:

• Implemented Full Load and CDC DMS tasks, troubleshooting failures and performance tuning by examining AWS CloudWatch logs.
• Supervised end-to-end data loading process from DMS tasks, including data delivery to S3 buckets, integration through external stages and further processing via Snowpipes, Streams, Snowtasks and Stored procedures.
• Designed and implemented real-time data ingestion pipelines for capturing guest preferences at Walt Disney parks using Amazon Kinesis Data Firehose.
• Leveraged AWS Lambda for serverless data transformations.

Hotel Revenue Optimization System

Project Description: Hotel Revenue Optimization System is a vendor app installed by Disney whose objective is to maximize the revenue from a fixed, perishable assets.

Responsibilities:

• AUTOMATION : Developed and implemented a Shell script-based monitoring system to track the batch status, enabling instant failure detection and automated incident creation with detailed error logs.
• Reduced escalation incidents from downstreams team by 70% by enabling immediate recovery actions, ensuring SLAs are consistently met.
• Included detailed error logs in the automated incident notifications, eliminating the need for manual log reviews and significantly reducing resolution time.
• Optimizing Stored Procedures for Reporting Database that contains daily snapshots of key HROS data sets.
• Writing optimized queries for analytics.

Rx Offload

Project Description : The project involved migration of the existing EDW system built on top of teradata and Abinitio to Hadoop Data Lake. There were 4 main modules of the project - Data ingestion, Noise reduction, Data Compaction and Extracts.

Responsibilities :

• Writing optimized queries for analytics.
• Development of Hadoop programs in Hive.
• Ingestion of delta files from other servers to HDFS and perform compaction to the hive tables.
• Used sequence file formats and snappy compression while storing data in HDFS.
• Developing generic script for re-usability.