Michael Kirby

Technical lead for a migration off on-prem database running on VMware to Aurora MySQL.

• Worked with management and engineers across dozens of teams to coordinate, schedule and execute each migration
• Used Terraform to provision ~50 Aurora Clusters
• Used AWS Database Migration Service to migrate approximately 35 TB of data across ~50 MySQL shards
• Created custom python tool for facilitating failover from on-prem databases to Aurora clusters

Co-lead initiative to transition our container orchestration from ECS to EKS in order to offer:

• Helped standardize various EKS environments using Terraform to stamp out EKS clusters containing least-privileged RBAC control, standard plugins and tooling for logging, monitoring, storage, secrets and autoscaling
• Used Helm templates to standardize deploying services across various teams
• Worked with other engineers to troubleshoot and advise on best practices

Co-lead a migration from legacy Databricks workspaces (Single Tenant) to the new E2 workspaces

• Used Terraform to helped standardize Databricks E2 workspaces implementations
• Worked with data engineering teams by advising on Terraform usage and cross account IAM and S3 data access during migration

Mentored and advised junior and mid-level platform engineers through the use of office-hours and ad hoc working sessions

• Responsible for managing all day-to-day MySQL database operations and delivering maximum up-time and performance
• Implemented data warehousing solution using Apache Airflow, Python and MySQL that enabled new reporting and data reconciliation capabilities. One of these capabilities was a data reconciliation processes between two systems of record - NetSuite ERP and OLTP e-commerce databases, which eliminated weekly manual tasks required by engineers and data analysts.
• As an online retailer, collaborated with management and other engineers to tune the checkout process to maximize speed and minimize overselling during Black Friday and Cyber Monday weeks.
• Collaborated with developers on optimizing application queries, resulting in improved user experience and system responsiveness.

• Managed all aspects of a multi-terabyte database environment, performing server and query performance tuning, space management, upgrades, data purging, replication and change management
• Migrated ~50 TB of data across 18 server and 24 databases from physical hardware to virtualized environment in 30 days
• ETL development using Pentaho to support internal MySQL data warehouse initiative

• Researched, tested and implemented MySQL Cluster and Clustrix to support throughput needed for new web-based online backup application
• Implemented reporting data warehouse using MySQL, Perl and stored procedures to de-normalize and aggregate data for an internal reporting application
• Implemented data archiving, data loading and data purging processes utilizing scripting and stored procedures
• Completed various performance and load tests against very large databases in order to evaluate schema design and indexes
• Query and schema optimizations were made based on the results