Deepak Malik

Hybrid Azure DNS Serving plane platform

Building from scratch a hybrid DNS serving plane orthogonal to existing DNS serving plane to ensure 100% availability of a critical service like DNS.

Designed and implemented several components of the hybrid serving plane capable of syncing data (which currently spans across 10 million DNS zones and increasing) within 15 seconds for 99.9% SLA.

• Implemented highly available data sync pipeline from Azure Cosmos Db (DNS database) to Kafka to ensure guaranteed in order changes for each zone for the DNS servers.
• Implemented sync component for DNS servers to read from the data sync pipeline and commit to local data store.
• Designed data schema for efficiently storing the data within the DNS server (using LmDB as local data store).
• Benchmarked 2Million queries per second capacity per DNS server and 100Million queries per second global capacity.
• Added monitoring for several crucial metrics to observe the age of data, availability of the service, latency metrics, route advertisement etc.
• Drove several BCDR (Business Continuity and Disaster Recovery) drills to verify phased rollouts and validation of the new serving plane in each region.

Migration of the first party DNS service to the Azure DNS service

Deprecate the old DNS platform (first-party) and migrate the data to the Azure DNS platform (first and third party). Since this was the first ever DNS platform in Azure, it consisted of most critical zones from the teams all across Azure.

Led the migration of the DNS zones to Azure DNS with zero downtime and without any violation of the promised SLA. In effect, migrated over 50k DNS zones which was responsible for over 20 million DNS records and a global DNS traffic of over 500k queries per second.

• Implemented new Azure DNS API over the existing system so that customers can use the new API while switching them from existing DNS system to Azure DNS in the background.
• Collaborated with over 150 partners across Azure, helping them migrate to the new API, point of contact for any queries or concerns they might have with the process, helping them debug any issues they might see during the migration.
• Wrote the migration engine that marks zone for migration and then migrates all the data from existing system to Azure DNS system, performs serving plane switch to the new system once verified all data is copied and then switches the control plane to the new system.

Connected Services in Visual Studio

Connected service platform within Visual studio empowers developers to easily add connections to Azure services during app-development.

Implemented the Azure Mobile connected service which auto added the required project dependencies and template code to connect to Azure Storage accounts. This was a customer ask from developers working on Cordova, Xamarin and Universal windows apps.