Summary
Overview
Work History
Education
Skills
Websites
Publications
Presentations
Timeline
Generic

KARTHICK SUNDARAM

Seattle,WA

Summary

Dynamic Senior Engineering Manager with a proven track record at Microsoft, driving $300M in efficiency gains through innovative AI solutions and scalable data pipelines. Expert in Azure technologies and data orchestration, complemented by visionary leadership and strong analytical skills. Passionate about mentoring teams and delivering impactful results in fast-paced environments.

Overview

15
15
years of professional experience

Work History

Senior Engineering Manager

Microsoft Corporation
Redmond, USA
09.2020 - Current
  • Led a 15-member engineering team within Microsoft Devices to architect and build intelligent data platforms and AI agents driving forecasting, and fulfillment analytics across Xbox, Surface, and accessories.
  • Spearheaded the development of AI copilots and agents using Azure AI Foundry, Cognitive Search, Lang Chain, Auto Gen and LLMs to enhance customer support, automate code diagnostics, and streamline business operations delivering $300M in efficiency gains in the last fiscal year.
  • Designed and implemented scalable, metadata-driven ETL pipelines using Azure Data Factory V2, ingesting data from wide variety of data sources.
  • Architected end-to-end big data processing platforms with Azure Databricks and Spark, publishing to Azure SQL and reporting via Power BI.
  • Developed project plans aligning with company goals and timelines.
  • Mentored junior engineers to enhance technical skills and knowledge.
  • Collaborated with product managers on feature development and prioritization.
  • Implemented high-availability solutions and CI/CD practices using Azure DevOps for reliable, cloud-native data pipelines.
  • Led technical POCs to modernize architecture and drive digital transformation across internal and partner teams.
  • Managed a team of engineers responsible for designing, developing, testing and supporting products.
  • Monitored project progress against established goals and adjusted resources or timelines accordingly when necessary.

Senior Software Engineer

Microsoft Corporation
Redmond, USA
02.2018 - 08.2020
  • Developed high-scale ingestion and transformation pipelines consolidating 30+ data sources including billing, subscriptions, revenue, and inventory.
  • Designed and implemented Spark-based ETL pipelines on HDInsight for high-throughput processing and scalable data transformations.
  • Created a metadata-driven ETL framework using Azure Data Factory V2, integrating with Cosmos DB, ADLS Gen2, and HDInsight clusters.
  • Built Spark SQL modules with Scala for large-scale batch processing and custom data transformations across multiple datasets.
  • Developed resilient data publishing frameworks using Spark connectors from HDInsight to SQL IAAS, enabling low-latency access for BI reporting.
  • Implemented high-availability and disaster recovery strategies.
  • Tuned Spark workloads for performance and resource optimization, reducing cost and improving pipeline SLA adherence.
  • Technologies: Azure Data Factory, Spark SQL, Scala, HDInsight, Cosmos DB, Azure Functions, Durable Functions, Azure Runbooks, Azure SQL DW, Azure DevOps

Technology Team Lead

Infosys Limited
Redmond, USA
10.2017 - 02.2018
  • Delivered big data profiling and identity resolution platform for Microsoft Marketing to support personalized campaign targeting.
  • Built scalable data warehouse using Azure Data Lake Analytics and USQL.
  • Designed ADF pipelines to orchestrate multi-source ingestion across SQL, Blob, and ADL.
  • Created Power BI reports using Power Pivot, enabling self-service analytics.
  • Client: Microsoft
  • Technologies: ADF, ADLA, USQL, SQL Server, Power BI, COSMOS, Azure Batch

Technology Lead

Infosys Limited
Redmond, USA
03.2017 - 09.2017
  • Transitioned marketing data platforms from legacy SQL systems to modern big data infrastructure.
  • Implemented ETL frameworks using COSMOS Scope scripts and SSIS.
  • Developed analytical models using SQLizer, Tabular cubes, and Power BI.
  • Drove full and incremental loading strategies using Scope scripts.
  • Client: Microsoft
  • Technologies: COSMOS, SCOPE, SSIS, SQL Server, Power BI

Technology Lead

Infosys Limited
Redmond, USA
02.2015 - 02.2017
  • Built big data system to track and analyze social sentiment for Microsoft products across platforms like Twitter, Facebook, and news.
  • Designed Cosmos-integrated Sangam ETL framework processing 4TB daily.
  • Integrated Lucene and Elasticsearch for free-text and sentiment analysis.
  • Reduced ETL latency from 17 hours to 3 hours using optimized MOLAP processing.
  • Evaluated and integrated Kusto for efficient aggregation and research queries.
  • Client: Microsoft
  • Technologies: COSMOS, Lucene, Elasticsearch, Sangam, SSIS, SSAS, Power BI, Kusto

Developer Lead

Infosys Limited
Chennai, India
08.2010 - 01.2015
  • Delivered enterprise BI platform and dashboards for Microsoft RE&F organization to track operations, space planning, and executive KPIs.
  • Designed reusable ETL frameworks in SSIS supporting diverse source systems.
  • Built multidimensional and tabular SSAS models for finance and operations.
  • Transitioned workloads from SQL 2008 R2 to 2012 and on-prem to IAAS.
  • Client: Microsoft
  • Technologies: SSIS, SSAS, SQL Server, Power Pivot, SharePoint, Power View

Education

B.E. - Electrical, Electronics And Communications Engineering

Kongu Engineering College
India
08.2010

Skills

  • Advanced analytics
  • Data warehousing
  • AI development
  • Data pipeline design
  • Big data processing
  • SQL
  • Python
  • Spark SQL, Scala
  • ETL
  • Azure OpenAI
  • AI orchestrators - auto gen, lang chain
  • Agentic, Ontology Graphs, RAG
  • MCP
  • Databricks
  • HDInsight
  • Metadata-driven ADF V2
  • Spark
  • SSIS, Azure Data factory, Power BI
  • Azure Cognitive Services
  • Growth mindset

Websites

Publications

  • Scaling AI Chatbot to Agents with Azure AI: A Technical Journey from POC to Production, A comprehensive technical guide on architecting production-grade AI agents using Azure OpenAI, LangChain, and AutoGen., 07/25, https://medium.com/@karthicksweeter/scaling-ai-chatbot-to-agents-with-azure-ai-a-technical-journey-from-poc-to-production-4ecdad3f7814
  • Securing Enterprise Data Access in AI Copilots Using Dynamic Row-Level Security, Demonstrates secure and scalable methods for enforcing row-level security in enterprise LLM and RAG-based agent deployments., 07/25, https://medium.com/@karthicksweeter/securing-enterprise-data-access-in-ai-copilots-agents-using-dynamic-row-level-security-a76fc34aefc7

Presentations

AI Business Consortium – Loyola University Chicago, Leveraging GenAI in Business Operations, Presented to national business leaders, showcasing real-world ROI and technical evolution., https://www.youtube.com/watch?v=PXOw_fomM-4

Timeline

Senior Engineering Manager

Microsoft Corporation
09.2020 - Current

Senior Software Engineer

Microsoft Corporation
02.2018 - 08.2020

Technology Team Lead

Infosys Limited
10.2017 - 02.2018

Technology Lead

Infosys Limited
03.2017 - 09.2017

Technology Lead

Infosys Limited
02.2015 - 02.2017

Developer Lead

Infosys Limited
08.2010 - 01.2015

B.E. - Electrical, Electronics And Communications Engineering

Kongu Engineering College

Similar Profiles

CREATE PROFILE
KARTHICK SUNDARAM