THIRUMURUGAN GANESAN
Data Management | Lakehouse Architecture | Enterprise Data Governance | Cloud & AI Engineering
Charlotte,NC
Summary
Enterprise Data & AI Leader architecting governed Lakehouse platforms across Databricks and Snowflake using Medallion design, canonical domain models, and semantic layers to power analytics, ML, and LLM-driven workloads. Expertise in Delta optimization, schema governance, feature engineering, and end-to-end Lakehouse lifecycle management.
Overview
20
20
Data & AI Architect driving Lakehouse & GenAI modernization
Work History
Cloud Platform Architect & Data Engineering Leader
Droys Inc / Isotropic Solution
12.2024 - Current
- Established enterprise Data Governance Framework—glossary, lineage, metadata standards, DQ rules, lifecycle processes.
- Architected Medallion-based Lakehouse modeling standards—curated silver and gold layers for finance analytics.
- Designed canonical financial data models aligned with governance, lineage, and audit policies.
- Built FinAI platform integrating FinGPT/FinBERT/QWEN using LangGraph—explainable, governed inference outputs.
- Created Azure MLOps pipelines supporting versioning, reproducibility, compliance scoring, and audit trails.
- Led governance committees, stakeholder workshops, roadmap planning and PMI-style steering forums.
Cloud Platform Engineer / Data Solutions Lead
AppITap / Yucca Solutions
07.2021 - 11.2024
- Led Lakehouse transformation—modeled raw → curated → semantic → Gold datasets with Delta Lake governance.
- Built multi-domain canonical and dimensional models powering analytics & ML workloads.
- Designed enterprise Data Contract Engine binding models, schemas, DQ rules, retention & semantic definitions.
- Implemented Purview + Unity Catalog lineage pipelines with classification & sensitivity tagging.
- Developed custom Data Marketplace enabling governed data discovery, documentation, and policy enforcement.
- Delivered DaaS platform with API governance, versioning, SLAs, onboarding workflows, and semantic-layer integration.
- Re-engineered Databricks pipelines achieving 75% runtime improvement with automated observability & DQ scoring.
Vice President, Engineering (Data & Security Platforms)
Indusface
09.2020 - 06.2021
- Designed Lakehouse-compatible security analytics models with lineage, retention and GDPR/PCI governance.
- Implemented ML-based detection pipelines using Kafka + Elastic with modeled, inference-ready datasets.
- Drove governance boards—risk reviews, dependency management, PMO steering meetings.
- Built documentation assets—runbooks, process SOPs, reference guides, and release governance checklists.
Founding Engineer / Data Platform Innovator
AppITap
01.2018 - 08.2020
- Built Kafka ingestion pipelines with domain-centric data modeling, schema evolution governance, and metadata tagging.
- Developed unified GraphQL + REST API layer backed by semantic and canonical domain models.
- Led creation of architectural handbooks, product guides, operational playbooks, and engineering documentation.
- Delivered secure, compliant data delivery pipelines for multimedia, voice analytics & customer platforms.
Senior Manager
VMware
01.2014 - 01.2017
- Led Debug-as-a-Service platform, lineage mapping, diagnostic governance, and documentation leadership.
Manager-II
Cisco
01.2013 - 01.2014
- Directed UCS platform engineering with program governance, risk reviews, and cross-site coordination.
Engineering Leadership
Juniper / LSI / HP / Ionic / Encanto
01.1995 - 01.2014
- Built networking/storage/OS systems; led governance adoption, modeling documentation, and platform transitions.
Education
Master of Applied Mathematics -
05-1993
Bachelor of Applied Sciences -
05-1991
Skills
Lakehouse: Databricks, Snowflake, Delta Lake, Unity Catalog, Purview, Feature Store
Modeling: Canonical models, Medallion architecture, dimensional modeling, MDM patterns, semantic layers
Data Governance: Glossary, dictionary, lineage, cataloging, DQ frameworks, stewardship roles
Cloud: Azure, AWS, GCP
Engineering: Spark, PySpark, Kafka, Synapse, ADF, Glue, ETL/ELT
AI/ML: FinGPT, FinBERT, QWEN, Azure ML, SageMaker, LangGraph, RAG
DevOps: Terraform, CI/CD, Docker, Kubernetes
Compliance: PCI-DSS, GDPR, SOC II, ISO 27001
Programming: Python, SQL, Java, Scala, Rust, C#, TypeScript
KEY HIGHLIGHTS
- Led enterprise Data Governance including glossary, dictionary, lineage, metadata standards, DQ scorecards, and stewardship roles.
- Implemented Purview, Unity Catalog, and custom-built data marketplace platforms for metadata, lineage, and governed access.
- Delivered 45% cloud cost reduction and 75% Databricks runtime improvement through Lakehouse optimization.
- Architected FinAI platform using FinGPT, FinBERT, QWEN, and LangGraph—governed inference outputs with explainability and lineage.
- Developed DaaS framework with API governance, versioning, SLAs, onboarding workflows, and semantic-layer integration.
- Led cross-functional program governance: policy review boards, roadmap steering committees, audit-prep sessions, and domain councils.
- Directed documentation programs producing product guides, operational runbooks, architectural handbooks, and field playbooks.
LAKEHOUSE & DATA MODELING LEADERSHIP
- Architected Medallion (Bronze-Silver-Gold) Lakehouse structures with Delta Lake optimization (Z-ordering, clustering, time-travel, retention policies).
- Designed domain-centric canonical models enabling interoperability across multiple business domains.
- Implemented MDM-aligned modeling patterns—conformed dimensions, reference data harmonization, golden record creation.
- Built semantic layers, curated Gold datasets, and ML-ready feature stores supporting predictive analytics & LLM inference.
- Executed modernization from legacy Data Lakes to governed Lakehouse architectures with schema governance and lineage requirements.
- Developed inference-centric data curation layers—sessionization, aggregations, entity resolution, vectorization.
- Integrated Unity Catalog & Microsoft Purview for lineage, classification, ownership, and sensitivity tagging.
- Defined Lakehouse consumption patterns—DaaS, SQL endpoints, governed APIs, semantic marts.
Timeline
Cloud Platform Architect & Data Engineering Leader - Droys Inc / Isotropic Solution
12.2024 - Current
Cloud Platform Engineer / Data Solutions Lead - AppITap / Yucca Solutions
07.2021 - 11.2024
Vice President, Engineering (Data & Security Platforms) - Indusface
09.2020 - 06.2021
Founding Engineer / Data Platform Innovator - AppITap
01.2018 - 08.2020
Senior Manager - VMware
01.2014 - 01.2017
Manager-II - Cisco
01.2013 - 01.2014
Engineering Leadership - Juniper / LSI / HP / Ionic / Encanto
01.1995 - 01.2014
Thiagarajar College of Engineering - Master of Applied Mathematics,
Thiagarajar College of Engineering - Bachelor of Applied Sciences,