Shanmukha Mathpati
West Chester,USA
Summary
Dynamic and results-driven Lead AWS Data Architect with over 14 years of experience in designing and delivering scalable, secure, and cloud-native solutions across financial services, R&D, and multi-cloud environments. Proven ability to lead cross-functional teams of up to 12 engineers on high-impact projects, including BARC-PBWM-Data POD 2 and VMware on AWS, ensuring alignment of technology with business objectives to drive innovation and measurable impact. Expertise in architecting AWS Data Lakehouse solutions using the Medallion framework, implementing large-scale Snowflake platforms on AWS, and optimizing ETL/ELT pipelines for multi-cloud interoperability. Proficient in SQL, Python, PySpark, and automation tools such as Jenkins and Terraform, with a strong focus on data governance, security compliance, and collaboration with senior stakeholders to deliver reusable and scalable data products.
Overview
15
15
years of professional experience
1
1
Certification
Work History
Lead AWS Data Architect
Barclays
01.2025 - 07.2025
- Lead AWS Data Architect, Leading a 7-members Data engineering team for BARC-PBWM-Data POD 2 (Singapore Demand) and Mass Affluent Projects.
- Designed, developed, tested, deployed, and maintained large-scale data pipelines on AWS using services such as Glue and Data Migration Service (DMS) for seamless data integration.
- Collaborated with data engineers, business stakeholders, and agile teams to deliver high-quality, scalable data solutions for global banking and financial clients.
- Worked extensively with AWS Data Lake, Redshift, RDS, DynamoDB, Glue, Lambda, Athena, Step Functions, S3, EC2, SNS, SQS, VPC, and Load Balancers, ensuring optimized performance and reliability.
- Demonstrated strong proficiency in SQL, Python, and PySpark for ETL development, automation, and performance tuning across multiple projects.
- Built and maintained DBT data models, mapping business entities to SQL scripts aligned with data models and developing automated test cases for ETL pipelines and APIs.
- Managed end-to-end Data & Analytics solution development lifecycles, ensuring scalability, governance, and alignment with enterprise architecture standards.
- Drove the growth of data capabilities across multiple initiatives by engaging cross-functional stakeholders and ensuring proactive issue resolution and delivery excellence.
- Established and maintained client relationships, supporting data strategy, solution delivery, and business growth initiatives with a strong commercial focus.
Lead AWS Data Architect
Broadcom / VMware
02.2020 - 12.2024
- Lead AWS Data Architect, managing 10-12 members of a data engineering team across VMware_LCaaS_vSphere R&D, VMware on AWS, and VCF on Azure projects.
- Designed and implemented AWS Data Lakehouse architectures using the Medallion (Bronze/Silver/Gold) framework, enabling governed, scalable, and high-performance analytics.
- Architected and optimized Snowflake data platforms on AWS, leveraging virtual warehouses, Snowpipe, Streams, Tasks, and Time Travel for real-time and batch processing.
- Built end-to-end ETL/ELT pipelines using DBT, AWS Glue, Redshift, EMR, and Airflow, integrating diverse data sources across hybrid and multi-cloud environments.
- Designed data models and schemas (Star, Snowflake, and Data Vault) optimized for analytical and operational workloads, ensuring flexibility and performance.
- Led development of streaming and batch ingestion solutions using Apache Spark, Kafka, and Python, delivering reliable real-time data pipelines.
- Established secure data-sharing frameworks and multi-cluster warehouse configurations to support cross-domain analytics and external collaboration.
- Applied advanced performance tuning, workload management, and cost optimization across Snowflake and AWS environments.
- Defined and enforced data governance, lineage, and quality frameworks aligned with GDPR, SOX, and enterprise compliance standards.
- Integrated data cataloging and metadata tools (Alation, Collibra, Purview, Glue Catalog, Unity Catalog) to enhance traceability and auditability.
- Architected cloud-native data solutions using S3, Redshift, Glue, Lambda, RDS, DynamoDB, ECS/EKS, and OpenSearch for scalable, secure workloads.
- Automated infrastructure provisioning with Terraform, CloudFormation, and AWS CDK, implementing IAM, KMS encryption, and network segmentation for compliance.
- Designed and managed VPC architectures (subnets, routing, NAT, and security groups) ensuring secure and resilient networking.
- Built and maintained CI/CD pipelines using Jenkins, AWS CodePipeline, CodeBuild, and CodeDeploy with GitHub/GitLab integration for automated deployments.
- Implemented monitoring and observability with CloudWatch, CloudTrail, X-Ray, Prometheus, and Grafana to ensure SLA adherence and system reliability.
- Led cloud migration projects (VMware Cloud on AWS and VCF on Azure) for databases, ETL pipelines, and analytics workloads with minimal downtime.
- Collaborated with enterprise architects, data engineers, scientists, and business teams to define data strategy, roadmap, and target-state architecture.
- Provided technical leadership and mentorship, establishing best practices in AWS, Snowflake, and hybrid-cloud data engineering to drive innovation and operational excellence.
Senior Data Engineer-II
Syniverse Technologies
08.2012 - 04.2019
- Created, enhanced, and maintained scalable data pipeline architectures to support functional and non-functional business requirements.
- Designed and implemented data process improvements including automation, optimized data delivery, and accelerated ETL velocity.
- Collaborated with data and analytics teams to develop and enhance analytic product features.
- Provided lifecycle support to operations for existing data products, services, and functionality.
- Applied Agile software development methodologies, ensuring iterative delivery and adaptability.
- Demonstrated strong analytical skills in working with structured and unstructured datasets.
- Designed and optimized big data pipelines, architectures, and datasets leveraging Hadoop, Spark, and Kafka.
- Developed stream-processing solutions using Flink, KSQL, and Spark Streaming.
- Worked extensively with relational databases (PostgreSQL, MySQL) and programming languages (Python, Scala) for data engineering solutions.
- Built cloud-native data engineering solutions on AWS and Azure, integrating with modern data architectures.
- Applied knowledge of message queuing, stream processing, and scalable data stores for high-volume data applications.
- Delivered projects with ownership, accountability, and on-time quality outcomes, while fostering teamwork and independent problem-solving.
- Consistently worked with urgency, adaptability, and a positive mindset to meet business goals.
Data Analyst
Syniverse Technologies
11.2010 - 08.2012
- Worked as a Data Analyst on MNP, CCA, International Roaming, and financial solutions, managing IoT data operations and supporting real-time analytics in AWS using EC2 and RDS (MySQL).
- Participated in requirements gathering and data design reviews, providing insights on architecture, reporting, and analytics integration.
- Created and managed AWS services including EC2, RDS, VPC, EFS, S3, and Glacier; enforced compliance and security using IAM, Inspector, and CloudWatch.
- Monitored and optimized data pipelines, server performance, and database workloads; conducted root cause analysis (RCA), incident documentation, and implemented performance tuning.
- Collaborated with international customers, billing vendors, and clearinghouses to resolve data integrity issues, drive settlements, and ensure SLA compliance.
- Resolved over 40% of production data issues independently, maintaining communication with roaming partners, analytics teams, and engineering.
- Ensured uninterrupted data service delivery by working independently during non-business hours and proactively addressing anomalies.
- Supported development and execution of product plans/releases by aligning infrastructure readiness with engineering and data center teams.
- Benchmarked production performance and optimized data pipelines and infrastructure to meet SLAs and throughput requirements.
- Assisted engineers in monitoring systems, resolving ETL job failures, and maintaining production data workflows.
- Automated reporting and data extracts to support billing, revenue tracking, and issue resolution using SQL and reporting tools.
- Analyzed logs and optimized data workflows to improve settlement processes and billing accuracy between global roaming partners.
- Investigated and resolved complex data access and quality issues, minimizing disruptions to analytics and production flows.
- Developed documentation and standard operating procedures for monitoring critical production data applications and workflows.
- Engaged with international clients and vendors to track SLA commitments and production data requests.
- Reviewed pipeline/application failures, performed RCA, and partnered with engineering to drive fixes and enhancements.
- Advocated for prioritization of high-impact fixes and improvements in release cycles.
- Collaborated with sales, marketing, product support, and development teams to ensure seamless data delivery and customer satisfaction.
Education
Bachelors in Computers application -
Sikkim Manipal University
Gangtok07.2014
Diploma in Mechanical Engineering -
Department of Technical Education Bangalore
Bangalore05.2007
Skills
- Industry Domains: Banking, Financial Services, Cloud Computing, Virtualization, Software Services, Data Clearing House
- Architectural Expertise: Data & ETL Architecture, Snowflake Architecture, Enterprise Data Architecture, AWS Solutions Architecture, Cloud Architecture, Cloud Migration, VMware Product Suite
- Methodologies: Data Analytics, Agile, Waterfall, Virtualization
- Data Warehousing & Platforms: AWS Data Lake, Snowflake, Redshift, Google BigQuery, Azure Synapse Analytics
- Cloud Platforms:
- AWS: EC2, S3, Lambda, Glue, Redshift, EMR, RDS, Athena, Kinesis (incl Flink), DMS, Step Functions, Fargate, API Gateway, ECS, EKS, EFS, EBS, ELB, DynamoDB, IAM, KMS, SNS, SQS, CloudWatch, CloudFormation, SageMaker
- Azure: Data Factory, Data Lake Storage, Databricks, Synapse Analytics, Stream Analytics, SQL Database, Blob Storage, DevOps, Monitor, Key Vault, Virtual Machines
- GCP: Dataflow, BigQuery, Cloud Functions, Cloud Run, Pub/Sub, Bigtable, Data Fusion, GKE
- Snowflake Expertise: Warehouses, Databases, Schemas, Streams, Tasks, Snowpipe, Time Travel, Zero-Copy Cloning, Secure Data Sharing, Materialized Views, Stored Procedures, Multi-Cluster Warehouses, Query Optimization
- Data Modeling: Star Schema, Snowflake Schema, OLAP/OLTP
- ETL & Data Integration Tools: AWS Glue, DBT, Apache Airflow, Azure Data Factory, Informatica, Talend
- Big Data & Streaming: Apache Hadoop, Spark, Kafka, Databricks, Presto
- Programming & Scripting: SQL, Python, PySpark
- Databases: Oracle, SQL Server, DB2, DynamoDB, Cosmos DB
- Data Visualization: Power BI
- DevOps & CI/CD: Jenkins, CodeDeploy, Git, GitHub, GitLab, Bitbucket, CodeCommit, CI/CD Pipelines
- Infrastructure as Code (IaC): Terraform, AWS CloudFormation, Azure ARM Templates
- Security & Governance: IAM, KMS, Secrets Manager, Azure Key Vault, GDPR, HIPAA, Data Lineage, Data Quality, Cataloging
- Performance & Optimization: Query Tuning, Storage Tiering, Auto Scaling, Multi-AZ, Multi-Region, Backup & Restore
- Leadership & Collaboration: Stakeholder Management, Team Leadership, Agile Delivery
Certification
- Project Management Professional – PMP
- SAFe 6 Agilist – Scaled Agile Inc.
- AWS Certified Solutions Architect – Associate
- AWS Certified Developer – Associate
- Azure Data Fundamentals
- Azure AI Fundamentals
Languages
English
Native or Bilingual
Accomplishments
- Transformed on-premise legacy data systems into a modern AWS Data Lakehouse using the Medallion (Bronze/Silver/Gold) framework, integrating S3, Glue, Redshift, and Athena — reducing data-processing latency by 40% and improving analytical query speed.
- Architected enterprise-wide Snowflake platforms on AWS with multi-cluster warehouses, Streams, Tasks, and Snowpipe; achieved 30% cost savings through warehouse sizing, query optimization, and resource governance.
- Led cross-functional teams of 10 + engineers across global projects (BARC-PBWM Data POD 2, Mass Affluent Platforms, VMware on AWS & VCF on Azure), delivering 100% on-time releases and meeting stringent SLA objectives.
- Migrated mission-critical data workloads from on-prem and Redshift to Snowflake on AWS using DMS and Glue, enabling real-time data availability and zero-downtime deployment for financial and R&D applications.
- Developed and standardized ETL/ELT frameworks with DBT, Airflow, and AWS Glue, automating data integration and reducing manual effort by 50%.
- Implemented governance and metadata lineage frameworks using Glue Catalog, Alation, and Collibra, ensuring compliance with GDPR, SOX, and financial audit policies.
- Delivered hybrid multi-cloud architecture integrating VMware Cloud on AWS and VCF on Azure, achieving near-zero downtime and 20% TCO reduction through optimized storage and compute strategies.
- Established CI/CD automation for data pipelines using Jenkins and AWS CodePipeline, shortening release cycles and improving deployment reliability.
- Enhanced observability and monitoring via CloudWatch, X-Ray, and Grafana dashboards for proactive alerting and root-cause analysis across data platforms.
- Mentored junior engineers and architects, promoting best practices in data modeling, governance, and cloud optimization, improving team efficiency and delivery maturity.
Timeline
Lead AWS Data Architect
Barclays
01.2025 - 07.2025
Lead AWS Data Architect
Broadcom / VMware
02.2020 - 12.2024
Senior Data Engineer-II
Syniverse Technologies
08.2012 - 04.2019
Data Analyst
Syniverse Technologies
11.2010 - 08.2012
Bachelors in Computers application -
Sikkim Manipal University
Diploma in Mechanical Engineering -
Department of Technical Education Bangalore