Kanchanlata Vaishya
Atlanta,GA
Summary
Dynamic Senior Data & Analytics professional with over 13 years of experience designing and delivering enterprise-scale data platforms and analytics solutions in cloud and on-premises environments. Proven expertise in cloud data engineering, modern data warehousing, big data processing, and analytics enablement, with a strong emphasis on leveraging Cloud (Azure/AWS) and Databricks to achieve impactful results. A robust background in professional services enhances collaboration with cross-functional stakeholders, ensuring alignment of data strategies with overarching business objectives. Recognized for leadership in project delivery, team mentorship, and adept problem-solving of complex data challenges in fast-paced settings.
Overview
16
16
years of professional experience
1
1
Certification
Work History
Data Engineer
A.P. Moller – Maersk
Bangalore, India
10.2018 - 09.2025
- Architect, Design and implemented Lakehouse architecture using Azure Databricks + Delta Lake, enabling scalable analytics and BI reporting using Power BI.
- Designed and implemented Databricks-based ETL pipelines using Delta Lake, Unity Catalog, Lakeflow jobs and Auto Loader for batch and streaming workloads.
- Automated code deployments through CI/CD pipelines leveraging GitHub and Databricks Asset Bundles.
- Developed real-time streaming pipelines using Spark Streaming, supporting business-critical KPIs with sub-minute latency.
- Designed robust cloud DWH models, enabling faster query performance and simplified downstream reporting.
- Partnered directly with business stakeholders to gather requirements and translate them into scalable technical solutions.
- Optimized Spark jobs, storage formats, and cluster configurations, resulting in 25–30% cost reduction.
- Troubleshooting production incidents, performed root cause analysis, and implemented long-term preventive solutions.
- Actively involved in full SDLC: planning, design, development, testing, QA, deployment, and post-production support.
- Mentored team members and enforced data engineering best practices and documentation standards.
Associate Manager
AIG
Bangalore, India
09.2014 - 03.2017
- Worked as an Individual Contributor on a Netezza migration POC, supporting enterprise analytics workloads.
- Designed and delivered data solutions for Data Science and Analytics teams, improving data accessibility and performance.
- Led functional and non-functional requirement discussions, translating business needs into detailed technical specifications.
- Created and maintained project artifacts, architecture documents, and technical deliverables.
- Collaborated with cross-functional teams to ensure solution scalability, performance, and compliance.
Data Specialist
IBM
Bangalore, India
11.2012 - 09.2014
- Designed and enhanced Business Intelligence and Data Warehouse solutions for enterprise clients.
- Supported continuous delivery of KPIs, ensuring data accuracy and timely availability.
- Developed enhancements for change requests, including coding, debugging, and documentation.
- Led unit, integration, and system testing, improving production stability and release quality.
- Trained and onboarded new team members, reducing ramp-up time by 30%.
Associate
Cognizant Technology Solutions
Chennai, India
09.2009 - 10.2012
- Started as a Trainee Software Engineer, progressing into a core BI delivery role.
- Delivered end-to-end BI solutions from ETL to reporting, supporting Healthcare and Retail domains.
- Performed data analysis, development, testing, and production support activities.
- Optimized reports and ETL processes, improving query performance and report turnaround time.
- Supported ad-hoc reporting and client data investigation requests.
Education
Bachelor of Technology (B.Tech) - Computer Science
Sikkim Manipal Institute of Technology
IndiaSkills
- Cloud data architecture expertise (Azure, AWS)
- Databricks & Spark (Batch & Streaming)
- Data Governance(Unity Catalog)
- Unity Catalog, Autoloader,Lakeflow Jobs
- DataBricks Asset Bundle(DABS)/Git Hub
- SQL & Advanced Analytics
- Python & PySpark
- Azure Data Factory(ADF)
- Azure Synapse
- Kafka
- CI/CD & Cloud DevOps
- Data Warehousing
- Data Modelling(Star/Snowflake)
- Lakehouse & Medallion Architecture
- Big Data Engineering
- ETL/ELT & Data Integration
- Enterprise Data Models
- Power BI
- Agile Methodology
Certification
Microsoft Certified: Azure Data Engineer Associate
Timeline
Data Engineer
A.P. Moller – Maersk
10.2018 - 09.2025
Associate Manager
AIG
09.2014 - 03.2017
Data Specialist
IBM
11.2012 - 09.2014
Associate
Cognizant Technology Solutions
09.2009 - 10.2012
Bachelor of Technology (B.Tech) - Computer Science
Sikkim Manipal Institute of Technology