Data quality professional with proven skills in Spark programming and Airflow orchestration. Developed robust data quality frameworks and optimized SQL database interactions, ensuring high accuracy and reliability of large datasets.
Overview
10
10
years of professional experience
Work History
Cloudserv
Cloudserve solutions
Irving, Texas
10.2021 - 11.2022
Built a custom data quality framework in Spark to profile, validate, and cleanse large datasets using configurable rules (null, type, range, referential, and business checks).
Developed reusable Spark jobs to calculate data quality metrics (completeness, accuracy, consistency) and capture detailed error records for failed rows.
Stored rule configurations, run metadata, and data quality results in DynamoDB to enable traceability, trend analysis, and self‑service reporting for stakeholders.
Orchestrated end-to-end data quality workflows in Airflow, including scheduling, dependencies between Spark jobs, and automated retries.
Implemented alerting and logging in Airflow to notify teams on data quality failures and pipeline issues, with status and run history tracked per job execution.
Software Programmer
Mizpatech
Ranni, Kerala,India
03.2013 - 09.2013
Designed and developed custom business applications using .NET ( ASP.NET Core) tailored to specific client requirements, including bespoke modules, workflows, and UI components aligned with their processes.
Gathered and analyzed functional requirements with stakeholders, translated them into technical specifications, and proposed solution architectures and technology stacks within the .NET ecosystem.
Implemented multi-layered application architecture (presentation, business, and data access layers) using SOLID principles and design patterns to ensure scalability, testability, and ease of maintenance.
Software Engineer
CS3 infomat
Kochi, Kerala
06.2012 - 09.2013
Developed and maintained ERP modules using .NET technologies (C#, ASP.NET, ADO.NET) to support core business operations such as finance, inventory, and sales.
Designed and implemented multi-layered architecture (presentation, business logic, data access) to ensure scalability and maintainability of ERP solutions.
Wrote complex SQL queries, stored procedures, and optimized database interactions to improve ERP system performance and data integrity.
Collaborated with business stakeholders to gather requirements, analyze existing processes, and translate them into technical specifications for ERP features.
Education
Bachelor of Science - Computer Science Engineering
MG University (Believers Church Caarmel College)
Ranni,Kerala,India
06-2011
Skills
Custom data profiling
Spark programming
Data quality metrics
Airflow orchestration
SQL database optimization
Business application development
AI Engineering
Rag based development
Timeline
Cloudserv
Cloudserve solutions
10.2021 - 11.2022
Software Programmer
Mizpatech
03.2013 - 09.2013
Software Engineer
CS3 infomat
06.2012 - 09.2013
Bachelor of Science - Computer Science Engineering