Karthik Patil

• Leading the development and management of data pipelines and ingestion processes for customer-related data from SAP, SQL, Oracle, and APIs.
• Collaborated with product owners, data modelers, data engineers, and the data governance team to ensure secure and properly classified data ingestion into the data lake following standards of medallion architecture.
• Led the reverse engineering of Teradata data warehouse solutions and successfully transitioned to an equivalent architecture on Azure Data Lake using the Medallion approach.
• Configured ETL pipelines utilizing PepsiCo’s common ingestion framework for various data sources (Teradata, SQL, CSV) into the silver layer.
• Designed and modeled Sales data tables from diverse sources (Oracle, SAP, SQL) into a unified Industry Data Model.
• Conducted data transformations using Azure Databricks (PySpark) to develop the gold layer, supporting consumer applications such as iOS apps, ML models, and PowerBI.
• Implemented Spark optimization techniques to manage large datasets, reducing latency between source and target systems.
• Established data reconciliation mechanisms using ICE DQ tool to ensure data quality.
• Led a team of 6 in project execution from initiation to delivery.
• Conducted training sessions for sector IT teams on PepsiCo’s data foundation IP to facilitate solution design on Azure.

• Lead offshore team and optimize data extraction python code
• Develop ETL pipelines for different sources (SQL, Oracle, Teradata) to hive using Spark and Sqoop.
• Coordinate with upstream data source applications to debug data integrity issues.
• Developed log parser code in Python to identify errors quickly and facilitate timely resolutions in case of job failures.
• Created Power BI dashboards to provide meaningful insights to aid decision-making.
• Debug and resolve issues in SSIS and SQL procedures for data warehouse applications.
• Gather requirements, break them down into stories, and participate in planning and estimations.
• Manage bi-weekly agile sprints with team sizes over 8.

• Worked on diversified Documentum projects based on xCP and D2.
• Created plugins and solutions for Novartis Pharma, AAEFES, UHG, JHS, and various other clients.
• Designed and implemented complex workflows, task pages, and automation processes in xCP.

• Customized Documentum WDK components and developed custom tag value handlers for KYC project.
• Implemented TBOs and preconditions for seamless document management system.

TCRA : Involved in requirement analysis, solution design, architecture design, object model, estimates, development, testing and delivery of the project. Developed application using wdk customization and designed workflow for approval process using process builder.