Pooja Kolla
Charlotte,NC
Summary
Experienced Data Engineer with 8+ years in IT and over 5 years of hands-on expertise in Palantir Foundry, specializing in ETL development, data modeling, ontology design, and metadata management. Proficient in Python and SQL for complex data transformations and optimization, with a strong focus on ensuring data consistency, performance, and business-aligned outcomes.
Overview
12
12
years of professional experience
Work History
Sr. Palantir ETL Data Engineer
AIG
03.2021 - 03.2025
- Designed and implemented end-to-end scalable data pipelines in Palantir Foundry, enabling seamless data ingestion, transformation, and integration from diverse on-premises and cloud sources (including Azure and Snowflake), supporting both real-time and batch processing use cases.
- Developed and optimized ETL processes using Python, PySpark, and Palantir’s Pipeline Builder, applying advanced transformation techniques, parallel processing, and caching strategies to enhance performance, reducing data processing time by 40%.
- Built robust data models, ontologies, and semantic mappings in Foundry to ensure accurate, consistent data representation and interoperability across platforms, while implementing metadata management, access controls, and validation checks to uphold data governance and quality standards.
- Collaborated with business stakeholders, data engineers, and ingestion teams to gather data requirements, support Snowflake-to-Foundry data migration, and deliver analytics-ready datasets for key use cases such as insurance claims processing and actuarial modeling.
- Deployed and tested data applications and workflows using Slate, Workshop, and Quiver within an Agile environment, ensuring secure, high-performance solutions across global teams while maintaining documentation and tracking progress in JIRA and Confluence.
Palantir Data Engineer
United Airlines
01.2019 - 03.2021
- Designed and developed real-time flight operations applications using Palantir Foundry Workshop, Slate, and Quiver.
- Designed and optimized ETL pipelines in Foundry, processing real-time airline data using PySpark transformations.
- Built ontology-based data models to standardize and link disparate airline data sources for seamless analytics.
- Improved airline data pipeline performance by 40%, leveraging PySpark optimizations and Foundry caching mechanisms.
- Created SQL database, and performed monitoring and restoring of AWS database. Performed migration of Microsoft SQL server to Azure SQL database.
Sr. Data Engineer
Ascena Retail group
04.2017 - 12.2019
- Understand the requirements, design and implement data sourcing solutions by using data modeling tools and implementing ETL using technologies like Teradata & Informatica.
- Utilized AWS CloudFormation templates to provision the necessary infrastructure components, including EMR clusters, Amazon S3 buckets for data storage, and IAM roles for access management.
- Writing SQL queries to help the ETL team with a system migration. DDL & DML SQL code to map and migrate data from source to destination new server in AWS.
- Created the Shell Scripts to extract the data from APIs and loaded the data into Teradata System.
Data Engineer
Highmark
08.2015 - 03.2017
- Leveraged Azure services such as Azure SQL Database, Azure Data Lake Storage, or Azure Synapse Analytics to develop and optimize data solutions.
- Creating Extract, Transform, Load ETL processes using Informatica to extract data from various sources, transform it as required, and load it into Azure databases or data lakes.
- Established Connection between on premise server and Azure Cosmos DB for cloud migration.
- Coordinate development work with team members, review ETL jobs, and create scripts for scheduling jobs and implementation. Also have installed and implemented Airflow for scheduling.
Data Analyst
HCL Technologies
01.2013 - 05.2015
- Wrote scripts for data cleansing, data validation, data transformation for the data coming from different source systems.
- Worked on processing the data and testing using Spark SQL and on real-time processing by Spark Streaming and Kafka using Python.
- Worked on Data Integration for extracting, transforming, and loading processes for the designed packages.
- Crafted stored procedures in SQL, optimizing data operations and enhancing database organization and retrieval efficiency for seamless storage.
Education
Bachelor of Science - Computer Science And Engineering
Jawaharlal Nehru Technological University
Hyderabad, IndiaSkills
- Tools: Palantir Foundry (Workshop, Quiver, Slate, Ontology), Power BI, Tableau
- Programming: Python, SQL, PySpark, Java
- Cloud: Azure, Snowflake, AWS
- ETL: Informatica, Data Pipeline Builder, Control-M,
- Data Modeling: Ontology, Metadata Management, Data Lineage
- Methodologies: Agile, Data Governance, Data Quality
Timeline
Sr. Palantir ETL Data Engineer
AIG
03.2021 - 03.2025
Palantir Data Engineer
United Airlines
01.2019 - 03.2021
Sr. Data Engineer
Ascena Retail group
04.2017 - 12.2019
Data Engineer
Highmark
08.2015 - 03.2017
Data Analyst
HCL Technologies
01.2013 - 05.2015
Bachelor of Science - Computer Science And Engineering
Jawaharlal Nehru Technological University
Similar Profiles
Sai Prathyusha VeguruSai Prathyusha Veguru
AEM Developer at AIGAEM Developer at AIG
Betty HernandezBetty Hernandez
Supervisory Accountant at AIGSupervisory Accountant at AIG
Aditi .RAditi .R
Process Developer at AIGProcess Developer at AIG