Summary
Overview
Work History
Education
Skills
Certification
Timeline
Carlos Pacheco

Carlos Pacheco

Ladson,SC

Summary

As a seasoned Data Engineer with over a decade of experience, I specialize in designing and implementing efficient data solutions. My work history includes leading roles at Booz Allen HAmilton, where I devised optimizations for the Databricks platform, designed robust data pipelines using PySpark and engaged in Agile project management with JIRA.

My proficiency extends to Azure Synapse, Apache Spark, Databricks, and ETL processes using Dagster and/or Airflow. I have also excelled in creating interactive data visualizations for business decision-making and predictive modeling. These skills have been instrumental in my role as a Lead Engineer, where I've reduced technical debt and enhanced system longevity by implementing effective data engineering solutions.

I am known to be tenacious and adept at problem-solving—traits that have helped me significantly improve data quality and maintain its integrity for peak performance. Furthermore, my communication skills have enabled me to foster cross-functional collaborations and convert business requirements into actionable data platform specifications.

Let's connect if your organization needs an experienced Data Engineer to streamline data storage systems or develop automated pipelines for timely data provision. I can contribute my analytical skills and expertise to drive your strategic objectives through innovative data solutions.

Overview

9
9
years of professional experience
1
1
Certificate

Work History

Senior Data Engineer

RunPod
10.2024 - Current
  • Develop and deploy scalable data pipelines and workflows using Dagster for orchestration, ensuring efficient data movement and processing
  • Design and manage data architectures within Snowflake, leveraging its powerful cloud capabilities for storage, transformation, and analytics
  • Establish robust frameworks to ensure data quality, integrity, and governance, supporting compliance and security requirements
  • Enhance data infrastructure with advanced technologies and integrations with platforms like Snowflake, enabling scalability to meet growing business demands
  • Collaborate with stakeholders to ensure that solutions delivered via Dagster and Snowflake meet business objectives, fostering innovation and driving growth

Lead Engineer

Booz Allen Hamilton
05.2024 - 10.2024
  • Led team to migrate systems to Azure Gov Cloud, enhancing security and compliance and ensuring data integrity
  • Modernize ETL processes, improving data flow efficiency and reliability and reducing downtime significantly
  • Streamline operations, achieving measurable performance improvements and increasing productivity
  • Collaborate with stakeholders to align technical solutions with business goals, fostering innovation and growth

Databricks Platform Architect

Booz Allen Hamilton
11.2023 - 05.2024
  • Enhanced Databricks on AWS cloud gov, boosting efficiency and cost-effectiveness
  • Established data governance policies ensuring data integrity and security
  • Incorporated new technologies to improve platform functionality
  • Directed technical development, aligning Databricks solutions with business goals
  • Collaborated cross-functionally to translate business needs into data specifications
  • Built scalable data pipelines with PySpark, improving data processing efficiency

Data Engineer

Booz Allen Hamilton
05.2023 - 12.2023
  • Designed, developed, and optimized data pipelines and workflows using Azure Data Factory, ensuring efficient ETL/ELT processes across diverse data sources.
  • Built scalable, high-performance data solutions in Azure Databricks, leveraging Spark for data transformation and advanced analytics.
  • Collaborated with clients to understand business requirements and translate them into technical solutions, ensuring alignment with their data strategy and goals.
  • Developed and maintained Azure Synapse Analytics solutions, including dedicated SQL pools, serverless SQL, and integration with Power BI for real-time reporting.
  • Conducted troubleshooting and provided expert-level support for data workflows, addressing customer issues related to data ingestion, transformation, and visualization.
  • Acted as a trusted advisor, delivering workshops, training sessions, and best practice recommendations to enhance client adoption of Azure data services.
  • Implemented monitoring and alerting for data pipelines, ensuring system reliability and rapid resolution of data-related issues.
  • Ensured compliance with data governance and security standards during solution design and implementation.
  • Collaborated cross-functionally with customer success teams, architects, and developers to deliver seamless end-to-end data solutions.
  • Authored detailed technical documentation and knowledge base articles to empower clients with self-service capabilities for common data engineering tasks.

Data Engineer

ANDMORE
06.2021 - 04.2023
  • Designed and developed data pipelines with Databricks and Azure Data Factory, ensuring high reliability
  • Optimized ETL workflows for large datasets, enhancing scalability and performance
  • Integrated diverse data sources with custom connectors, streamlining data ingestion and transformation
  • Orchestrated data processing jobs using Apache Airflow, creating custom DAGs for business needs
  • Facilitated data-driven decisions with Power BI reports and dashboards, improving business insights
  • Developed a custom monitoring system for ETL processes, significantly reducing downtime and operational costs
  • Streamlined data integration processes, achieving a 50% reduction in data latency and ensuring timely business insights

Technology Analyst

Royal Caribbean Group
05.2020 - 06.2021
  • Supported and maintained revenue management systems and business intelligence reports
  • Adapted to changing business patterns by updating PL/SQL code, reducing errors, and improving efficiency
  • Facilitated understanding of technical methods and impacts through clear presentations
  • Collaborated with business stakeholders to identify and prioritize technology initiatives that align with the company's strategic goals and objectives
  • Identified and analyzed emerging technologies in the cruise industry to recommend innovative solutions that can enhance revenue management systems and business intelligence reports
  • Evaluated the effectiveness and efficiency of existing revenue management systems and business intelligence reports and recommended improvements to optimize technology use and enhance performance
  • Collaborated with cross-functional teams to assess and provide recommendations on the potential use of emerging technologies in revenue management systems and business intelligence reports
  • Conducted regular presentations to business stakeholders on the benefits and potential impacts of implementing emerging technologies in revenue management systems and business intelligence reports

Analyst

Royal Caribbean Group
03.2019 - 05.2020
  • Designed and developed reporting and analytics solutions focusing on data visualizations
  • Consolidated data from multiple large datasets and used it to analyze results and create reports, presentations, and dashboards
  • Developed interactive data visualizations to support business decision-making and drive insights
  • Collaborated with stakeholders to understand their data visualization and BI needs and translate them into actionable insights and deliverables
  • Identified key performance indicators (KPIs) and developed metrics to measure and track the success of data visualizations and business intelligence initiatives
  • Utilized advanced analytics techniques, such as predictive modeling and machine learning, to identify trends and patterns in the data and provide actionable insights

Business Intelligence QA

AltaReturn
03.2019 - 05.2020
  • Supported maintenance and updates of the current ETL process and SSRS reports
  • Adapted to changing business needs by modifying existing SSRS reports
  • Designed and implemented automated test plans and test cases to ensure the quality of business intelligence applications and reports
  • Collaborated with the business intelligence team to develop and implement testing strategies for new ETL processes and SSRS reports
  • Collaborated with the development team to identify and fix defects or bugs in the business intelligence applications and reports
  • Conducted regular audits of business intelligence applications and reports to ensure data security and privacy regulations compliance
  • Analyzed root causes of defects and issues in business intelligence applications and reports to identify and implement solutions that improved overall system performance and functionality

Support Engineer

THINKRITE
09.2016 - 09.2017
  • Configured and tested proprietary software, reporting usability to senior management for strategic decisions
  • Developed Power BI visualizations, dashboards, and reports to enhance data-driven insights
  • Collaborated with cross-functional teams to resolve technical issues, ensuring system reliability
  • Identified and resolved hardware/software issues, maintaining smooth software operations
  • Provided technical support to clients, ensuring efficient resolution of issues and high client satisfaction

Data Analyst

Nova Southeastern University
08.2015 - 02.2017
  • Implemented business logic via PL/SQL code, enhancing data processing efficiency
  • Analyzed SQL stored procedures, significantly improving execution speed
  • Developed and applied data cleaning and validation techniques, ensuring data accuracy
  • Identified process improvement opportunities through data analysis, reducing costs and boosting efficiency

Education

Bachelor of Science -

INSTEC, Havana, Cuba
06.2010

Skills

  • ETL development
  • Data security
  • Python programming
  • SQL
  • Big data
  • Data migration
  • Advanced analytics
  • Databricks
  • Snowflake
  • Dagster
  • CI/CD

Certification

  • Databricks Certified Data Engineer Associate, 06/01/10
  • CIW, 06/01/10
  • Databricks Partner Training - Cloud Data Warehouse Migration (Verified), 06/01/10

Timeline

Senior Data Engineer - RunPod
10.2024 - Current
Lead Engineer - Booz Allen Hamilton
05.2024 - 10.2024
Databricks Platform Architect - Booz Allen Hamilton
11.2023 - 05.2024
Data Engineer - Booz Allen Hamilton
05.2023 - 12.2023
Data Engineer - ANDMORE
06.2021 - 04.2023
Technology Analyst - Royal Caribbean Group
05.2020 - 06.2021
Analyst - Royal Caribbean Group
03.2019 - 05.2020
Business Intelligence QA - AltaReturn
03.2019 - 05.2020
Support Engineer - THINKRITE
09.2016 - 09.2017
Data Analyst - Nova Southeastern University
08.2015 - 02.2017
INSTEC - Bachelor of Science,
Carlos Pacheco