Catherine Chomyk

Client Based

• Developed and implemented ETL pipelines using Databricks, AWS, Git, and PySpark facilitating seamless on-premises to cloud data migration and enabling cloud transformation.
• Designed data quality and validation solutions, integrating automated remediation frameworks to ensure high-quality data consumption and swift issue resolution.
• Optimized complex Starburst SQL queries, significantly improving dashboard performance and query execution time for end users.
• Built and executed a test automation framework, validating and comparing programmatic data extraction accuracy against LLM-based methods, improving efficiency and validation through iterative enhancements.
• Spearheaded automation of data workflows and pipelines, significantly reducing manual intervention and enhancing operational efficiency using Spark and Python.
• Partnered with architects, business analysts, and end users to develop gold-standard data layers, improving data warehousing, analytics, and enhancing visualization accessibility for non-technical stakeholders.
• Enhanced ontology dictionaries to improve data extraction efficiency, competitive analysis, and research and development for a global biopharmaceutical company.
• Reported directly to the Head of Data Engineering of North America at one of the largest consumer goods companies in the world, providing essential support, insights, and acting as a representative when required.

Internal

• Led a team of 10 consultants as a Product Owner, Scrum Master, and Developer, overseeing end-to-end software engineering projects, demonstrating strong leadership and project management skills.
• Developed and maintained a robust, production-grade codebase using Agile development methodologies, ensuring efficient sprint planning, iterative deployments, and timely project delivery.
• Mentored and trained new consultants, ensuring smooth onboarding and enhancing their technical expertise in data engineering, software engineering, and cloud transformation.