Nova Guliyev
Arlington,VA
Summary
Seasoned Lead Data Engineer with over 9 years of experience specializing in modern data platforms on Databricks and Azure. Led high-performing teams to drive scalable data solutions, optimized large-scale processing using Apache Spark and Databricks, and delivered cloud-native architectures that align with business objectives.
Overview
9
9
years of professional experience
1
1
Certification
Work History
Senior Data Engineer
Blueprint
Bellevue, Washington
03.2024 - Current
- Built scalable ETL pipelines in Azure Databricks for efficient large-scale and real-time data processing
- Built scalable, event-driven data pipelines and unified analytics solutions by integrating Azure Data Factory, Synapse Analytics, Event Hubs, and Microsoft Fabric
- Applied Delta Live Tables (DLT) for declarative pipeline development and data quality enforcement
- Built automated data quality and monitoring using MTF (metadata-driven framework) in Databricks to ensure reliable pipelines
- Optimized large-scale (billions of records) Databricks pipelines using partitioning, bucketing, predicate pushdown, Z-ordering, caching, and broadcasting to improve performance and reduce runtime
- Implemented Databricks Asset Bundles for environment-aware, CI/CD-driven deployment of jobs, workflows, and infrastructure as code
- Enabled seamless data ingestion, unified data management, and real-time analytics across lakehouse architectures using Databricks Lakeflow Connect and Lakebase
- Designed and implemented Unity Catalog from scratch, migrating Hive Metastore with automation.
- Migrated on-prem data and applications to Azure and implemented real-time streaming with Kafka/Spark Streaming, ensuring minimal downtime
Lead Data Engineer
CBS
Scotch Plains, NJ
03.2023 - 03.2024
- Led data engineering team delivering end-to-end scalable pipelines
- Implemented Unity Catalog, DLT, and Structured Streaming for real-time data pipelines
- Experience with dbt for data modeling, transformations, and testing
- Built real-time pipelines using Event Hubs and Databricks
- Reduced data prep time by 30% and improved model efficiency by 25% using Databricks
- Developed Fabric Lakehouse for streamlined analytics across structured and unstructured data
- Fine-tuned Spark workloads for performance and scalability
- Established data governance framework with Azure Purview to ensure compliance and data quality
- Ingested data from APIs and systems (Salesforce, NetSuite, Zendesk, SQL, Cosmos DB)
- Managed Databricks clusters with CI/CD processes, enhancing security, data lineage, and monitoring capabilities
Senior Data Engineer (Consultant)
Concord
Minneapolis, MN
03.2022 - 03.2023
- Executed Medallion architecture (Bronze/Silver/Gold) with real-time capabilities to streamline data processing
- Led migration of on-prem pipelines to Databricks, implementing Medallion architecture
- Developed ETL pipelines using Python, SQL, and Spark, enhancing data accuracy by 25%
- Optimized Spark & Delta (partitioning, caching, Z-ordering, broadcast joins) to reduce runtime
- Built data pipelines using ADF for scalable data ingestion and orchestration
- Integrated Cosmos DB for high-throughput, low-latency data storage
- Implemented Kafka for real-time streaming and event-driven processing
- Partnered with analysts and data scientists to enhance data quality and deliver actionable insights
- Led team delivery, ensuring collaboration and high-quality outcomes
Senior Data Engineer
Altria
Richmond, Virginia
12.2016 - 03.2022
- Developed scalable data pipelines using Spark, Python, and Scala to support large-scale data processing
- Engineered pipelines in Databricks & Spark for 100TB+ datasets
- Built and optimized data pipelines using Azure Data Factory (ADF) to ensure reliable data ingestion and orchestration
- Designed and optimized analytics solutions using Azure Synapse to enable high-performance querying
- Wrote complex queries, transformations, and procedures using SQL for efficient data processing
- Designed data warehouse architectures using Kimball & Inmon methodologies
- Developed Power BI dashboards with advanced DAX calculations
- Worked with AWS services (S3, DMS, Glue) for data migration and processing
Education
Master of Science - Analytics & Data Science
Northeastern University
Boston, MA04-2022
Bachelor of Science - Computer Science
ADA University
Baku AzerbaijanSkills
- Databricks & Microsoft Azure expert with hands-on experience in Databricks, Fabric, ADF, Synapse, SQL DB, Cosmos DB, Power BI, and Purview
- Proficient in Python, Scala, SQL, and DAX for large-scale data engineering
- Data governance
- Skilled in cloud migration, CI/CD, and end-to-end data solutions
- Proven ability to lead, manage and deliver high-performing data engineering teams
Certification
Databricks Champion
Databricks Certified Data Engineer Professional
Databricks Certified Data Engineer Associate
Microsoft Azure Data Engineer
Databricks Certified Data Engineer Professional
Databricks Certified Data Engineer Associate
Microsoft Azure Data Engineer
Timeline
Senior Data Engineer
Blueprint
03.2024 - Current
Lead Data Engineer
CBS
03.2023 - 03.2024
Senior Data Engineer (Consultant)
Concord
03.2022 - 03.2023
Senior Data Engineer
Altria
12.2016 - 03.2022
Master of Science - Analytics & Data Science
Northeastern University
Bachelor of Science - Computer Science
ADA University