Data Engineer
Walmart
Dallas, TX
08.2022 - Current
- Architected and implemented end-to-end data solutions on the Azure cloud platform, leveraging services such as Azure Data Factory, Azure Databricks, and Azure SQL Database.
- Designed and developed ETL pipelines to ingest, process, and transform large volumes of data from diverse sources, resulting in a 40% improvement in data processing efficiency.
- Implemented data warehousing solutions using Azure Synapse Analytics, optimizing data storage and enabling real-time analytics for business stakeholders.
- Conducted data modeling and schema design to support reporting and analytics requirements, ensuring data consistency and accuracy across the organization.
- Collaborated with cross-functional teams to define data governance policies, data access controls, and security measures, ensuring compliance with industry standards and regulations.
- Led efforts to implement data quality checks and validation processes, reducing data errors by 30% and improving overall data reliability.
- Implemented CI/CD pipelines for data solutions using Azure DevOps, enabling automated deployment and version control of data pipelines and workflows.
- Conducted performance tuning on SQL queries and optimized data storage using techniques such as partitioning and indexing, resulting in a 50% reduction in query response times.
- Used version control systems (e.g., Git) to manage code and configurations related to data pipelines.
- Deployed and managed data engineering solutions in production environments.
