Bethoon Upputuri
Garner,NC
Summary
Dynamic Data Engineering Architect with a robust background in designing and implementing enterprise-scale data platforms on Azure and AWS. Expertise includes data architecture, ETL/ELT pipelines, data lakes, Delta Lake, and comprehensive data warehouse solutions. Proficient in a range of technologies, including Python, PySpark, Databricks, Apache Airflow, and Snowflake, with strong skills in SQL, data modeling, and governance. Proven leader in driving data-driven decision-making for analytics, business intelligence, and supply chain optimization through the integration of structured and unstructured data while maintaining high standards of quality, security, and compliance.
Overview
14
14
years of professional experience
1
1
Certification
Work History
Data Engineering Architect
Psolv LLC
Dallas
02.2021 - Current
- Architect and implement cloud-native data engineering solutions on Azure to enable end-to-end supply chain analytics, improving forecasting, visibility, and decision-making.
- Develop scalable data pipelines using Databricks, PySpark, and Azure Data Factory to integrate ERP, logistics, and vendor data for real-time and batch processing.
- Design and optimize ETL/ELT workflows into Azure Data Lake, Delta Lake, and Synapse Analytics for enterprise reporting and BI.
- Orchestrate complex workflows with Apache Airflow, ensuring dependency-aware scheduling, high availability, and fault tolerance for critical data processes.
- Build real-time streaming solutions leveraging Azure Event Hub and Spark Structured Streaming for inventory tracking and replenishment alerts.
- Implement data quality frameworks and governance policies, optimizing Spark jobs and Airflow DAGs for performance, scalability, and cost-efficiency.
Senior Data Engineer
Accenture AI
Raleigh
06.2021 - 01.2022
- Design, develop, and deploy scalable data pipelines in cloud environments using Big Data technologies such as Azure, AWS, Databricks, PySpark, and Hadoop.
- Implement data cataloging, metadata management, and self-service analytics frameworks to enable data discoverability and usability for Data Scientists and Analysts.
- Collaborate with cross-functional teams (software engineers, product managers, data scientists) to gather requirements and deliver data-driven solutions aligned with business objectives.
- Create interactive dashboards and visualizations using BI tools like Power BI and Tableau to present actionable insights to stakeholders.
- Ensure scalability, reliability, and compliance by following design standards, documentation practices, and optimizing data and analytics services.
- Diagnose and optimize existing data pipelines, define SLAs, and implement performance tuning for improved efficiency and timely delivery of high-quality datasets.
Senior Data Engineer
Inbiz Concepts Inc
Boosan
04.2017 - 06.2021
- Architected and implemented cloud-based data lake and data warehouse solutions on Microsoft Azure, leveraging ETL/ELT pipelines, Azure Data Factory, and Apache Airflow to ensure scalability, reliability, and compliance.
- Designed and developed dimension and fact tables with calculated measures for enterprise analytics and BI reporting using Power BI and Tableau, enabling data-driven decision-making.
- Led data archival and storage optimization strategies, ensuring cost efficiency, long-term accessibility, and adherence to data governance and compliance standards.
- Integrated diverse data sources (ERP, transactional, and streaming) into Azure Data Lake and Delta Lake, collaborating with advanced analytics teams to enable predictive modeling and machine learning workflows.
- Optimized big data processing using Spark, PySpark, and Hadoop, and implemented SQL, Hive, and Spark SQL transformations for efficient data wrangling and analysis.
- Managed end-to-end data pipeline orchestration, performance tuning, and SLA compliance, reducing latency and improving throughput across distributed systems and cloud-native architectures.
Senior SAS programmer
CGI
USA
04.2014 - 06.2017
- Implemented ETL processes for unstructured weblog data from sources like MediaMath, Omniture, and CoreMetrics, transforming raw data into structured formats using SAS, Hive, and SQL on cloud platforms.
- Collaborated with business stakeholders to create functional specifications and technical documentation, defining marketing channel classifications, KPIs, and conversion patterns for analytics.
- Developed MIS reports and dashboards using Excel and Tableau, providing actionable insights on data trends and conversion patterns for decision-making.
- Created reusable UDFs and optimized code components to enhance query performance and scalability across large datasets.
- Processed terabytes of log data in distributed cloud environments, identifying bottlenecks and implementing performance tuning and resource optimization strategies.
- Ensured data quality, governance, and compliance while enabling efficient data wrangling and analytics for marketing and business intelligence teams.
SAS Programmer
Data Song
Hyderabad, India
06.2012 - 09.2014
- Participated in business requirement meetings with clients and end-users to gather functional specifications and translate them into technical solutions.
- Designed and developed SAS programs by analyzing requirements, creating workflow diagrams, and writing detailed specifications for data processing and reporting.
- Integrated survey data from multiple sources into SAS environment, ensuring data quality and consistency for downstream analytics.
- Performed Exploratory Data Analysis (EDA) using PROC FREQ, PROC UNIVARIATE, and PROC MEANS to identify patterns, trends, and anomalies in large datasets.
- Prepared clean, structured datasets for statistical modeling, dividing data into training and testing samples for predictive analytics.
- Created MIS reports and dashboards using Excel and Tableau, delivering actionable insights to stakeholders for business decision-making.
- Provisioned and managed Linux-based cloud infrastructure to support SAS applications, ensuring scalability and reliability.
Education
Master of Computer Applications (MCA) - Computer Science
Jawaharlal Nehru Technological University
01-2012
Bachelor’s Degree - Computer Statistics
Acharya Nagarjuna University
01-2009
Skills
- Programming & Big Data: Python, PySpark, Spark, Hive, SQL, SSIS
- Cloud Platforms: Microsoft Azure, Amazon AWS
- Data Engineering & Analytics: Databricks (Certified Professional & Associate), Azure Data Lake, Delta Lake, Data Warehouse, ETL/ELT, o9 Solutions
- Orchestration & Streaming: Apache Airflow, Azure Data Factory, Azure Event Hub
- BI & Visualization: Power BI, Tableau
Certification
- Databricks Certified Data Engineer Professional – Issued Nov 2023 (Valid until Nov 2025)
- Databricks Certified Data Engineer Associate – Issued Jul 2023 (Valid until Jul 2025)
- SnowPro Core Certification (Snowflake) – Issued Jul 2023 (Valid until Jul 2025)
- Microsoft Certified: Azure Data Engineer Associate – Issued Jun 2023
- AWS Certified Big Data – Specialty – Issued Jan 2020
- AWS Certified Solutions Architect – Associate – Issued Dec 2018
- AWS Certified Developer – Associate – Issued Nov 2018
- SAS Certified Advanced Programmer for SAS 9 – Issued Apr 2017
- SAS Certified Base Programmer for SAS 9 – Issued Mar 2017
- Professional, Academy for Healthcare Management (PAHM) – Issued Aug 2015
- O9 Solutions Integrations Specialist (Int 3.0, Delta Lakes, EKG Configurator) – Issued Jul 2025
Timeline
Senior Data Engineer
Accenture AI
06.2021 - 01.2022
Data Engineering Architect
Psolv LLC
02.2021 - Current
Senior Data Engineer
Inbiz Concepts Inc
04.2017 - 06.2021
Senior SAS programmer
CGI
04.2014 - 06.2017
SAS Programmer
Data Song
06.2012 - 09.2014
Bachelor’s Degree - Computer Statistics
Acharya Nagarjuna University
Master of Computer Applications (MCA) - Computer Science
Jawaharlal Nehru Technological University