Rohit Korra
Chantilly, VA, United States, 20152,VA
Summary
Data Architect Manager with 14 years of comprehensive experience in software development, data architecture, strategy, and management across diverse business teams. Expert in designing, implementing, and managing large-scale data platforms. Proficient in Python modules, Google Cloud Platform (GCP), Airflow, Cloud Dataflow, Confluent Kafka, Google Pubsub, Apache Kafka, and Google Big Query. Skilled in ELT and ETL architectures, DevOps, Kubernetes, Helm, Cloud Build, and GIT. As a Principal data architect, I've been instrumental in driving data-driven decision-making by implementing robust data architectures that significantly improved operational efficiency and enabled informed strategic decisions.
Overview
14
14
years of professional experience
Work History
Principal Data Architect
Totalwine & More
Bethesda
07.2021 - Current
- Leading a team of Data engineers to maintain and enhance companies Enterprise Data Analytical Platform in GCP
- Building new Data pipelines using Airflow, DBT, BigQuery, Apache beam, Kafka and Kubernetes
- Developing data models and certified datasets in BigQuery for order management, supply chain management, sales reporting, financial reporting, CRM, and various other data modules that support business decision-making at Total Wine.
- Migrating Kafka producers and consumers from confluent cloud to self-hosted Kafka solution
- Using Kafka Schema registry for schema evolution
- Developed a framework for custom Kafka consumers that can be configured using simple YAML files. Implemented dynamic transformations to extract specific fields from semi-structured Kafka messages based on table schemas. Utilized Keda for horizontal pod autoscaling of the custom Kafka consumer pods
- Leading the upgrade of crucial applications – Cloud Composer, Strimzi operators in K8, Confluent Cloud Kafka connectors, and underlying container images to leverage cutting-edge features. Additionally, I'm orchestrating the migration of Kafka connector setups to helm charts for enhanced management and efficiency
- Led efforts for migrating existing transformation framework from SQL statements in BigQuery to DBT, enhancing efficiency and maintainability. Also ensured robust security by implementing policy tags and dynamic data masking to protect sensitive PII data. Furthermore, I strengthened password security by utilizing the secret manager, enabling direct application access and enhancing overall data protection measures.
- Building custom Dashboards for ELT members using Looker and PowerBI
- Leading GCP Cost optimization and significantly cutting expenses by pinpointing storage and computing anomalies. Designed reports and real-time alerts for immediate notification on exceeding thresholds, leveraging Cloud Monitoring and custom alerts
Lead Cloud Data Engineer
Totalwine & More
03.2018 - 07.2021
- Migrating Legacy Data warehouse in SQL Server to Google BigQuery and associated pipelines into Google Cloud Composer and Cloud Dataflow.
- Led efforts to migrate Data pipelines in Airflow from On-prem machines to fully managed Google Cloud Composer. Contributed to building an in-house customer MDM solution using Cloud Dataflow.
- Architecting data pipelines (batch and real-time) from a variety of source systems that include Salesforce Service Cloud, Adobe Analytics, Acxiom Customer Data Enrichment, Qualtrics, Totalwine's inhouse ERP, and e-commerce systems (FTP, SQL server, My SQL, Pubsub, Kafka).
- Spearheading research and development efforts focused on Confluent Kafka and Strimzi in Kubernetes (K8) with the aim of establishing them as primary tools for real-time data integration into BigQuery. This involves in-depth exploration, optimization, and seamless integration to empower efficient and scalable real-time data flow into BigQuery for enhanced analytics and insights.
Lead Integrations Developer
Totalwine & More
03.2015 - 03.2018
- Led a team in pioneering our company's inaugural in-house data warehousing system on SQL Server leveraging Clover ETL and SSIS as our data integration tools. We seamlessly extracted data from diverse systems, channeled it into the staging layer, and proficiently constructed facts and dimensions. This strategic endeavor has not only streamlined data processes but also fortified our analytical capabilities for informed decision-making.
- Created many inbound and outbound data integration pipelines using Clover ETL working with a variety of systems (Salesforce marketing cloud, Instacart, Acxiom). Integrated different kinds of sourch and destination systems including SFTP, REST API, Databases and Streams
Senior Software Developer
Totalwine & More
03.2013 - 03.2015
- Supporting and enhancing ERP systems (.NET applications). Building new modules in window applications and new web services to support these modules.
- Worked as a production support engineer and helped maintain all internal ERP applications including window applications, web services, and SSRS reports
- Working on creating SSRS reports on Item and Inventory management data and developing underlying data servi
Software Developer
Totalwine & More
10.2011 - 03.2013
- Developing Mark out-of-stock module in .NET Windows application and underlying SOAP web service
- Enhancing Inventory management module and demand forecast module in .NET web service and SQL stored procedures. Updating indexes to improve query performance.
Programmer Analyst
Hanusoft Inc.
01.2011 - 09.2011
- Working with complex computer models/ programs, writing queries, develop and perform quality assurance tasks for commercial software, Requirements gathering, process flow analysis, requirements documentation, testing and implementation
- Working in production support team and involve maintenance releases, hot fixes and Change requests
Education
MS Applied Computer Science -
Northwest Missouri State University
12-2009
Bachelors in Technology -
JNTU
05-2007
Timeline
Principal Data Architect
Totalwine & More
07.2021 - Current
Lead Cloud Data Engineer
Totalwine & More
03.2018 - 07.2021
Lead Integrations Developer
Totalwine & More
03.2015 - 03.2018
Senior Software Developer
Totalwine & More
03.2013 - 03.2015
Software Developer
Totalwine & More
10.2011 - 03.2013
Programmer Analyst
Hanusoft Inc.
01.2011 - 09.2011
MS Applied Computer Science -
Northwest Missouri State University
Bachelors in Technology -
JNTU
Similar Profiles
Rohit KorraRohit Korra
Principal Data Architect at Totalwine & MorePrincipal Data Architect at Totalwine & More
Bruce LudwigBruce Ludwig
Merchandiser at Totalwine&speritsMerchandiser at Totalwine&sperits
Krishna Sandeep KalepuKrishna Sandeep Kalepu
Sr. Technical Lead at National Education Association, NEASr. Technical Lead at National Education Association, NEA
Tonia MooreTonia Moore
Senior VIEW Social Caseworker at City of Richmond Dept of Social ServicesSenior VIEW Social Caseworker at City of Richmond Dept of Social Services
Ranjith VaddeRanjith Vadde
Principal Data Architect at XeoMatrixPrincipal Data Architect at XeoMatrix