Rohit Korra

Leading a team of Data engineers to maintain and enhance companies Enterprise Data Analytical Platform in GCP.

Developed a framework for custom Kafka consumers that can be configured using simple YAML files. Implemented dynamic transformations to extract specific fields from semi-structured Kafka messages based on table schemas. Utilized Keda for horizontal pod autoscaling of the custom Kafka consumers pods.

Leading the upgrade of crucial applications – Cloud Composer, Strimzi operators in K8, Confluent Cloud Kafka connectors and underlying container images to leverage cutting-edge features. Additionally, I'm orchestrating the migration of Kafka connector setups to helm charts for enhanced management and efficiency.

Led efforts for migrating our existing transformation framework from SQL statements in BigQuery to DBT, enhancing efficiency and maintainability. Also ensured robust security by implementing policy tags and dynamic data masking to protect sensitive PII data. Furthermore, I strengthened password security by utilizing the secret manager, enabling direct application access and enhancing overall data protection measures.

Leading GCP Cost optimization and significantly cutting expenses by pinpointing storage and computing anomalies. Designed reports and real-time alerts for immediate notification on exceeding thresholds, leveraging Cloud Monitoring and custom alerts.

Migrating Legacy Data warehouse in SQL Server to Google BigQuery and associated pipelines into Google Cloud Composer and Cloud Dataflow.

Led efforts to migrate Data pipelines in Airflow from On-prem machines to fully managed Google Cloud Composer. Contributed to building an in-house customer MDM solution using Cloud Dataflow.

Architecting data pipelines (batch and real-time) from a variety of source systems that include Salesforce Service Cloud, Adobe Analytics, Acxiom Customer Data Enrichment, Qualtrics, Totalwine's inhouse ERP, and e-commerce systems (FTP, SQL server, My SQL, Pubsub, Kafka).

Spearheading research and development efforts focused on Confluent Kafka and Strimzi in Kubernetes (K8) with the aim of establishing them as primary tools for real-time data integration into BigQuery. This involves in-depth exploration, optimization, and seamless integration to empower efficient and scalable real-time data flow into BigQuery for enhanced analytics and insights.

Led a team in pioneering our company's inaugural in-house data warehousing system on SQL Server leveraging Clover ETL and SSIS as our data integration tools. We seamlessly extracted data from diverse systems, channeled it into the staging layer, and proficiently constructed facts and dimensions. This strategic endeavor has not only streamlined data processes but also fortified our analytical capabilities for informed decision-making.

Created many inbound and outbound data integration pipelines using Clover ETL working with a variety of systems (Salesforce marketing cloud, Instacart, Acxiom). Integrated different kinds of sourch and destination systems including SFTP, REST API, Databases and Streams

Supporting and enhancing ERP systems (.NET applications). Building new modules in window applications and new web services to support these modules.

Worked as a production support engineer and helped maintain all internal ERP applications including window applications, web services, and SSRS reports

Working on creating SSRS reports on Item and Inventory management data and developing underlying data servi

Developing Mark out-of-stock module in .NET Windows application and underlying SOAP web service

Enhancing Inventory management module and demand forecast module in .NET web service and SQL stored procedures. Updating indexes to improve query performance.

Working with complex computer models/ programs, writing queries, develop and perform quality assurance tasks for commercial software, Requirements gathering, process flow analysis, requirements documentation, testing and implementation

Working in production support team and involve maintenance releases, hot fixes and Change requests