Engineering leader with 12+ years of experience in building highly scalable software and data products using distributed systems and big data technologies
5+ years of managing multiple teams of managers and team leads focusing on data engineering and data science
Proven ability to translate business requirements into data-driven solutions using machine learning algorithms like NLP, Logistic Regression, SVM, and Neural Networks
Solid understanding of distributed systems with experience in processing huge volumes of data using Kafka, Spark, and NoSQL databases
Experience in data analytics and business intelligence using Python and SQL
Strong experience in managing, hiring, and mentoring engineers and data scientists working to create an environment of curiosity, encouragement, and technical growth
Overview
12
12
years of professional experience
Work History
Director of Data Engineering
Spekit Inc
06.2022 - Current
Built the core data team ground up and managed multiple teams of 12+ engineers, and engineering managers responsible for developing data products at Spekit to enable value-driven insights and decision-making by optimizing our data systems and analytics
Built engineering processes from the ground up and set the vision for teams to support Product, Customer Success, and Sales to provide insights into customer behavior and make data-driven decisions
Built analytics data warehouse using dbt and customer-facing analytics platforms using Tableau and Explo
Designed and implemented Spekit-wide event tracking system using Segment to gain more insights into product usage and customer behavior
Developed a summarizer to facilitate just-in-time learning using LLMs for our flagship product
Built a personalized recommendation system using NLP and Neural hashing
Defined data strategy for the company and established data governance to achieve regulatory compliance per GDPR and CCPA
Hired and mentored high-caliber managers and engineers with diverse technical strengths and backgrounds across geographically dispersed team
Engineering Manager
Pattern Energy
03.2019 - 06.2022
Managed 3 teams of engineers, data scientists, and technical leads that developed and maintained data products thereby supporting internal teams and customers at Pattern Energy
Built a prediction model in Python using Logistic Regression, Random Forest, and Neural Networks to predict the probability of wind generation for specific regions with varying wind conditions
Built a text mining framework using NLP from incident logs to analyze failure conditions for wind turbines
Improved the forecasting method to predict net megawatts generated across all wind farms by 10% using SVM best tuning and Quantile Regression Forest
Developed a real-time data processing solution to process extensive volume data from SCADA systems in globally located wind turbines to power analytics dashboard and provide the executive management with metrics like MWh production and revenue generation using Kafka, KStreams, and HBase
Designed and developed multiple data pipelines to collect, process, and persist the data required for various data science, data engineering, and analytics projects
Implemented data infrastructure required to manage various infrastructure components like Kafka, EMR, and ECS in AWS
Built multiple ETL jobs from various sources to power our data warehouse (Snowflake)using Airflow
Lead Engineer
Financial Systems, Pattern Energy
03.2017 - 03.2019
Studied and optimized market funding programs by creating a statistical model (in Python ) using exponential curve and Monte Carlo Simulation to estimate the probabilities of exceeding budgets
Designed and developed a batch data pipeline to process IoT data to power analytics dashboards using Kafka, Spark, and Snowflake
Developed a portal that processes data by creating cluster nodes on the fly using Spark and Ansible in AWS
Integral part of the project team that was responsible for financial systems re-implementation at Pattern Energy
Senior Engineer
Pattern Energy
07.2014 - 03.2017
Designed and developed an analytics engine to process financial events using Java, Hadoop, and MapReduce
Implemented new technologies using Power Automate and Power BI to automate financial reporting that saved around 5000 hours annually for end users
Completed SOX process documentation to comply with internal and external data governance guidelines
Software Engineer
Cisco Systems
02.2012 - 07.2014
Automated ETL processes, making it easier to wrangle data and reducing latency between systems
Formulated approaches for automation and optimization of data reporting workflows, resulting in 80% reduction in manual data input
Created SQL scripts to extract and reshape data in alignment with business needs, leading to a remarkable 95% enhancement in accuracy
Developed interactive dashboards to provide crucial performance trends and insights
Software Engineer
Sempra Energy
09.2011 - 12.2011
Created analytics dashboards in OBIEE by translating business requirements into technical solutions
Education
Master of Science - Computer Science
Southern Polytechnic State University
Atlanta, GA
07.2011
Bachelor of Engineering - Electrical & Electronics
CMR Institute of Technology
Bangalore, India
05.2009
Skills
LANGUAGES: Python, Java
DATA PLATFORM: Spark, Kafka, Hadoop, Hive, Presto
DATABASES: Cassandra, HBase, Redis, Oracle, MySQL
DATA SCIENCE: Regression, Logistic Regression, Random Forest, Neural Networks, SVM
ML FRAMEWORK: Keras, PyTorch, TensorFlow, AutoViML
Timeline
Director of Data Engineering
Spekit Inc
06.2022 - Current
Engineering Manager
Pattern Energy
03.2019 - 06.2022
Lead Engineer
Financial Systems, Pattern Energy
03.2017 - 03.2019
Senior Engineer
Pattern Energy
07.2014 - 03.2017
Software Engineer
Cisco Systems
02.2012 - 07.2014
Software Engineer
Sempra Energy
09.2011 - 12.2011
Master of Science - Computer Science
Southern Polytechnic State University
Bachelor of Engineering - Electrical & Electronics