Radhika Ganapathi
Senior Manager, Data Engineering
River Vale,NJ
Summary
Motivated, energetic, and meticulous project lead/data engineer senior specialist with strong communication skills and extensive experience in Big Data, Data Engineering, and Data Science. Proficient in executive reporting with Power BI and data governance. Possessing over 15 years of software development experience in the Microsoft suite of technologies, I have a deep understanding of Azure cloud solutions architecture and a working knowledge of Azure stack. Furthermore, I have more than 20 years of experience with diverse data frameworks and solutions.
Overview
29
29
years of professional experience
14
14
Certifications
Work History
Senior Manager, Data Engineering
Nasdaq
01.2024 - Current
- Worked as a lead data engineer, cloud architect and technology operations manager for several RISK systems in Nasdaq
- Worked on architecting and provisioning a secure ETL cloud solutions for Risk teams across Nasdaq
- Proposed architecture and implemented solutions incorporating Self Hosted Integration Runtime within an Azure Virtual network with express route connectivity to on-premises networks
- Worked on building ETL automation data flows, data pipelines using Azure Data Factory for various data transformation and load activities
- Experienced in building reports and dashboards using MSFT Power BI
- Familiar with using tools like DAX Studio/ Tabular Editor for analyzing performance
- Worked on provisioning and configuring MSFT Purview for data governance and data lineage for our cloud infrastructure
- Experienced in provisioning cloud resources using Terraform
- Experienced in building CICD pipelines using Azure Dev Ops for various deployments like azure functions, azure Sql databases, azure data factory
- Experienced in building Azure functions, Power apps and Power automate flows
Lead Data Engineer
Nasdaq
05.2023 - 01.2024
- Build a secure cloud infrastructure and ETL solution to monitor Nasdaq’s clearing risk liquidity at risk models
- Key metrics include liquidity at risk (highpoint, worst individual, defaulters, cash collateral callbacks), treasury portfolio, clearing capital, collaterals, margins & positions
- Build data pipeline automations using Azure Data Factory, configure triggers, configure alerts for monitoring failures of activities
- Build the database schema, tables, views and stored procedures in Azure SQL database
- Build Power BI analytics reports/dashboards based on the data collected in azure cloud, provision reports in the power bi service, configure refreshes
Senior Data Engineer
Nasdaq
07.2022 - 05.2023
- Worked on migration of counterparty and credit risk dashboards from legacy system to Power BI
- Built necessary data models, bookmarks, relationships in Power BI, configured refreshes and configured alerts
- The dashboard comprises of a multi tabbed report with key metrics like top risks, global exposures, treasury investments, credit watch, credit scores, bankruptcy lists to name few
- Worked on building a Power App for D&B Searches which uses a database driven backend
Senior Data Engineer
Nasdaq
01.2021 - 07.2022
- Build a secure cloud infrastructure and ETL solution to monitor Nasdaq’s enterprise risk metrics
- Key metrics include incidents, issues, control assessments, top risks… to name a few
- Build data pipeline automations using Azure Data Factory to extract and transform data from internal systems like BWise, Assurance to name a few
- Provision a cloud instance of sql server/db and create database schema, tables, views and stored procedures
- Build Power BI analytics reports/dashboards based on the data collected in azure cloud, deploy reports in the power bi service, configure refreshes
- Consolidated data in the Azure cloud from a variety of data sources like on premise sql databases/data warehouse, various API methods, FTP methods
- Build Power BI reports/dashboards for incidents, issues and actions, risk control assessment heatmaps, control assessments, business continuity datasets to name a few
Sr Software/Data Engineer
Crestron Electronics
08.2014 - 09.2020
- Built dashboard displaying various metrics and KPI like current messages processed, device usage metrics and historical statistics for room usage data and various other stats using Power BI
- Created a customer portal to deliver the dashboard, reports, and stats to the customers
- Worked on writing an Azure Durable function and implemented the orchestrators and activities
- This job powers one of our internal dashboards to display various statistics
- It accesses Azure Cosmos DB/Azure Search Indexes to collect information about Device Summary, Feature Usage, Air Media Usage, Network Statistics, Display Statistics, Calendar and Fusion Statistics etc
- Created an internal dashboard to show the feature usages for all our supporting device models in XiO Cloud, as well as an internal dashboard for all the residential customer data who use the Crestron Pyng devices
- Enhanced POWER BI Visualizations with additional filters, which involved UTC Time conversions
- Took a deep dive into Power BI DAX formulas to accomplish this functionality
Architect & Lead Developer
Crestron Electronics
02.2018 - 06.2018
- Built scalable solution that comprised of a custom library wrapper for the Azure Cosmos Change Feed (using the ChangeFeed Processor Host)
- Architected a service fabric application that is a container of multiple micro-services each of which is a subscriber to the Change Feed for Azure Cosmos DB collections
- The Service Fabric application invokes the custom library for Azure Search Indexes using which the documents are indexed
Lead Data Engineer
Crestron Electronics
09.2017 - 02.2018
- Designed a Big Data processing solution for our XiO Cloud system and aggregated Device telemetry data from Azure Data Lake, reference data from Cosmos DB, and stored processed data into Azure SQL DB using Scala
- Aggregated data using Apache Spark Analytical window functions
- Stored the summary data into Azure SQL DB and built Power BI reports & dashboards for customers
Development Lead
Crestron Electronics
06.2017 - 09.2017
- Built Data & API services for XiO Cloud which is Crestron's cloud-based provisioning and management solution, allowing customers to view status, push settings, manage licenses, and update firmware
- Developed backend services for XiO Cloud Portal that has a Customer facing, Dealer facing and a Crestron Facing side
- In the Customer Facing side, we allow users to push settings to the customer owned devices
- In the Crestron facing side, we allow the creation of global admin accounts and creation of users with roles as either Crestron Managers/Crestron Support
- In the Dealer facing side, we allow dealers to manage their linked customer accounts with impersonation functionality and branding
Architect/Development Lead
Crestron Electronics
06.2016 - 06.2017
- Wrote the web socket communication layer between Amazon Echo & Google Home requests and Crestron control systems by building a service bus request queue to process requests
- Completed Amazon Echo implementation by November 2016 and approximately 1500 pilot users are using it
- Completed Google Home implementation by June 2017
Lead Developer
Crestron Electronics
01.2015 - 03.2016
- Designed and developed a RESTful web service servicing PinPoint mobile UI application
- PinPoint Service communicates with a backend Scheduling provider like Exchange/Google and has interfaces that support retrieval of available conference rooms, appointments in these rooms, assets in these rooms, configurations etc
- Built an authorization/authentication module that uses Active Directory
- PinPoint services can be deployed on both on-prem environments as well as cloud infrastructure
Lead Developer
Crestron Electronics
09.2014 - 01.2015
- Fusion is a monitoring and scheduling software that includes network room scheduling, device monitoring, data collecting and reporting
- Worked on building the middle tier for processing some signals with a certain threshold and forwarded them to an external web service
- Built configuration feature for these forwarding rules in Fusion
- For example, when the signal for ‘MakeUp Room’ is triggered, to send the signal to a service that is separately configured to process requests
Senior Developer
Hudson News Group
08.2008 - 08.2014
Developer
Indus Consultancy Services
06.2004 - 07.2008
Developer
Mortgage.COM
09.1999 - 06.2001
Developer
Salomon Smith Barney
08.1998 - 09.1999
Developer
New York Life Insurance Company
07.1996 - 08.1998
Education
M. S. - Computer Science
Computer Science, NJIT
Newark, NJB. S. - Electronics and Communications
Electronics and Communications, B.M.S College of Engineering
Objective C programming course
NJIT
Web Design and Architecture – Ruby On Rails course
Coursera
Certificate in JavaScript
Certificate in Java programming
Python Fundamentals
Python for Data Analysts
Building Regression Models with Scikit learn
Pandas Fundamentals
Advanced Pandas
Building Clustering Models with Scikit learn
Skills
Azure HDInsight
Azure SQL
Azure SQL Data Warehouse
Azure Databricks
Azure Data Lake Store
Azure Cosmos DB
Azure Cloud services
App services
API management tools
Service bus
IOT hub
stream analytics
Azure Functions/Web Jobs
Azure Search Service
SCALA
Python
Power BI Services
Data Visualizations
undefinedCertification
Objective C programming course offered by NJIT
Awards Accomplishments
- Crestron Electronics, 12/01/18, Received ‘Achievement in Design Excellence’ award for successful implementation of Big Data solution with visualization using Power BI dashboards and reports for Enterprise Software department.
- Nasdaq, Recipient of several DAQ (Delivering awesomeness with quality) awards from my manager, customers and co-workers.
Timeline
Senior Manager, Data Engineering
Nasdaq
01.2024 - Current
Lead Data Engineer
Nasdaq
05.2023 - 01.2024
Senior Data Engineer
Nasdaq
07.2022 - 05.2023
Senior Data Engineer
Nasdaq
01.2021 - 07.2022
Architect & Lead Developer
Crestron Electronics
02.2018 - 06.2018
Lead Data Engineer
Crestron Electronics
09.2017 - 02.2018
Development Lead
Crestron Electronics
06.2017 - 09.2017
Architect/Development Lead
Crestron Electronics
06.2016 - 06.2017
Lead Developer
Crestron Electronics
01.2015 - 03.2016
Lead Developer
Crestron Electronics
09.2014 - 01.2015
Sr Software/Data Engineer
Crestron Electronics
08.2014 - 09.2020
Senior Developer
Hudson News Group
08.2008 - 08.2014
Developer
Indus Consultancy Services
06.2004 - 07.2008
Developer
Mortgage.COM
09.1999 - 06.2001
Developer
Salomon Smith Barney
08.1998 - 09.1999
Developer
New York Life Insurance Company
07.1996 - 08.1998
B. S. - Electronics and Communications
Electronics and Communications, B.M.S College of Engineering
Objective C programming course
NJIT
Web Design and Architecture – Ruby On Rails course
Coursera
Certificate in JavaScript
Certificate in Java programming
Python Fundamentals
Python for Data Analysts
Building Regression Models with Scikit learn
Pandas Fundamentals
Advanced Pandas
Building Clustering Models with Scikit learn
M. S. - Computer Science
Computer Science, NJIT
Similar Profiles
AVANICA CHRISTIANAVANICA CHRISTIAN
Software Engineer in Test at NASDAQSoftware Engineer in Test at NASDAQ
RITESH PATNERITESH PATNE
Quality Assurance Analyst at NasdaqQuality Assurance Analyst at Nasdaq
Felipe SodreFelipe Sodre
Technical Team Lead at NasdaqTechnical Team Lead at Nasdaq
Mahesh Vidyadhar PhadtareMahesh Vidyadhar Phadtare
Account Specialist at NasdaqAccount Specialist at Nasdaq
Cheryl RybackiCheryl Rybacki
Executive Administrative Assistant at Englewood Hospital Medical CenterExecutive Administrative Assistant at Englewood Hospital Medical Center