BALASUBRAMANYAM VR
San Ramon,CA
Summary
Sr Data Engineer and Manager with over 15 years of IT experience in Analysis, Design, Development, and implementation of highly scalable systems. Effective communicator with strong leadership, interpersonal and problem-solving skills, able to drive cross- functional collaboration and work closely with stakeholders at all levels. Extensive knowledge in Programming, Big Data technologies, Cloud platforms, ETL tools, data warehousing, data modeling, and data governance.
Overview
16
16
years of professional experience
1
1
Certification
Work History
Sr. Data Engineer, Tech Lead
Kaiser Permanente
12.2021 - Current
- Defined the new ETL Architecture at Intapp with Python, AWS and Airflow as new tech stack
- Integrated cloud and web applications like Azure Cost management, Pendo, Aha, Hubspot, Workday, OnePlace
- Cloud etc via APIs with Redshift DWH
- Lead the deliverables of data solutions and coordinate with stake holders
- Manage a team of data engineers responsible for building and maintaining data pipelines, ETL processes and data architectures to support business objectives
- Big Data/Data Engineering
05.2017 - 11.2021
- Design scalable data flows and create technical design documents and present solutions to the executives
- Led the development activities in the Hadoop Big data eco system on Azure using Scaled Agile methodology and coordinated with Product Managers, Business Analysts, QA Team etc
- Developed scalable ETL pipelines using Spark SQL/Dataframes, Data Engineering, Azure Datafactory ETL tools and SQL queries
- Implemented processes to handle scheduling using Kafka and file archival activities using Spark
- Git hub/Jenkins for code migration and data validations, Hadoop Yarn for debugging and resource management
- Hands on coding using ETL Informatica Powercenter, writing complex SQL queries and used data profiling tool to profile source systems
- Handled major database migration projects.
ETL Tech Lead / Architect
DentaQuest
05.2015 - 04.2017
- Built Data warehouse environment from scratch on SQL server with Stage layer, Dimension layer and Fact layers
- Designed the end-to-end data flow for full, incremental loads and archival process that had complex business requirements and tight SLA
- Led the development efforts with a huge team of 40 offshore developers building ETL flows using Informatica
- PowerCenter on SQL server
- Handled the project smoothly that had the attention of executives due to massive work and tight deadlines.
ETL Tech Lead and Onsite Project Coordinator
Wellmark BCBS
08.2014 - 04.2015
- Hands on development writing complex Teradata SQL queries and ETL transformations using Informatica
- Powercenter to implement business logic
- Created Korn shell scripts to schedule informatica jobs to run Daily, weekly and Monthly with Full and
- Incremental loads
- Applied performance optimization techniques such as pushdown optimization, Fast load, query tuning to improve the performance of the overall flow
- Coordinate with Offshore development team, QA team, Business analysts and Project managers.
Mainframes and ETL Developer, Team Lead
Target corporation
08.2007 - 07.2014
- Managed a team of 10 members at Onsite and 6 members at a nearshore location as a team lead
- Worked with retail business analysts and Business users closely to identify and document requirements
- Developed retail Supply chain applications on mainframes using Cobol, JCL, DB2
- Developed ETL pipelines using Informatica for data transfer from DB2 to Oracle database
- Supported complex and time critical applications like Order Management, Replenishment, Supply Distribution
- Management as an SME and technical consultant
- Formed a team to clear application backlogs and developed alert mechanisms to monitor applications that reduced of issues that otherwise cost huge amounts to the client
Education
M.Tech - Computer Aided Design and Manufacturing
Vellore Institute of Technology
Tamil Nadu, India2007
B.Tech - Mechanical Engineering
Sri Venkateswara University
Andhra Pradesh, India2005
Skills
- Programming: Python, Scala, Spark Shell, Shell scripting
- ETL Tools: Informatica Powercenter, Data Engineering Tool, Azure Data Factory, Talend
- Relational DBs: Redshift, Hive, Oracle, Teradata, SQL server, DB2
- Semi Structured: Apache HBase, JSON, CSV, XML
- File system and Storage: HDFS, S3, Azure datalake storage
- Other tools: Airflow, Kafka, Jenkins, Git, Yarn
- Cloud environments: AWS, Azure
- Other programming Languages: PL/SQL, Java, Cobol
Accomplishments
- Defined new architecture and technology stack at Intapp and created robust ETL process that significantly improved efficiency and performance
- Built dataflow on Hadoop eco system using Spark and ETL tools for Mobile application for Kaiser Healthcare that’s heavily used for decision making by leaders at the organization
- Successfully executed a major database migration from Teradata to Oracle Exadata by maintaining the stability and performance resulting in significant cost savings for the organization
- Built a complex Datawarehouse with scalable design from Scratch for DentaQuest, providing comprehensive view of Claims, Authorizations etc of the customers they serve
- Developed and enhanced critical supply chain applications for Target retail stores using Mainframes.
Certification
AWS Certified Solution Architect- Associate
Spark and Hadoop Developer
AWS Certified Developer Associate
Java SE 7 Programmer I
Certified SAFe 5 Agilist
Timeline
Sr. Data Engineer, Tech Lead
Kaiser Permanente
12.2021 - Current
05.2017 - 11.2021
ETL Tech Lead / Architect
DentaQuest
05.2015 - 04.2017
ETL Tech Lead and Onsite Project Coordinator
Wellmark BCBS
08.2014 - 04.2015
Mainframes and ETL Developer, Team Lead
Target corporation
08.2007 - 07.2014
M.Tech - Computer Aided Design and Manufacturing
Vellore Institute of Technology
B.Tech - Mechanical Engineering
Sri Venkateswara University
Similar Profiles
Marie A. StevensonMarie A. Stevenson
Patient at Patient FinancialAdvisor, Kaiser Permanente Eligibility and FinancialServices, FinancialAdvisor, Kaiser PermanentePatient at Patient FinancialAdvisor, Kaiser Permanente Eligibility and FinancialServices, FinancialAdvisor, Kaiser Permanente
Edith NagunaEdith Naguna
Special Needs Program Care Mgt RN Consultant at Kaiser Permanente - Southern California Permanente Medical GroupSpecial Needs Program Care Mgt RN Consultant at Kaiser Permanente - Southern California Permanente Medical Group
MICHAEL NAVAMICHAEL NAVA
Area Director at Kaiser Permanente – The Permanente Medical GroupArea Director at Kaiser Permanente – The Permanente Medical Group
Diana IovescuDiana Iovescu
Program Manager III- Centers for Reproductive Health/IVF at Kaiser Permanente- The Permanente Medical GroupProgram Manager III- Centers for Reproductive Health/IVF at Kaiser Permanente- The Permanente Medical Group
Yesenia Yadira OchoaYesenia Yadira Ochoa
Pre-Op / OR / PACU Nurse at Aesthetic and Reconstructive Plastic Surgery Medical Associates ARPSMA.Pre-Op / OR / PACU Nurse at Aesthetic and Reconstructive Plastic Surgery Medical Associates ARPSMA.