Ananda Harihara Shivamurthy
Marlborough,MA
Summary
- Highly motivated, innovative Lead Data Engineer with 13 years of extensive technical knowledge in Data engineering ( ETL/ELT, Data modelling and data warehouse)
- Experience with dimensional and fact data modeling.
- Familiarity with financial domain in risk asset management.
- Highly recognized for great system performance improvement skills.
- Design and Development of batch data processing. Fair knowledge of stream processing.
- Enthusiastic professional with a high degree of commitment to succeed. Works well in the team environment under tight deadlines and rapidly changing priorities.
- Provides technical consulting to application development teams during application design and development for highly complex or critical projects
- Experience in leading team of 6 developers with end to end project delivery from design to implementation.
Overview
14
14
years of professional experience
1
1
Certification
Work History
Principal Consultant
Oracle Financial Services Inc
06.2019 - Current
- Lead, Design and Development of end to end pipeline for Enterprise Exposure Reporting using AWS Databricks ( Fund of Fund look though engine) for SSGA client that gets data from 20 different data sources. Improved overall performance of this pipeline by 50% by optimizing spark code .
- Implemented Investor Voting Choice look through engine for SSGA client using Cloudera Hadoop and its now migrated to Databricks .
- Design and implementation of ESG data onboarding for CASH and FI asset classes for SSGA risk analysis.
- Leveraged Spark SQL , Dataframes and Graph frames ( hierarchical data traversal) for data transformation on hadoop and databricks.
- Dimensional and fact data modelling in databricks lakehouse and Redshift database.
- Implementation of Change Data Capture on data lake.
- Provided technical expertise and created software design proposals for upcoming components
- Expert in python to parse data and handling data flow across entities using python. Developed framework for interaction with databricks using Rest API's for on premise code components.
- Designed and implemented delta and incremental loads through out
Senior Consultant
Oracle Financial Services Inc
06.2016 - 05.2019
- Designed and built a data warehouse solution for back-office operations of State Street Global Advisors which analyses the financial Risk using historical data
- Designed/implemented multiple complex and big data ETL processes using Java/Python/Hadoop and AWS to load data into the data warehouse to facilitate downstream analytics and reporting
- Implemented In-House Risk based performance attribution calculation for 400+ active equity funds
- Coordinated and mentored a development team of 6+ members (onsite-offshore model) using Agile (Scrum) methodologies
- Defined and implemented best practices within team and has given several technical presentations and demos to other teams to help them adopt the set practices.
- Interacted and coordinated with multiple technical teams and business across multiple geographies to collect functional/technical requirements and providing product demos
- Implemented multiple migration activities like Hadoop migration/AWS migration, IBM Netezza to RedShift migrations.
Associate Consultant
Oracle Financial Services Software Ltd
10.2012 - 05.2016
- Worked as a Full Stack Developer for EC financing team in State Street using Java/Spring frameworks, oracle stored procedures/sql. Involved in various activities from requirements gathering, design and implementation.
- Worked as Developer on a cloud migration project in which multiple applications were ported to SaaS/PaaS and IaaS Cloud implementations. Activities includes profiling the existing applications to come up with an estimate and then identifying and defining a strategy to migrate the applications. Migration involves complete/partial rewrite of the application code.
Associate Software Engineer
Torry Harris Integration Solutions
08.2010 - 10.2012
- Developed SOAP based web services using CXF framework.
- Worked on enhancement of modules in event based system that used Publisher, JMS Provider (IBM MQ) and Subscriber
- Write unit test cases using Junit and code quality checks using Mockito
- Worked at client site for major releases that involved extensive client interaction
Education
Bachelor of Engineering in Computer Science - Information Technology
Bapuji Institute of Engineering And Technology
Davangere, India06.2009
Skills
- Python, Java, Bash scripting
- Bigdata, Hadoop ( Hive, Map Reduce, Oozie, Hbase)
- Spark, Pyspark
- Python Pandas and Numpy libraries for data transformation
- Databricks (AWS/Azure)
- AWS cloud ( EC2, Lambda, S3, Athena, Glue, EMR, Redshift)
- Azure cloud ( Azure data factory, ADLS)
- Data Engineering, Advanced Analytics, Risk Analysis
- SQL, Stored Procedures and Functions on Oracle and MSSQL
- Advanced SQL, Data modelling for data warehouses ( Netezza, Redshift)
- DEVOPS - GIT, Bit Bucket, Maven , Gradle
Certification
- Spark Programming in Python - O'Reilly
- Databricks Certified Associate Developer for Spark 3.0
- Databricks Certified Data Engineer Associate
- Certified Big Data Professional - Trendy Tech
Timeline
Principal Consultant
Oracle Financial Services Inc
06.2019 - Current
Senior Consultant
Oracle Financial Services Inc
06.2016 - 05.2019
Associate Consultant
Oracle Financial Services Software Ltd
10.2012 - 05.2016
Associate Software Engineer
Torry Harris Integration Solutions
08.2010 - 10.2012
Bachelor of Engineering in Computer Science - Information Technology
Bapuji Institute of Engineering And Technology