Senior Lead Data Engineer (SDE), with over fourteen years of engineering experience.
Hands-on experience in creating an Analytics tool from the ground up with Big Data technologies to provide insights to end user
Experience working with Real Time and Near Real Time data for the Monitoring tool to provide alerts, actionable insights and reduce troubleshooting time for customers
Hands-on experience migrating RDBMS solutions to Big Data solutions (Cassandra/Scala/Spark SQL).
Strong understanding and experience with Dimensional data modeling concepts like Star-Schema Modeling, Snowflake-Schema Modeling, Fact and Dimension Tables etc.
Comprehensive knowledge and experience in process improvement, normalization/de-normalization, data extraction, data cleansing, data manipulation.
Very strong in SQL coding and very good understanding of RDBMS concepts. Hands-on experience in creating, scheduling and maintaining the SQL jobs.
Overview
15
15
years of professional experience
Work History
Senior Lead Data Engineer
Vyopta Incorporated
06.2017 - Current
Leader for the Data development team which comprises 3 data developers and 2 QA engineers
Responsible and accountable for the delivery of the milestones set for the data team
Plan sprints for the team with a defined set of milestones
Work with the product team to come up with the roadmap features for the Analytics tool
Responsible for architecting and incorporating new features into the Analytics product
Using Scala to parse and load the various data files (JSON, XML and CSV) coming from multiple sources via Kafka streams into the cassandra staging database
Use Spark SQL to process the raw data and convert them into usable and actionable data into facts and dimensions so that the data can be visualized as Dashboard Panels, Summarized Datasets or Reports.
Replicate the data into PostgreSQL database for consumption from the user interface
Create and maintain the metadata and the Dashboard API layer to serve the UI
Worked on the migration project to convert the Analytics product from RDBMS to Big Data Solution to provide scalability and reliability with our growing customer base
Software Engineer (Data)
Vyopta Incorporated
10.2014 - 05.2017
Integral part of the "Development Team" responsible to create new user interfaces for the customers to interact with
Also responsible to create and maintain the back end database design and the ETL processes
Design and develop new innovative features and capabilities with the highest ROI into Vyopta's scalable cloud application suite
Embrace technical excellence and the shared responsibility for writing testable, high performance, maintainable code
Deliver working software weekly via iterative and incremental development
Excel in creative software, database and ETL design, and have strong technical expertise to quickly understand the Vyopta architecture, platform, and API services
Assist with client training and technical support as needed for Vyopta professional services, partners and clients
Create robust user interfaces for users to interact with.
Solutions Engineer
Vyopta Incorporated
07.2013 - 09.2014
Integral part of the "Consulting Team" and provide technical support to sales, customers as a field liaison
Will ensure that sales is given the necessary level of support by participating in and documenting technical discussion meetings between the sales team and prospective customers
Deploy video collaboration technologies and Vyopta software solutions to customers, both onsite and remotely as required
Provides pre-sale technical expertise, including technical presentations, demonstrations, technical training, application/network design, and other related activities supporting Vyopta Software Solutions
Support sales as a consultative subject matter expert and function as primary technical liaison for customers during the proposal stage of complex solutions regarding video collaboration
Works in conjunction with the sales team to help define customer requirements and needs
Collect technical related data for all complex services and communicates the information to Vyopta support team and developers
Prepare and present integrated network solutions and engineering specifications to management for qualified proposals based upon the customer's technical requirements, site requirements and needs
Prepares network documentation, technical documents and reports as required
Uses discretion to determine which procedures best address each situation, determines the appropriate action required and coordinates resolution with the customer
Provides timely and accurate reporting to the customer, sales, management and company executives during the presales, delivery and post sales process
Keeps appropriate records on all customer interactions and efficiently enters description of action taken into the appropriate system
Possesses and maintains expert knowledge of video collaboration and Vyopta software solutions used to support customer environment.
Software Developer
Quick Internet Software Solutions
02.2013 - 06.2013
Responsible to create version 2 of the claims management software using the Model-View-Controller (MVC) Concepts of the .Net frame work
Developed XML models that dynamically generate the C# classes that are required to perform the database connectivity
Developed XML views that dynamically render the web forms that the users work with
Also worked on the conversion scripts in SQL to convert the data from version 1 to version 2.
Software Engineer Intern
Wayne, A GE Energy Business.
05.2012 - 08.2012
Responsible to create a management tool using VB.Net to control the implementation and other functionalities of a White Listing Software
Developed a management tool using .Net 3.5 with VB as the front end language to perform the silent install and initial setup of the white-listing software on the POS software's
Developed tools using VB.Net to set the status (Enabled, Disabled and Update) of the white-listing software
Drafted all the related documentation for the developed tools
Performed the knowledge transfer to two development teams.
Software Consultant
3i InfoTech Asia Pacific Pte. Ltd.
05.2009 - 05.2011
Responsible to create intranet .Net web applications based on client requirements and provide continuous support and maintenance for the created applications
Was deployed with Phillip Securities Pte Ltd. Throughout this period involved in requirements gathering from the clients, understanding their business requirements and drafting those business requirements into a technical requirements specification that can be understood by the development team
Drafted the design specification document based on the user requirements and provided a pictorial representation of the design to the users
Developed web applications using .Net 1.1 or .Net 4.0 and created all database related objects using MS SQL Server 2000
All applications were in compliance with the user requirements
Performed manual testing on the applications based on the various test cases drafted during the development of the application
Helped with the integration testing, quality assurance testing and user acceptance testing
Drafted the implementation plan which was used by the implementation officer during the implementation of the created software packages in the live server
Created MS SQL DTS packages to extract data from flat files received from third party sources, transform the data to a usable format and to load the data into the databases
The packages were also used to generate excel reports and crystal reports that were sent to other systems
Added the MS SQL DTS packages into scheduled SQL jobs
Provided continuous support for all scheduled SQL jobs and for all the web applications developed
Was the team lead for 1 year, hence was responsible and accountable for work done by my subordinates
Responsible for allocating work and deadlines to subordinates
Performed constant code review for work done by subordinates
Resolved issues in the web applications within the stipulated time span of 2 hours.
Programmer Analyst
RR Sat Solutions Pvt. Ltd.
07.2008 - 04.2009
Responsible for creating internet and intranet web applications based on client requirements
Developed .Net based internet and intranet applications with MS SQL Server 2005 as the back end database
Tested the applications based on various test cases formed during the development of the applications.
Education
Master of Science in Management Information Systems -
Texas A&M University
College Station, TX
12.2012
Bachelor of Technology in Information Technology -
Anna University
Chennai, TN
05.2008
Skills
Scala
Apache Spark
Cassandra
MS SQL Server
PostgreSQL
C#
VB
Net
Oracle PL/SQL
Timeline
Senior Lead Data Engineer
Vyopta Incorporated
06.2017 - Current
Software Engineer (Data)
Vyopta Incorporated
10.2014 - 05.2017
Solutions Engineer
Vyopta Incorporated
07.2013 - 09.2014
Software Developer
Quick Internet Software Solutions
02.2013 - 06.2013
Software Engineer Intern
Wayne, A GE Energy Business.
05.2012 - 08.2012
Software Consultant
3i InfoTech Asia Pacific Pte. Ltd.
05.2009 - 05.2011
Programmer Analyst
RR Sat Solutions Pvt. Ltd.
07.2008 - 04.2009
Master of Science in Management Information Systems -
Texas A&M University
Bachelor of Technology in Information Technology -
Native Community Adviser/ Technical Assistant at Kauffman And Associates IncorporatedNative Community Adviser/ Technical Assistant at Kauffman And Associates Incorporated
Strategic Sourcing Contract Raw Material Buyer at Syensqo – Austin, TX | 2023 – PresentStrategic Sourcing Contract Raw Material Buyer at Syensqo – Austin, TX | 2023 – Present