Acted as team leader in group projects, delegating tasks and providing feedback.
Primary developer in building POC that handles data movement from on-prem databases to cloud using Scala/Akka technology.
Led design, and development of integrated application that ingest historical and incremental data from on-prem Netezza data warehouses into Snowflake using primarily Java with supporting tools and utilities in Python.
Led team in developing ingestion application that consumes Guidewire S3 CDA bucket to Snowflake via on-prem feeder system using Python.
Led data migration team that operates on 24X7 comprising of 10-12 resources located across continental US and India.
Principal engineer in development of backend application that detects Python vulnerabilities via Jfrog Xray watcher, deeper scanning and management of DBT (via gitlab) components, Snowflake stored procedures and user-defined functions for vulnerabilities and violations.
Developed numerous POCs relating to streamlined data ingestion, parallel executions, generic flattening processes, data lineage and other relayed activities.
Designed and written backend application that automatically syncs up Snowflake source and target data points using primarily Scala and Akka as tactical solution while another team is working on finalizing Informatica-based option.
Currently part of select team that conducts in-depth analysis and proof of concepts on ETL/ELT tools, particularly: Fivetran, SnapLogic and Informatica Cloud. Assigned use-case is Confluent KAFKA as source and target – which consequently led to development of custom generation of fake events using Python and related libraries such as Faker.
Currently building generic CLI utility that supports kafka-related activities such as creation of topics, registration of schemas, generation of fake events for a topic and others.
Personal project: Development of IT certification test simulator platform using Scala, Akka, Slick, Javascipt, React-JS, HTML, CSS, Postgres, and DevExtreme libraries.
Personal project: Developed a data hub PoC where source and target databases meet. Choice of technologies is wide open. Tech stack includes: Scala, Akka, Play, Slick, Javascript, React-JS, Scala-JS, Slinky, HTML-5, CSS, popular OLTP and NO-SQL databases.
Mentored junior team members in best practices for software development, code optimization, and troubleshooting techniques
Spearheaded efforts to migrate legacy systems onto cloud-based platforms, resulting in improved scalability and costefficiency
Contributed significantly towards setting up an automated monitoring mechanism using state-of-the-art technologies and tools, which led to proactive issue identification and resolution
Evaluated emerging technologies and tools to identify opportunities for enhancing existing systems or creating new ones
Collaborated with cross-functional teams to define requirements and develop end-to-end solutions for complex data engineering projects
Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability
Developed custom algorithms for efficient data processing, enabling faster insights and decisionmaking
Reduced operational costs by automating manual processes and improving overall data management efficiency
Participated in team projects, demonstrating an ability to work collaboratively and effectively
Proven ability to learn quickly and adapt to new situations
Acted as a team leader in group projects, delegating tasks and providing feedback
Worked effectively in fast-paced environments
Worked flexible hours across night, weekend, and holiday shifts
Proven ability to develop and implement creative solutions to complex problems
Applied effective time management techniques to meet tight deadlines
Contributed to internal activities for overall process improvements, efficiencies and innovation
Enhanced system performance by designing and implementing scalable data solutions for high-traffic applications
Reengineered existing ETL workflows to improve performance by identifying bottlenecks and optimizing code accordingly
Optimized data pipelines by implementing advanced ETL processes and streamlining data flow
Compiled, cleaned and manipulated data for proper handling
Sr Data Engineer
Choice Hotels International
10.2015 - 06.2019
Act as manager on special projects involving deeper technical know-how: Activities include assigning, following-up tasks on entire team and reporting to higher management
Perform administration activities of 6-node Vertica database, ensuring smooth operations while maintaining overall performance at acceptable level
Implemented database backup and restore procedures, including specific object replication processes
Led extraction development effort on data sources requiring more intense business logic
Development of internal tools and utilities such as data replication across clusters, dynamic Omniture Clickstream url parsing, etc.
Maintain database clusters, ensuring data is well balanced among participating nodes.
Provide support to developers and analysts on their access and data needs.
Enforce coding standards, code deployment and other Release Management practices.
Development of various monitoring scripts to ensure overall health of database is maintained such as disk usage, active monitoring of long running sqls, health of Vertica cluster, etc.
Developed Vertica license utilization monitoring tool in Scala/Akka, sending notifications to table owners and auto-revocation of some privileges of repeat offenders.
Written various UDXs (in Java, Scala, and C++) such as dynamic table privilege grants, on-demand url parsing, database designer programatically, etc.
Architected and developed lightweight extension that enables user to initiate DBD on a table level via client tool (vsql, Db Visualizer) in one go using Scala.
Automated Vertica weekly/daily full and incremental backups using bash/vbr.
Built automated Linux system performance data gathering tool using Scala, Akka, and Activator.
Built automated Vertica load test by simulating sql execution with varying virtual users in multi-threaded fashion using Java.
Development of custom object replication utility (using Java) that allows end-users to clone tables to other Vertica environments within a client tool such as Db Visualizer or via vsql.
Led migration effort of entire Vertica cluster to new set of servers.
Development of Vertica to Hive/Impala ingestor - using Java, Spring Framework, Apache Spark, Hive technologies.
Written Vertica to JSON file converter into Amazon S3 storage utilizing Scala and Apache Spark.
Developed tool to load S3 JSON file into Hive table in parquet format in Scala and Apache Spark.
Written tool that scrubs numerous files in Amazon S3, getting rid of unwanted characters and other housekeeping activities using Scala and Akka.
Written daily feed process to Medallia, combining LDAP user information and some other hotel-specific data utilizing Apache Spark in Java, and Spring Framework.
Architected migration process of BI group from Vertica environment to Cloudera/Amazon cloud infrastructure.
Developed generic database extractor and replicator that moves data across several database types – initially to cater Hive/Impala, Redshift, Vertica and Amazon S3 sources and/or destinations. Tool was written in Scala and Apache Spark.
Re-wrote SQL Load Simulator in Scala and Akka that was utilized to test performance of Vertica VS Redshift on Amazon Cloud/AWS.
Independent Consultant
Results Positive/Express Software
05.2009 - 10.2015
Managed client engagements, ensuring deliverables are met on timely manner. Activities include: assignment of tasks to team members, follow ups, quality assurance and reporting project status/progress to customer stakeholders and sponsors.
Installation, configuration and support of Vertica databases including development of custom UDx functions using C++.
Developed a custom ELT (Extract Load Transform) process (written in Java) that loads data from Oracle and SQL Server to HP Vertica database on batch mode and near real time fashion.
Assisted BI team by supporting Vertica and Oracle databases in their solution development efforts.
Scripted backup and restore procedures for Oracle and Vertica databases.
Perform administration functions such as user management, performance monitoring, query optimizations, etc.
Activities include database administration and development and transporting sql scripts and building custom functions and procedures into Vertica.
Creating and fine-tuning projections, views and other related activities.
Installation and configuration of Oracle databases housing different customers’ software application needs.
Installation and configuration and support of Business Objects for customers’ reporting requirements.
Application performance tuning, including tweaks in Linux kernel parameters, Oracle init parameters, JVM, and sql-specific.
Architected major customization that sits on top of HP PPM Deployment application. This custom module enables developers to launch creation of deployment packages via custom web UI that auto-populate deployment package with its associated components or objects in change request.
Led design and development of Capacity-Based Resource planning module on top of HP PPM Project Management. One of primary features is automatic scheduling of resources on assigned tasks based on current and future assignments, taking into consideration weekends, holidays and his/her regional and personal calendars. This also includes simulation module allowing managers to peek overall resource capacity and assignments over given future period without necessarily persisting back to database.
Built General Ledger integration component with HP PPM Financial Management module using Java/Axis web services technologies. Incoming GL data are fed daily into staging area that java/axis SOA client will process and post to PPM Financials System.
Designed and developed custom components within HP PPM’s Resource Management module for better and more flexible user interface.
Led implementation, configuration and integration of HP PPM enterprise application at various customer sites. Provided level 3 customer support following go-live.
Led development of PoC components, including integration work that customers require.
Provided product demonstrations to various prospects/customers - engaging active discussions on areas related to product functionalities and capabilities.
Led meetings, discussions among various customer players including DBAs, developers, and stake holders - discussing areas relating to change processes, approvals, securities and other related topics.
Prepared statement of work (SOW) for various customer professional engagements for areas relating to HP Deployment Management implementations.
Re-engineered HP PPM built-in deployment object types to implement strict SOX requirements – ensuring tight security is embedded in any form of server to server interactions.
Mentored junior consultants within the team, contributing to their professional development and growth as independent consultants themselves
Liaised with customers, management, and sales team to better understand customer needs and recommend appropriate solutions
Created and managed project plans, timelines and budgets
Prepared presentations to explain revisions, enhancements and process improvements of organization's systems and programs
Delivered outstanding service to clients to maintain and extend relationship for future business opportunities
Enhanced client satisfaction by providing tailored solutions to their unique business challenges
Frequently inspected production area to verify proper equipment operation
Reviewed internal systems and organized training plans to address areas in need of improvement
Devised and implemented processes and procedures to streamline operations
Facilitated change management initiatives within client organizations, minimizing resistance and maximizing adoption rates
Supported clients during periods of transition, ensuring seamless integration of new systems or policies
Led training sessions for client staff members to improve skillsets and enhance overall performance
Developed effective improvement plans in alignment with goals and specifications
PPM Principal Consultant
Hewlett Packard Enterprise
06.1998 - 05.2009
As engagement manager, prepare project plans, follow-ups, and provide status reports to customer stakeholders and sponsors.
Responsible for clustered-installation, configuration of HP PPM software at various customer sites. Research, design, advice and development of various HP PPM solutions and extensions, such as configuration of workflows, request types, and other PPM-centric components.
Built various integration components using AXIS web services framework for customers for Peoplesoft integration, and other custom applications.
Built custom portlets using JSR-168 technology and PPM-centric capability.
Implemented automated software environment provisioning and cloning system that handles requests and actual build of whole system to support Pre-Sales for their demo needs.
Performance assessment and optimization at customer’s HP PPM installations covering various tweaks from OS kernel settings, Oracle parameters, PPM parameters, JVM settings, SQL optimization, process-re-engineering, etc.
Development of scripts to perform various database administrative activities such as creation/modificaton of various database objects, de-fragmentation, etc.
Performed integration work on SSO, SSL, LDAP and other related technologies.
Load simulation and tuning activities surrounding PPMC environments/components.
Responsible for implementation of HP’s Deployment Management module (aka Kintana) at various customer sites.
Built integration components of PPMC with external systems such as Documentum, Oracle EBS, SVN, PVCS, VSS, GIT, etc.
Configuration of PPM object type components that handle automated deployments to target environments (DEV to QA to PROD).
Implementation of archiving and purging processes surrounding HP PPM software.
Development of numerous graphical portlets using 3rd party tools and utilities.
Development of various PPMC initiatives and offerings.
Performed upgrades of PPM software to later versions.
Implemented innovative solutions to address challenges and enhance business performance
Created and managed project plans, timelines and budgets
Oversaw project teams and maintained quality-minded schedules
Optimized customer experience by delivering superior services and effectively troubleshooting issues
Optimized resource allocation to maximize return on investment across diverse projects
Increased client satisfaction by providing tailored consulting solutions for their specific business needs
Managed large-scale projects, ensuring timely completion within budget constraints
ERP Consultant
RP Accord Systems
03.1996 - 06.1998
Provided consulting services on Oracle EBS products covering Financial, Manufacturing and Order Management areas (GL, AR AP, PO, INV, MRP, BOM, PM, OE, etc).
Development of custom reports, interfaces, forms on various modules
Technical and functional lead in implementing various EBS modules
Provided technical and functional support on Financial and Manufacturing modules.
Database and application administration.
Led various initiatives such as data migrations, Y2K, multi-orgs implementations.
Designed and developed add-ons on top of Oracle Order Management.
Developed JIT implementation for major semiconductor company.
Provided performance tuning on various areas of custom processes.
Offered input for complex documents to support client-ready final versions
Collaborated with upper management to drive strategy and implement new processes
Optimized inventory management with accurate demand forecasting and automated replenishment processes using ERP system
Met project goals on time and within budget constraints by managing implementation project activities, adhering to deployment standards and monitoring project schedules
Intensive hands-on experience in leading all phases of design, development, customization, integration, and implementation of enterprise applications, warehousing, data migration, synchronization of various data points and other related activities. As developer and administrator, a natural polyglot and well exposed in various types of databases both on-prem and cloud-based. Demonstrated success in delivering solutions timely and within budget.