Siddharth Srivastava
Huntersville,NC
Summary
Seasoned Dev Lead at Tata Consultancy Services, adept in Hadoop and Datastage migrations, showcasing robust problem-solving and Agile project management skills. Excelled in strategic data transformations, enhancing data integrity, and streamlining operations, significantly contributing to project successes with innovative DevOps methodologies.
Overview
13
13
years of professional experience
Work History
Strategic Data Platform – Onehadoop Project
Tata Consultancy Services
Charlotte, USA
01.2023 - Current
- Worked as DEV Lead in SDP (Strategic Data Platform) Hadoop Project
- CDP Adoption- As DEV lead, I migrated code from SDP to Cloudera Data platform with end to end testing in DEV,UAT and PROD
- Data Protegrity- Worked on data tokenization and data masking for SDP applications and implemented in successfully in Prod
- Worked on housekeeping tasks that included compacting larger tables and creating scripts for archival of larger number of files
- Worked on Spark2 to Spark3 migration testing
- Worked on EEH Kafka migration framework for hadoop table loads
- Worked on Reconciliation report for critical SDP applications to ensure catchup of any missed record from source
- Worked on Jil creation in Autosys
- Worked on investigation of multiple critical issues in Production
OMNI Teradata to Hadoop Migration
Tata Consultancy Services
Delhi, India
01.2021 - 01.2023
- Worked as DEV Lead in Teradata to Hadoop Migration for OMNI initiative
- Tech Lead as part of migration of Teradata application to Hadoop involving java, Unix ETL technologies
- Coordinated with the Admin teams to set up configuration files for JDBC driver needed in Hive Connection from Java
- Involved in testing Hive connectivity from Java ETL and testing the Hive/Impala queries to make sure they match Teradata result during migration
- Created JIL scripts in Autosys to execute the wrapper scripts and used Autosys job Scheduler to schedule the ETL jobs to run the daily jobs and weekly jobs
- Worked with Application Team to gather requirements for data Migration
- Worked on Code Integration and code Deployment through Bit bucket, Ansible, Celestial
GWIM(Global Wealth Investment Management) Data Provisioning Point.
Tata Consultancy Services
Chennai, India
01.2012 - 01.2021
- DataStage Migration from 8.1 to 8.5 and Worked on translating Account level scenarios to Client Level within Supervision
- Key developer as part of migration of datastage 8.1 to 8.5
- Developed DataStage Parallel Jobs where in using required stages, data from different sources formatted, Cleansed, summarized, aggregated and transformed and loaded into datawarehouse
- Involved in design and development of parallel jobs, sequences using the Designer
- Worked with Datastage admin teams closely for all the environmental upgrades needed in the migration
- Helped in redesigning all the stages that were incompatible with higher version in datastage and tested all the jobs for these changes
- Debugged and resolved the issues encountered in the testing and eliminated all the warning messages from the logs
- Participate in project and business requirement gathering meetings and understand the user needs
- Helped in redesigning all the account level scenarios with in RMS to Client level
- Translate the complex business requirements into scalable design solutions and develop image templates as per the user needs and the industry standards
- Prepare unit test plan and execute testing scenarios using Unit test cases and validate the newly added functionalities/user interface with all possible business scenarios and document the results
- Monitor the production logs and coordinate with the on call support team if any issues/outages occur in production and provide the support for the production client and server application
- Set up Email alerts to corresponding teams on late runs, failures, long runs
- Responsible for incident, change, outage, problem management on Service now
- Scheduled jobs using Autosys scheduler based on the requirements and monitored the production processes closely for any possible errors
Education
Bachelor of Technology - Computer Science and Engineering
SRM Institute of Science and Technology
Chennai, India01.2012
Skills
- Windows Server
- UNIX and LINUX Shell
- Continuous integration and deployment
- Agile project management
- DevOps methodologies
- Hadoop
- Datastage
- Bitbucket
- Ansible
- Autosys
- Putty
- Winscp
- Jira
- DB2
- Teradata
- Datastudio
- Hue
- Software development
- Load balancing
Training
- Conducted Data warehousing training for the team members as part of learning session.
- Organized and conducted a training on Autosys scheduler with high level details on all functionalities.
- Conducted trainings as and when we migrated from lower versions of datastage to higher versions to keep the team in sync with all the added functionalities in higher version.
- Conducted trainings on the scenarios that I worked on with in Supervision technology.
- Attended a session on Banking Concepts held at Chennai for BFS Domain.
- Attended extensive trainings in Datastage v8.7 and got the certification for the same.
- Coordinated with TCS IBM team for Datastage usage on Cloud Pak and attended the training organized by TCS IBM team on the same.
- Conducted trainings on Hadoop migration from SDP to CDP platform.
Affiliations
- Reading Books
- Watching and Playing Tennis
- Playing Chess
Languages
English
Professional
Hindi
Professional
French
Elementary
References
References available upon request.
Timeline
Strategic Data Platform – Onehadoop Project
Tata Consultancy Services
01.2023 - Current
OMNI Teradata to Hadoop Migration
Tata Consultancy Services
01.2021 - 01.2023
GWIM(Global Wealth Investment Management) Data Provisioning Point.
Tata Consultancy Services
01.2012 - 01.2021
Bachelor of Technology - Computer Science and Engineering
SRM Institute of Science and Technology
Similar Profiles
Vrunda ChindhadeVrunda Chindhade
HR Manager at Tata Consultancy Services, TCS, Tata Consultancy Services LimitedHR Manager at Tata Consultancy Services, TCS, Tata Consultancy Services Limited
Sreya BasuSreya Basu
Procare Analyst at Tata Steel(Tata Consultancy Services)Procare Analyst at Tata Steel(Tata Consultancy Services)
Arun VArun V
Program Manager at Tata consultancy services | Financial Ombudsman ServicesProgram Manager at Tata consultancy services | Financial Ombudsman Services
Naimish AgnihotriNaimish Agnihotri
Assistant Delivery Manager at Tata Consultancy Services, Global Shared ServicesAssistant Delivery Manager at Tata Consultancy Services, Global Shared Services
Jarrai JallowJarrai Jallow
Registered Nurse at Carolinas Medical Center - Dickson, Cardiac ICURegistered Nurse at Carolinas Medical Center - Dickson, Cardiac ICU