Hiteshkumar Naganathan
Exton,PA
Summary
Self-motivated Big Data Architect with 12+ years of experience in warehouse data management. Collaborates effectively with multi-functional roles to identify and leverage areas for improvement in data systems. Bringing comprehensive understanding of warehouse operations and documentation needs.
Responsive expert experienced in monitoring database performance, troubleshooting issues and optimizing database environment. Possesses strong analytical skills, excellent problem-solving abilities, and deep understanding of database technologies and systems. Equally confident working independently and collaboratively as needed and utilizing excellent communication skills. Background includes data mining, warehousing, and analytics. Proficient in machine and deep learning. Quality-driven and hardworking with excellent communication and project management skills. Detail-oriented team player with strong organizational skills. Ability to handle multiple projects simultaneously with a high degree of accuracy.
Overview
17
17
years of professional experience
1
1
Certification
Work History
Big Data Architect
Tata Consultancy Services
08.2023 - Current
- Developed the ETL pipeline, moving data from a source or multiple sources into a database and built a Data warehouse
- Developed a big data program in PYSPARK on Kubernetes cluster and generated a report on comcast business expansion
- Used Minio storage for reading and writing data in parquet format
- Developed a spark code using Apache Sedona package for geometry joins
- Built docker images and ran the spark program from Docker
- Developed a code to pull data from kinesis stream and parse the JSON and load it to a csv/database
- Developed a code to pull data from Azure data inventory and load it to a database
- Maintaining the code in GIT repository
- Analysis and understanding of the Business Requirements, Project Functional Specification, HLD, LLD through review sessions with Business Analysts team
- Co-ordinate with customers on requirement discussion and conducted triage call
- Development of Project Plan & Estimation based on the project scope
- Involved in Solution design document creation for developing functionalities
- Co-ordinate with offshore development team and conducted code review for the changes.
Senior Data Engineer
Tata Consultancy Services
04.2022 - 08.2023
- Developed the ETL pipeline, moving data from a source or multiple sources into a database such as a data warehouse
- Developed Apache spark program to copy data from various sources (Flat files and RDBMS) and pre-processed them to HDFS
- Developed Apache spark program in JAVA to read the data from HDFS and loaded the raw data to staging layer which is built in HBASE
- Developed spark program in JAVA to read data from HBASE, transform the data and then load it to HIVE tables
- Develop and maintain data models to support data warehouse and extract generating requirements
- Created Shell scripts to trigger the spark program via SOS scheduler
- Developed Reconciliation/Accuracy reports using checksum after ETL process
- Built Apache spark using Maven repository
- Prepare deployment packages to deploy jars using Jenkins
- Ensured no high/medium/low vulnerabilities in SONAR & SAST scans
- Analysis and understanding of the Business Requirements, Project Functional Specification, HLD, LLD through review sessions with Business Analysts team
- Development of Project Plan & Estimation based on the project scope
- Involved in Solution design document creation for developing functionalities
- Maintaining DDL scripts for both Hive and HBASE tables
- Co-ordinate with offshore development team and conducted code review for the changes
- Developed big data program for generating business/finance extracts using critical data elements
- Developed Big data program in purging archiving data from legacy system with business logics
- Code optimization in loading huge volume of data and did performance tuning of extracts
- Co-ordinate with customers and conducted triage call
- Conducted Dress rehearsal exercise before application goes live
- Worked with SOS job scheduling team and ran the batch program jobs using scheduler
- Maintaining the code in GIT repository
- Prepare Unit Test scripts based on requirements and Design documents
- Tracking defects in Master craft (TCS internal tool)
- Development of SQL Queries to validate the data load / extracts generated
- Participate in Process Improvement efforts, Monthly and weekly status reporting
- Establish 'Best Practices' and plan for continuous improvement of processes
- Reporting and tracking of defects till closure.
Big Data Engineer
Tata Consultancy Services
07.2019 - 04.2022
- Analysis and understanding of the Business Requirements, Project Functional Specification, HLD, LLD through review sessions with Business Analysts team
- Development of Project Plan & Estimation based on the project scope
- Create DDL scripts for HIVE / HBASE tables packages
- Maintaining Data dictionary for all the tables
- Developed ETL program in cluster mode using Apache Spark and did data ingestion from Flat files to staging layer (Data Lake in Phoenix tables) and loaded to Hive layer
- Developed program using spark java for generating functional extracts using Critical data elements
- Developed program in purging archiving data from legacy system with business logics
- Code optimization in loading huge volume of data (100M records) from source to target
- Worked with SOS job scheduling team and ran the batch program jobs using scheduler
- Prepare Unit Test scripts based on requirements and Design documents
- Ensured no high/medium/low vulnerabilities in SONAR & SAST scans
- Tracking defects in Master craft (TCS internal tool)
- Development of SQL Queries to validate the data load / extracts generated
- Participate in Process Improvement efforts, Monthly and weekly status reporting
- Establish 'Best Practices' and plan for continuous improvement of processes
- Reporting and tracking of defects till closure.
Business Analyst
Bank of America
08.2012 - 06.2019
- Analyzing the BRD and understanding Business Requirements from Line of Business
- Preparing High level design document and review with Line of Business
- Reviewing the HLD document with offshore development team
- Involving in design document creation for developing functionalities
- Developing ETL scripts using SQL for converting legacy data from Source to target system
- Additional roles and responsibilities of a being a Scrum Master of Agile team
- Creating user stories for the functionalities and grooming offshore development team
- Clarifying functional and technical queries in daily stand-up call
- Participate in Process Improvement efforts, Monthly and weekly status reporting
- Establish 'Best Practices' and plan for continuous improvement of processes.
Database Developer
Bank of America
04.2010 - 08.2012
- Requirement Analysis
- Application Study
- Develop ETL scripts for conversion
- Prepare Unit test case scenario
- Defect Fixing.
Developer
British Airways Plc
07.2007 - 08.2010
- Requirement Analysis
- Application Study
- Maintenance and Support Activities
- Status Reporting.
Education
Bachelor of Technology in Information Technology -
Anna University
01.2006
Skills
- ETL development
- PySpark
- SQL Expertise
- Java
- Python Programming
- Hadoop, Hive, HBASE
- Kubernetes
- Docker
- Data Modeling
- Data Warehousing
- Cloudera
- Data Pipeline Design
- Backup and Recovery Strategies
Certification
2008, SCJP - Sun certified Java Programmer, Chennai
Awards & Appreciations
- Contextual master in Optimization of Data Loading Time in Data warehouse for a Leading Insurance Company
- Awarded with 'Best Performance Improvement Project - BFSI Platform Unit Level Award' and 'Special Achievement Award' in Big data program for performance tuning.
Trainingconducted
- 2011, RFT Training, 15 TCS Associates, Chennai, Tata Consultancy Services
- 2010, GCPI Application - Navigator Session, 60 TCS Associates, Chennai, Tata Consultancy Services
Designation
Big Data Consultant
Personal Information
- Visa: H1B
- Passport Number: P1466997
- Date of Birth: 03/30/85
- Gender: Male
- Nationality: Indian
Training
- 2007, Initial Learning Programme (ILP), Trivandrum, Tata Consultancy Services
- 2008, JUnit Training, Chennai, Tata Consultancy Services
- 2009, Test Automation Basics, Chennai, Tata Consultancy Services
- 2009, QTP training, Chennai, Tata Consultancy Services
- 2010, Core Java - Overview, Chennai, Tata Consultancy Services
- 2010, RFT - An Overview, Chennai, Tata Consultancy Services
- 2011, Basics of Banking, Chennai, Tata Consultancy Services
Timeline
Big Data Architect
Tata Consultancy Services
08.2023 - Current
Senior Data Engineer
Tata Consultancy Services
04.2022 - 08.2023
Big Data Engineer
Tata Consultancy Services
07.2019 - 04.2022
Business Analyst
Bank of America
08.2012 - 06.2019
Database Developer
Bank of America
04.2010 - 08.2012
Developer
British Airways Plc
07.2007 - 08.2010
Bachelor of Technology in Information Technology -
Anna University
Similar Profiles
Vrunda ChindhadeVrunda Chindhade
HR Manager at Tata Consultancy Services, TCS, Tata Consultancy Services LimitedHR Manager at Tata Consultancy Services, TCS, Tata Consultancy Services Limited
Sreya BasuSreya Basu
Procare Analyst at Tata Steel(Tata Consultancy Services)Procare Analyst at Tata Steel(Tata Consultancy Services)
Arun VArun V
Program Manager at Tata consultancy services | Financial Ombudsman ServicesProgram Manager at Tata consultancy services | Financial Ombudsman Services
Naimish AgnihotriNaimish Agnihotri
Assistant Delivery Manager at Tata Consultancy Services, Global Shared ServicesAssistant Delivery Manager at Tata Consultancy Services, Global Shared Services
JULIA STEYERJULIA STEYER
Receptionist at Valley Veterinary HospitalReceptionist at Valley Veterinary Hospital