Nehal Balki

• Performing development task as Data Engineer.
• Implemented Python scripts for data load.
• Experience with python libraries like pandas sqlalchemy, db based libraries os xlsxwriter psycopg2 etc.
• Developed sustainable ETL pipeline with use of python as primary ETL script.
• Developed python jobs with error logging and error handling techniques with restart-ability of job.
• Managed and maintain in house Datawarehouse and implemented changes in ETL logic as per requirement.
• Developed CICD architecture based on Jenkins and configured with inhouse tools for organization.
• Implemented CICD for all development.
• Extensively worked on Oracle, Postgres and Snowflake.
• Implemented performance tuning in old Talend jobs and other ETL jobs.
• Created automated excel report logic using python.
• Developed data pipeline using sql Loader.

Project Name: HCSC (Healthcare Domain)

Title: Talend BIG Data Developer

Duration: September 2019 to November 2021

Job Description:

• Designed, developed and improved complex ETL structures to extract transform and load data from multiple data sources into data warehouse and other databases based on business requirements.
• Worked on extracting data from various sources into Hadoop Distributed File Systems (HDFS).
• Used Spark framework to configure big data batch jobs.
• Developed custom routines as per business logics.
• Implemented FTP and SFTP Logics and worked on SMB data transfer. o Implemented Error Logging, Error Recovery, and Performance Enhancement's & created Audit.
• Worked with Json and XML file on regular basis.
• Implemented CI/CD pipeline using Jenkins and UCD components for all deliverables.
• Worked directly with Client in Agile mode of work.
• Created Hive tables, partitions and implemented incremental imports to perform ad-hoc queries on structured data.
• Worked on bigdata batch jobs in spark Framework.
• Created audit logics and implemented for data quality at source and destination.
• Developed mappings to implement type1, type2, type3 slowly changing dimensions.
• Implemented API jobs using Talend ESB components.

Project Name: FTFCU (BFSI Domain)

Title: Data Engineer, Talend developer

Duration: November 2018 to August 2019

Job Description:

• Developed/ designed Talend mappings by translating business requirements.
• Extensively used ETL to transfer and extract data from source files and load data into target database.
• Documented Mapping and Transformations details, user requirements, implementation plan and schedule.
• Responsible for performance tuning at mapping level, source level and thee target level for slowly changing dimensions type 1, type2 for data loads.
• Designed and developed efficient error handling methods and implemented throughout mappings.