Summary
Overview
Work History
Education
Skills
Personal Information
Timeline
Generic

KALAIVANI HARI PRAKASH

Atlanta

Summary

Data Engineer with over 8 years of experience in the Information Technology (IT) industry in helping clients align IT strategies with corporate strategic objectives across all departments & divisions. Continues to be involved with every phase of the life cycle development, including feasibility studies, design, and coding for large and medium business intelligence/ Cloud projects using Snowflake & AWS. Have acquired over the years a comprehensive understanding of database design and methodology from multiple perspectives (user, designer, and developer) and has hands-on experience in designing, developing, Testing, and implementing Extraction, Transformation, and Load (ETL) techniques on multiple database platforms and operating system environments using today's innovative technology.

Overview

11
11
years of professional experience

Work History

Data Engineer

Flagstar - Cognizant Technology Solutions
04.2024 - Current
  • Implement and configure and optimize snowpipe to automate the loading of data from AWS S3 into snowflake.
  • Troubleshoot and resolve data ingestion issues such as failures,latency and data integrity issues.
  • Automated error handling and retries in the event of data loading failures.
  • Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability using Snowpipes.
  • Write SQL Queries for data extraction,transformation and analysis in stored procedures and implemented those in Snowflake Tasks .
  • Successfully created and optimized snowflake Tables using the data modelling standards.
  • Managed identification, protection and use of data assets using Snowflake using the RBAC Access policies.
  • Wrote and optimized in-application SQL statements.
  • Managed data quality issues during ETL processes using the notification services.
  • Familiar with Snowflake Architecture and snowflake data sharing for external applications.
  • Implement data quality checks, validation rules, and monitoring processes to ensure data accuracy and consistency.
  • Create technical documentation, including data dictionaries, process flow diagrams, and system specifications.
  • Investigate and resolve data-related issues, provide technical support, and participate in on-call rotations for production systems.
  • Utilize and enhance existing tools and frameworks for data ingestion, processing, and analysis.
  • Involve and drive the SLA discussions for DE with customer.
  • Proactiveness in fixing batch delays to Biz, Downstream, etc.
  • Involve and Assess Transition of Data Lake Support from DE Teams.
  • Managed project timelines and deliverables for multiple concurrent initiatives, successfully ensuring on-time completion.
  • Developed and maintained optimized data models and schema designs to support application requirements and business processes.
  • Designed and developed ETL Mappings using IBM Datastage to extract data from different source systems.


Associate - Projects

Avis Budget Group - Cognizant Technology Solutions
04.2022 - 04.2024
  • Have good knowledge in ETL and hands on experience in creating Pipelines.
  • Strong in AWS Data Engineering pipelines using Airflow.
  • Strong Experience in Snowflake and automated queries using tasks in Snowflake cloud datawarehouse.
  • Strong Experience in creating Snowflake streams.
  • Worked in migrating data from legacy system to Snowflake tables using AWS Database migration services.
  • Good knowledge in Snowflake time Travel features.
  • Creation of Data pipelines in EMR and refresh of Redshift Tables.
  • Good in SQL, Python and DWH.
  • Designed & implemented a Retail Datawarehouse using AWS Glue providing secured access to large datasets.
  • Create reusable components and enhance existing flows and components.
  • Experience with ELT/ETL tools and processing.
  • Create and monitor schedules and scope of support, based on Failures.
  • Good hands on experience in creating DAG's using Airflow orchestration tool.
  • Monitor Data Lake batch jobs and handle job failures &data related issues.
  • Liaise with AWS team for any issues with AWS environment.
  • Lead the Daily connect with offshore team for any Pipelines Issues.
  • Monitor daily/weekly/monthly job run status and status reports to Client.
  • Daily Review failures/resolutions using Change request.
  • Ensure SOPs documented for new failures.
  • Ensure SLA tracker is updated with right reasons and verbiage.
  • Take up and drive performance improvements initiatives.

IT Analyst

Master Card - Tata consultancy services
10.2014 - 10.2018
  • Involved in interactions with the Business Analyst to understand and obtain application requirements.
  • Involved in preparation of the change request documents.
  • Updated complex SQL queries and demonstrated ability to collaborate with others during Design, Development, and Testing.
  • Used design and development techniques that resulted in efficient, maintainable, and high quality ETL processes.
  • Involved in development of a new Java sub-module to calculate Penalty & Interest for defaulters based on new requirements.
  • Developed complex mappings in Power Center Designer using Advanced ETL Transformation.
  • Worked on Aggregate, Expression, Filter, and Sequence Generator, Update Strategy, Union, Lookup, Joiner, and Stored procedure transformations.
  • Responsible for source code and version control, involved in integration and deployment.
  • Given demos, presentations to internal teams.
  • Involved in Unit testing and System testing and prepared Test plan documents.
  • Extensively used UNIX shell scripts to create the parameter files dynamically.
  • Used PMCMD command to automate the Power Center sessions and workflows through UNIX.

Education

Computer Science and Engineering -

Anna University
06.2014

Skills

  • Data Engineering
  • Data warehousing
  • Snowflake SQL datawarehouse
  • Snowflake Streams
  • Snowpipes
  • Snow tasks
  • AWS Redshift
  • Athena
  • S3
  • AWS Lambda
  • AWS Glue Catalog
  • AWS Glue Databrew
  • AWS Glue ETL
  • AWS Glue
  • AWS Cloud watch
  • Data pipelines
  • Python Scripting
  • Airflow
  • Azure Devops
  • Servicenow
  • Architecture Concept
  • ETL Tool - Informatica
  • MS SQL Server
  • Oracle
  • ANSI SQL
  • SQL Scripting
  • IBM Datastage

Personal Information

Employee ID: 958131

Timeline

Data Engineer

Flagstar - Cognizant Technology Solutions
04.2024 - Current

Associate - Projects

Avis Budget Group - Cognizant Technology Solutions
04.2022 - 04.2024

IT Analyst

Master Card - Tata consultancy services
10.2014 - 10.2018

Computer Science and Engineering -

Anna University

Similar Profiles

CREATE PROFILE
KALAIVANI HARI PRAKASH