VIGNESH KRISHNAN

Client: The Home Depot , USA

• Responsible for design, develop, test, and maintain ETL/ELT pipelines to ingest, transform, and load data from multiple sources into data warehouses or lakes.
• Manage and optimize data storage solutions (BigQuery, GCS and Data Base ) for performance, scalability, and cost-efficiency. Ensure data quality and integrity through validation, cleansing, and monitoring processes.
• Created Cloud Functions to consume streaming JSON data (Receipts, Inbound, and Outbound transfers) from Cloud Pub/Sub topics. Added subscriptions to write messages directly into BigQuery tables, extracting required fields for loading into target tables and exposing them through views.
• Exporting the batch data to GCS bucket from HDFS to load the
  data in the landing table and transforming in the stage layer
  that involves transformations, cleansing etc.. to push the final
  data to target.
• Designed and implemented complex business validation logic for Purchase Orders and landed cost metrics to ensure data consistency between source and target systems. Additionally, developed Python scripts using Pandas and Google Cloud packages to automate SOX compliance validations.
• Developed and owned approximately 900 pipelines and also
  provided the production support to find the root cause of job failures by tracing the BQ logs and deployed the fix accordingly.
• Scheduling the jobs through IBM Tivoli (Maestro) that invokes
  the jenkins pipeline to complete all the ETL stages.
• Developed automation to download data as CSV files via API services from external applications (Blackline and Workiva) and load it into BigQuery tables for analytics and historical data maintenance.
• Retired App Engine instances to reduce cost and migrated the codebase to Cloud Functions.

Client: Liquid Telecom, MEA

• Specialized in telecom domain projects, focusing on customer usage processing and billing operations
• Comprehensive understanding of end-to-end telecom systems, including usage processing, billing, and customer data management.
• Handled database operations using PL/SQL to generate business-critical reports and fulfill client data requirements, including modifying tables as per client requests.
• Developed automations using SQL, Unix, and PL/SQL to optimize daily tasks by reducing time and resource usage while improving accuracy.
• Provided support as a customer-facing executive, resolving issues and handling service requests to ensure timely delivery and client satisfaction