Summary
Overview
Work History
Education
Skills
Open Source Projects
Timeline
Generic
Vengateswaran Arunachalam

Vengateswaran Arunachalam

Santa Clara,CA

Summary

Professional Summary:

Accomplished Full Stack Data Engineer & Data Architect with 14+ years of expertise in BI solutions. Proficient in Spark, Hadoop, Python, ReactJS, and the complete SDLC. Solid experience in cloud services with AWS & GCP, database solutions both in the cloud and on-premise, and mastery of BI tools including Tableau and MicroStrategy. Demonstrable skills in customer-focused open-source projects, content creation, and community engagement. Excel at advanced database solutions, ETL processes, and enhancing data infrastructure. Well-versed in partnering with diverse teams to foster data-driven strategies.

Overview

14
14
years of professional experience

Work History

Data Architect/Senior Data Engineer

Keysight Technologies
10.2021 - Current

Team Collaboration & Leadership:

  • Worked closely with data scientists and ML engineers to ensure data quality for advanced analytics.
  • Managed and mentored technical DATA team comprising data architects, modelers, and engineers.

Data Architecture & Management:

  • Oversaw data source mapping, movement, interfaces, and analytics, with emphasis on data quality.
  • Engaged in systems integration, addressed compatibility issues, and provided coaching and career development.

Snowflake Implementation & Optimization:

  • Integrated Snowflake, streamlining storage and queries, resulting in 30% improvement in data retrieval.
  • Led migration efforts to Snowflake with focus on data integrity and utilized its features for data sharing and warehouse management.

Performance & Automation:

  • Enhanced SQL query performance in Snowflake through analysis and caching, improving execution times.
  • Automated ETL pipelines for data ingestion into Snowflake and set up monitoring/alerts for efficient resource utilization.

Data Engineer Lead

Keysight Technologies
04.2018 - 10.2021
  • Support platform development team and perform activities to resolve developer issues in timely and accurate fashion
  • Design existing Datawarehouse/Data marts in new stacks(Incorta, Snowflake, Spark, Python)
  • Design reverse ETL with complex data model.

Senior BI Developer

Cognizant (Client: Keysight Technologies)
06.2014 - 04.2018
  • Involved in Data Warehousing and worked extensively on RDBMS (Oracle, MS SQL) and ETL tools such as Informatica, Shell Scripting, and Python.
  • Facilitated knowledge transfer sessions for new resources.
  • Handled structured data projects ranging from 1-10 TB in size.
  • Defined Informatica job flows and processes.
    Gained expertise with Spark using Python.
  • Managed loading data from UNIX file system to HDFS.

BI Consultant

Cognizant (Client: Agilent Technologies)
02.2011 - 05.2014

ETL & Data Management:

  • Gathered client requirements for ETL objects and designed FTP data transfer jobs.
  • Loaded data from LINUX file system to RDBMS using Informatica & Cron for automation.

Development & Scripting:

  • Analyzed and transferred data to relational databases using Informatica & Python.
  • Developed stored procedures and utilized BAPI and ABAP function calls in SAP.

Admin & Database Procedures:

  • Administered repository with user logins and privilege assignments.
  • Demonstrated expertise in writing and implementing PL/SQL procedures and functions.

SAP Integration:

  • Employed mappings in Informatica leveraging BAPI and ABAP.
  • Utilized Remote Functional Call (RFC) for inter-system communication.

Informatica Developer

Cognizant (Client: EBay)
04.2010 - 01.2011

Informatica Power Center Expertise:

  • Utilized tools including Designer, Repository Manager, Workflow Manager, and Workflow Monitor.
  • Developed robust mappings using transformations like Filter, Expression, Sequence Generator, and more.

ETL Development:

  • Translated high-level design specifications into ETL coding and mapping standards.
  • Extracted data from flat files/RDBMS into staging and further populated onto Data Warehouse.

Procedural & Scripting:

  • Designed procedures for data extraction across systems into Data Warehousing system.
  • Created UNIX shell scripts to automate Informatica sessions.

System Configuration & Data Movement:

  • Worked on loading data from various flat files to XML Targets.
  • Installed and set up Informatica Client tools, developing ETL mappings for heterogeneous data feeds.

Education

Bachelor of Science - Information Technology

Mount Zion College of Engineering & Technology
Tamilnadu, India
05.2009

Skills

  • Docker
  • Kubernetes
  • Git
  • AWS & GCP architecture
  • Python(Django, Flask, FastAPI)
  • Shell scripting
  • MySQL/Relational DB
  • Snowflake
  • Postgresql
  • Hadoop
  • Tableau
  • MicroStrategy
  • Looker
  • Cassandra
  • NoSQL
  • Pyspark
  • Airflow
  • Streamlit
  • openAI
  • Incorta

Open Source Projects

  • Teckiy, Developer support platform. https://www.teckiy.com
  • HelpU, India's first customer experience sharing portal., https://www.helpu.in

Timeline

Data Architect/Senior Data Engineer

Keysight Technologies
10.2021 - Current

Data Engineer Lead

Keysight Technologies
04.2018 - 10.2021

Senior BI Developer

Cognizant (Client: Keysight Technologies)
06.2014 - 04.2018

BI Consultant

Cognizant (Client: Agilent Technologies)
02.2011 - 05.2014

Informatica Developer

Cognizant (Client: EBay)
04.2010 - 01.2011

Bachelor of Science - Information Technology

Mount Zion College of Engineering & Technology
Vengateswaran Arunachalam