Websites
Summary
Overview
Work History
Education
Skills
Area Of Expertise
Previous Experience
Timeline

Padmanabhan Iyer

Sunnyvale,CA

Summary

Experienced technology professional with over 15 years in technical leadership roles, including Lead Data Architect/Engineer and Consultant at Meta/Facebook, LinkedIn, and Director of Data Engineering. Proven track record of designing and implementing Peta-Byte scale data lakes, resulting in a 40% enhancement in data processing capabilities. Adept at driving innovation with a forward-thinking mindset, leading to a 30% increase in the adoption of innovative solutions. Accomplished in team management, achieving a 25% improvement in project delivery timelines and a 15% increase in overall team productivity.

Overview

15
15
years of professional experience

Work History

Lead Data Architect/Engineer

VMware
Palo Alto, CA
01.2021 - 11.2023
  • Spearheaded the identification and resolution of key issues in siloed data, ensuring a seamless and integrated data infrastructure
  • Spearheaded initiatives to enhance VMware’s data architecture, resulting in optimized processes and a more responsive data ecosystem
  • Designed and implemented an all-encompassing data framework, efficiently accessing and integrating data from diverse sources, ETL processes using Informatica, resulting in an impressive 80% reduction in data retrieval time
  • Pioneered accuracy and reliability enhancements by instituting and enforcing coding standards, data governance, and cataloging practices, resulting in an impressive 95% improvement in data quality
  • Designed python scripts to extract data from different source systems and perform transformations and loading to AWS S3 data lake using AWS Glue
  • Engineered robust policies, processes, and procedures, ensuring flawless data management, protection, and adherence to regulatory mandates
  • Collaborated closely with cross-functional teams, Partner Operations, Sales, Marketing and Finance to propose and implement data architecture strategies, contributing to an 80% surge in project success rates.

Lead Consultant - Data Engineering

Meta
07.2018 - 12.2021
  • Optimized over 1000 Hive pipelines to Spark, boosting efficiency for commerce and payments teams
  • Architected a Facebook/Instagram/Marketplace Category Management Data Warehouse for insightful analysis
  • Orchestrated the Data Enterprise partner track, encompassing diverse facets of data management and collaboration
  • Led the successful implementation of the VMware Partner Data Platform, unifying partner data across the organization
  • Delivered high-quality data solutions on time and within budget.

Lead Consultant - Data Engineering

LinkedIn
01.2017 - 01.2018
  • Spearheaded encryption of LinkedIn contacts information during GDPR migration, optimizing performance with Hive, Pig, and Python frameworks
  • Successfully converted over 1000 tables from Teradata to high-performance Hive, Pig, and Python solutions
  • Designed python scripts to extract data from different source systems and perform transformations and loading to AWS S3 data lake using AWS Glue.

Lead Consultant - Data Engineering

Meta
01.2015 - 01.2017
  • Oversaw critical projects including Cross-Device Insights (three releases), GAT Pipelines/Global Media Guideline report, Ops Dashboard, Live Monetization, Norms DB, and Dynamic Product Ads
  • Cultivated deep data expertise and assumed ownership of data quality for allocated areas of responsibility, ensuring the integrity and reliability of both new and existing data models and ETL processes in production
  • Proactively monitored and managed SLAs for all data sets and systems under purview, ensuring consistent performance and adherence to agreed-upon service level agreements
  • Worked seamlessly with data infrastructure and data engineering teams to effectively triage infrastructure issues and drive swift resolution, minimizing downtime and optimizing data flow
  • Possess extensive experience working with petabyte-scale ads data, leveraging technical expertise to assist the Sales Operation and Marketing Intelligence team in optimizing revenue generation strategies.

Data Engineer

GREE International
01.2014 - 01.2015
  • Building highly scalable data pipeline using python and spark that processes large amounts of data
  • Involved the following projects: PII (Personal Identifiable Information) masking of game data
  • DB optimization of 1000 plus tables holding multi terabytes of gaming data
  • Sunset Vertica and port existing code to Redshift
  • Work with game engineers/analysts to validate game data and provide real-time stats related to revenue, installs, and other KPI related to game performance.

Education

Bachelor of Science - Electrical Engineering

Sardar Patel College of Engineering, Mumbai
05.1997


Honors

Associate of Science - Electrical, Electronics And Communications Engineering

Technical Board, Tamil Nadu, Nagercoil
05.1988

Skills

  • Google Cloud Platform
  • Amazon Redshift
  • Data Governance
  • Big Data
  • Data Warehousing
  • Docker
  • Jenkins
  • Vertica
  • Python
  • Data Pipeline
  • Tableau
  • Infrastructure
  • Amazon Web Services
  • SAP HANA
  • Data Architecture
  • SQL (Programming Language)
  • Analytics
  • Performance Tuning
  • Dashboard
  • Extract Transform Load (ETL)
  • Informatica
  • Data Engineering
  • Agile Methodologies
  • Hive
  • Pig
  • Spark (SQL)

Area Of Expertise

  • Data Architecture & Governance
  • Cloud Platforms: AWS, GCP, Azure, Snowflake
  • Advanced Hands-on Proficiency: Python, SQL
  • Advanced Skills: Informatica, SAP, Hadoop, Hive, PIG, Spark, Database Technologies

Previous Experience

  • Lead Data Architect/Data Engineering Consultant for leading organizations including Chegg, PlayFirst, Model N, CallidusCloud (SAP), Palm, Hewlett Packard, Cisco, and Brocade.
  • Directed and executed data warehouse projects leveraging cutting-edge technologies, such as AWS, Informatica, SAP, and BusinessObjects.
  • Led and guided teams of skilled data engineers and architects to deliver comprehensive data warehousing solutions.

Timeline

Lead Data Architect/Engineer - VMware
01.2021 - 11.2023
Lead Consultant - Data Engineering - Meta
07.2018 - 12.2021
Lead Consultant - Data Engineering - LinkedIn
01.2017 - 01.2018
Lead Consultant - Data Engineering - Meta
01.2015 - 01.2017
Data Engineer - GREE International
01.2014 - 01.2015
Sardar Patel College of Engineering - Bachelor of Science, Electrical Engineering
Technical Board, Tamil Nadu - Associate of Science, Electrical, Electronics And Communications Engineering

Similar Profiles

CREATE PROFILE
Padmanabhan Iyer