Mamta Pattnayak
NY
Summary
Experienced technology leader with over 17 years in Big Data, Engineering, and Data Operations, specializing in Agile environments. Skilled in designing, developing, and enhancing data management systems and leading high-performing teams to manage ETL pipelines and cross-functional projects. Proficient in Python, Scala, Airflow, Tableau, Databricks, AWS, Snowflake, and Redshift, with expertise in optimizing cloud infrastructure on AWS and a strong command of the Hadoop ecosystem. Proven track record in building scalable ETL workflows, implementing data governance, and ensuring operational excellence across mission-critical data pipelines.
Overview
18
18
years of professional experience
Work History
Sr. Director of Data Engineering and Operations
iSpot LLC
08.2023 - Current
- Led data engineering and data operations teams, overseeing ETL pipeline management and fostering collaboration across multiple teams
- Made data and system architecture decisions, optimizing AWS cloud environments for data scientists, engineers, and analysts
- Orchestrated scalable ETL workflows using Airflow, implementing data quality checks for acquisition, modeling, and ingestion
- Managed routine maintenance, performance tuning, and ETL development in Redshift, Snowflake, and MySQL
- Architected and supported Reference Data Management (RDM) changes, leading data governance initiatives and methodologies to ensure compliance and data quality
- Monitored ETL processes, handled Experian feed processing, and addressed ad hoc requests
- Environment: AWS Redshift, EC2, S3, Glue, Athena, Aurora DB, Spark, Jenkins, Docker, Databricks, GIT, Managed Airflow (MWAA), Datadog
Manager Data Engineering
6IX 0ERO 5IVE (605) LLC
04.2020 - 07.2023
- Led engineering and data operations teams, managing ETL pipelines and fostering cross-team collaboration
- Developed and optimized scalable ETL workflows, ensuring robust data quality checks
- Enhanced cloud infrastructure for performance and cost management utilizing AWS services
- Created runbooks and notifications to streamline data pipeline management
- Debugged ETL pipelines and provided root cause analysis for data anomalies
- Architected and supported Reference Data Management (RDM) changes, ensuring seamless integration with multiple teams
- Environment: AWS EC2, S3, EMR, Redshift, Glue, Athena, Amazon Aurora, MariaDB, Spark, Databricks, GIT, Jenkins, Docker, Managed Airflow (MWAA), Datadog, DBeaver
Tech Lead Data Engineering
6IX 0ERO 5IVE (605) LLC
06.2017 - 04.2020
- Managed engineering and Operations teams to ensure timely delivery of ETL data pipelines
- Developed and deployed data ingestion pipelines and data quality frameworks using AWS, PostgreSQL, and ClickHouse
- Built data workflow pipelines and produced analytical reports using Tableau
- Created runbooks and implemented notifications for operational management of ETL pipelines
- Environment: AWS EC2, S3, Informatica PowerCenter 9.1, Oracle 11g, Redshift, Netezza, SQL Server, Hive, MS Visio
Lead Data Engineer
Cablevision Systems Corporation
07.2014 - 06.2017
- Designed and developed a Big Data ingestion system using Hadoop technologies
- Analyzed data with Java, Spark, and Hive SQL, optimizing data storage
- Implemented Sqoop scripts for data import and aggregation using Hive and Pig
- Documented technical design specs and Runbooks for the data ingestion process
- Environment: Sun Solaris Unix, Informatica PowerCenter 9.1, Oracle 11g, Hadoop, Netezza, SQL Server, Java, Pig, Hive, Oozie, Shell, Python
BigData Consultant
Cablevision Systems Corporation
01.2012 - 07.2014
- Designed and developed a Big Data ingestion system using Hadoop technologies
- Analyzed data with Java, Spark, and Hive SQL, optimizing data storage
- Implemented Sqoop scripts for data import and aggregation using Hive and Pig
- Documented technical design specs and Runbooks for the data ingestion process
- Environment: Sun Solaris Unix, Informatica PowerCenter 9.1, Oracle 11g, Hadoop, Netezza, SQL Server, Java, Pig, Hive, Oozie, Shell, Python
DataWareHouse Consultant
Cablevision Systems Corporation
06.2012 - 01.2014
- Designed and developed a Big Data ingestion system using Hadoop technologies
- Analyzed data with Java, Spark, and Hive SQL, optimizing data storage
- Implemented Sqoop scripts for data import and aggregation using Hive and Pig
- Documented technical design specs and Runbooks for the data ingestion process
- Environment: Sun Solaris Unix, Informatica PowerCenter 9.1, Oracle 11g, Hadoop, Netezza, SQL Server, Java, Pig, Hive, Oozie, Shell, Python
Technology Consultant
Hewlett Packard Enterprise (Roger Comm. Canada)
01.2011 - 06.2012
- Involved in Developing and handling the PL/SQL Packages, Procedures and Database Triggers.
- Involved in tuning SQL queries by using quest control tools and manual by EXPLAIN PLAN.
- Gathered business focused data requirements and performed analysis from a Data Warehouse and ETL Development perspective.
Senior Oracle Developer
Symphony Services (Vanguard, LiquidNet, TCW & MBC)
08.2008 - 09.2010
- Responsible for rescue maintenance as needed across a spectrum of store developed applications built on Oracle Forms, Reports and Oracle PL/SQL.
- Developed/Modified User Interface/Reports using Oracle Forms & Report.
- Extensively worked in Oracle SQL, PL/SQL, SQL*Plus, Schema Management, SQL*Loader, Query performance tuning, Created DDL scripts, Created database objects like Tables, Views Indexes, Synonyms and Sequences.
Oracle PL/SQL Developer
Symphony Services (ING, Belgium)
08.2006 - 07.2008
- Responsible for requirements gathering from Clients, Analyzed the functional specs provided by the data architect and created technical specs documents for all the enhancements.
- Design & coding of transaction & master forms
- Created various UNIX Shell Scripts for scheduling various data cleansing/refining scripts and loading process. Maintained the batch processes using Unix Shell Scripts.
Education
Master of Computer Application (MCA) -
BPUT
Orissa, India05.2003
Bachelor of Science (B.Sc.) -
Berhampur University
Orissa, India05.1999
Skills
- RDBMS: Redshift, Oracle, Teradata, MS SQL Server, Netezza, Snowflake
- Programming Languages: PL/SQL, SQL, Core Java, JavaScript, Scala, Python
- Data Modeling: Relational & Dimensional (Star Schema, Snowflake), Erwin, MS Visio
- Development/ETL Tools: Splunk, Google Analytics, Tableau, Informatica
- Frameworks/Technologies: Hadoop, HDFS, MapReduce, Pig, Hive, Sqoop, Zookeeper
- AWS Products: Redshift, EC2, EMR, S3, IAM, RDS, CloudWatch, CloudTrail, Lambda
- Utilities/Tools: Aginity, DBeaver, PG Admin, Toad, SQL Developer, SQL*Loader
- Version Control: GitHub, BitBucket
- Functional Areas: Media, Reference Data/Capital Markets, Telecom Prepaid Billing
Timeline
Sr. Director of Data Engineering and Operations
iSpot LLC
08.2023 - Current
Manager Data Engineering
6IX 0ERO 5IVE (605) LLC
04.2020 - 07.2023
Tech Lead Data Engineering
6IX 0ERO 5IVE (605) LLC
06.2017 - 04.2020
Lead Data Engineer
Cablevision Systems Corporation
07.2014 - 06.2017
DataWareHouse Consultant
Cablevision Systems Corporation
06.2012 - 01.2014
BigData Consultant
Cablevision Systems Corporation
01.2012 - 07.2014
Technology Consultant
Hewlett Packard Enterprise (Roger Comm. Canada)
01.2011 - 06.2012
Senior Oracle Developer
Symphony Services (Vanguard, LiquidNet, TCW & MBC)
08.2008 - 09.2010
Oracle PL/SQL Developer
Symphony Services (ING, Belgium)
08.2006 - 07.2008
Master of Computer Application (MCA) -
BPUT
Bachelor of Science (B.Sc.) -
Berhampur University
Similar Profiles
Magdalena BrownMagdalena Brown
Analyst, Deal Strategy and Operations at ISpotAnalyst, Deal Strategy and Operations at ISpot
Bikash TiwariBikash Tiwari
IT Senior Technician at iSpotIT Senior Technician at iSpot
Abby DixonAbby Dixon
Content Editor at ISPOTContent Editor at ISPOT
Fatoumata SowFatoumata Sow
Case Manager at The Door Supportive HousingCase Manager at The Door Supportive Housing
Fahim AbdulkaderFahim Abdulkader
Summer Camp Counselor at SYEPSummer Camp Counselor at SYEP