Sanku Guha

Media Content Hub(MCH)

• Migrated on-prem Netezza databases to AWS Redshift and built a processing backend using Talend & EMR(PySpark) clusters for distributed processing replacing ODI & TIBCO resulting in 1M+ in licensing & hardware cost.
• Developed data pipelines for entire Currency TV measurement backend system in AWS using Airflow replacing TIBCO Framework resulting in licensing cost savings.
• Created Custom UI Plugins(using JavaScript & Jquery) & reusable Operator to support project requirement i.e Creating Task HOLD View, Custom DAG Processing View, Missing Pools View.
• Crafted a metadata driven approach for ingesting data in Near real time into Data Lake for business use.
• Created a fan-out architecture using SNS/SQS for multiple downstream processing in parallel.
• Migrated 15 TB of data from Netezza to Redshift using AWS SCT and DMS
• Created CI/CD Pipeline using Terraform for automated Build & Deployment.

EDW

• Analyzed and optimized(Spark with Scala) the Nielsen Core Reporting tool(NPOWER) by applying proper partition,sorting, compression & Parquet Block Size in the underlying data

Nielsen National TV View(NNTV)

• Migrated on-prem Hadoop system to AWS S3 using Spark & EMR for distributed processing resulting Cloudera Cost Savings
• Migrated 25 TB of data from on-prem Hadoop to Cloud(AWS S3)
• Created custom simulation script for High Critical Jobs after Every Redshift Version Upgrade to meet SLA
• Automated Redshift Vacuum and Analyze process for needed tables for better System Performance
• Collaborated with Data Science & Business teams on regular basis to tap on new business opportunities and revenue growth

• Created ODI workflow using Oracle PL/SQL & Stored Procedures for Verizon Quantus Application
• Migrated ODI Worflow to Hadoop Ecosystem using Oozie and Impala
• Have Created Custom Script for migrating Data from Oracle to HDFS using Sqoop for the entire Data Warehouse
• Lead a team of 6 and involved in requirements gathering and prepared functional specifications & low-level design.

• Crafted Nielsen National Currency Reporting System in Big Data Frameworks using Spark, Oozie ,Sqoop & Impala
• Engineered highly scalable and responsive reporting systems for Nielsen National Reporting to handle high volume of user requests
• Created Data Versioning in HDFS Level to avoid File not Found exception for 24/7 Reporting Application
• Migrated a 3 server Netezza backend to Cloudera Hadoop Distribution to avoid processing contention
• Created Custom Script for copying Data across Prod and Non Prod Clusters.
• Worked in a fast-paced agile team to deliver the business-critical milestones on-time with quality
• Analyzed client enquiries from major National networks on last 20 years of data