Summary
Overview
Work History
Education
Skills
Accomplishments
Management Skills
Timeline
Generic

NILADRI DAS CHOUDHURY

Lead Engineer / Data Architect
Portland

Summary

Accomplished Data Engineer and Cloud Architect with 18+ years of experience delivering scalable, secure, and high-performance systems across data engineering, cloud platforms, and enterprise applications. Proven leadership in architecting AWS-based data platforms, enabling real-time data integration, and modernizing legacy systems. Adept at managing cross-functional teams, driving technical roadmaps, mentoring engineers, and aligning technology strategy with business goals. Hands-on expertise in AWS, Terraform, Python, DynamoDB, Elasticsearch, AppSync, Databricks, and distributed data pipelines. Recognized for transforming complex requirements into robust, production-grade solutions that deliver measurable business value.

Overview

19
19
years of professional experience
2007
2007
years of post-secondary education

Work History

Lead Engineer

Nike
04.2023 - Current
  • Preparing strategy and roadmap to develop a unified Product Catalog that combines governed data across domain platforms providing a single, trusted source of product data for complex enterprise uses cases inclusive of MarketPlace needs.
  • Idea is to Deliver near real-time access to trusted product data, reducing latency and complexity.
  • Explore knowledge graph using AWS Neptune, validating scenarios through property graph model.
  • Work on the end to end integration for different data sources to ingest into the Catalog data model.
  • Align with product teams to ensure we meet our goal of producing 80% of business entities data via APIs, Streams and lakehouse availability across all Consumer Product and Innovation domains.

Software Engineering Lead

Nike
03.2021 - 04.2023
  • Conceptualized and Delivered: Designed an end-to-end data service platform to support cloud applications within the Line Planning and Merchandising domain, while also enabling seamless integration with legacy systems.
  • Collaborating with the Technical Program Manager (TPM) on backlog prioritization and delivery planning.
  • Partnering with business stakeholders to align technical solutions with business value.
  • Ensuring consistent monitoring of delivery progress, team health, and customer success as key priorities.
  • Platform Architecture: Spearheaded the overall design of the platform using AWS services, ensuring scalability, security, and efficiency.
  • AWS AppSync: Designed, developed, and integrated AWS AppSync to create secure, scalable GraphQL APIs that enabled efficient communication between the application back-end and front-end.
  • Leveraged AWS AppSync to simplify data access, using real-time data synchronization, and efficiently connected multiple data sources, including AWS DynamoDB and AWS Lambda.
  • Designing and implementing Bulk Data load: Worked on proof of concept and validated a successful solution that involved movement of relational data into Databricks Lakehouse, move it to Platform's authoritative and search stores using Apache Kafka (Nike Streaming Platform). It also involved using a very new integration service called Zero-ETL-Integration provided by AWS.
  • Implemented fine-grained security using AWS IAM to control access to the GraphQL API and ensure data integrity.
  • Collaborated with cross-functional teams to monitor and troubleshoot API performance using AWS CloudWatch and iterated on API functionality to meet evolving business needs.
  • Proof of Concept Leadership: Directed a 10-member team through the Proof of Concept (PoC) phase, finalizing the platform's overall architecture and approach.
  • Engineering Leadership: As an Engineering Manager in a stretch role, responsibilities included conducting 1:1s, mentoring, and career development through Creation for Excellence (CFE) documentation.
  • Driving goal-setting discussions and identifying leadership opportunities for high performers.
  • Dual-Focused Leadership: Balanced leadership from both product and engineering perspectives, bridging technical complexity with product requirements.
  • Mentorship and Team Development: Championed technical roadmaps, aligning with Agile PI objectives in collaboration with Product Management counterparts.
  • Guided team members to take on leadership roles, fostering the next generation of leads.
  • Intern Mentorship: Successfully mentored an intern, assigning tasks and guiding the creation of a comprehensive Monitoring and Observability dashboard for monitoring usage of experience APIs served by the Platform.
  • Data Store and Search Infrastructure: Established the authoritative data store using AWS DynamoDB and the search store using AWS Elasticsearch, including advanced security configurations such as IAM roles and AD groups for Elasticsearch.
  • Enabled Kibana access for Elasticsearch hosted within a VPC.
  • Innovative Platform Modularization: Transformed the platform from a limited application hosting solution into a foundational, modular platform capable of rapid application assembly through reusable components.
  • Advanced Features Development: Designed and implemented technical solutions for challenges such as: Bulk writes capabilities in DynamoDB, Optimistic concurrency control for Elasticsearch, Real-time transaction streaming using DynamoDB Streams and AWS Kinesis.
  • Utilized other AWS services, including Lambda, API Gateway, Firehose, S3, AppSync, Athena, CloudWatch, and SNS.
  • Integration with Nike Platforms: Integrated the platform with existing systems such as the Nike Streaming Platform (built on Apache Kafka) and Databricks for bulk data loads, orchestrated using Apache Airflow.

Senior Data Engineer

Nike
06.2020 - 02.2021
  • Collaborated with Business Stakeholders: Engaged directly with the business to gather and document requirements, adopting an iterative development approach to refine needs and solutions over time.
  • Dynamic Development Process: Updated business documents during development iterations and utilized rapid prototyping techniques to demonstrate real-time changes to required services.
  • Team Leadership: Led and managed a team of three to develop storage solutions, backend services, and batch jobs for refreshing multi-dataset operations.
  • Cross-Functional Collaboration: Partnered with UI engineers to successfully deliver Nike's first program management application for footwear design.
  • AWS services used: AWS Aurora MySQL, AWS Lambda, AWS API Gateway.

Lead Engineer

Nike
02.2020 - 02.2021
  • Developed an Integration Framework: Designed a system to enable near real-time data sharing across existing Line Planning and Merchandising applications at Nike.
  • Search Store Implementation: Set up the platform's search functionality using AWS Elasticsearch.
  • Leveraged AWS Compute Services: Extensively utilized AWS Lambda for serverless computing.
  • Implemented AWS ECS Fargate for efficient bulk data processing.
  • Monitoring and Observability: Created Splunk dashboards to monitor the usage of AWS API endpoints, ensuring system reliability and performance.
  • AWS and Infrastructure Tools: Worked with AWS SQS, AWS SNS, AWS API Gateway, Terraform, and Docker for infrastructure management and application deployment.
  • Technical Roadmap Leadership: Defined technical directions for the team, collaborating with Product Management to align the roadmap with Program Increment (PI) objectives in an Agile framework.
  • Crisis Management during COVID-19: Successfully led a newly formed team during the COVID-19 shutdown, balancing the dual priorities of maintaining production system stability and delivering system enhancements.

Senior Data Engineer

Nike
01.2018 - 06.2020
  • Worked on integrating Nike's apparel data into one of the existing Decision Support Systems.
  • The issue was Nike had launched a new application on cloud for maintaining product data with many new functionalities and hence all the downstream systems which were still on-premises needed to be wired back to ensure smooth flow of data.
  • This did not only need new technology but also a continuous work on the data model since many of the attributes were divested.
  • This was one of the most visual projects at Nike's Creation landscape since any disruption of data flow would have let delay/escalation of many critical business reports resulting out of the downstream data systems.
  • AWS Services used: AWS S3, AWS Lambda, AWS SQS, AWS DMS, AWS SNS, Python, AWS CloudWatch (for Logs and Event), AWS SSM, Oracle 11g, Terraform.

Manager, Delivery

Cognizant Technology Solutions
03.2015 - 01.2018
  • Dual Team Management: Managed two teams simultaneously: one for Nike and another for an e-commerce company, overseeing a total of seven full-time employees.
  • Leadership Responsibilities: Led goal-setting initiatives, conducted performance appraisals, and provided mentorship to team members.
  • Request-for-Proposal (RFP) Contributions: Actively participated in multiple RFP activities for Cognizant, including presenting two proposals to clients on ETL with AWS.
  • Resource Management: Served as the single point of contact for resourcing activities at Nike's Data Warehousing group in the Pacific Northwest region.
  • Interview panel selection: Was one of the members working actively with Cognizant's data-warehousing resource pool.
  • Revenue forecasting reviews: One of the major validation process inside Cognizant was to meet with account heads and engage in a validation process involving revenue generated and revenue forecast metrics.
  • Strategic Staffing Growth: Successfully facilitated the addition of 65 Nike employees across various client locations within three single fiscal year. Was awarded by Cognizant as ‘Above and Beyond' Person of the year.

Senior Data Engineer

Cognizant Technology Solutions
01.2012 - 01.2018
  • Sound knowledge on Nike's Product Creation Data Model- worked to get Product Creation's biggest application go live.
  • Worked on creating centralized repository to support one stop place for Nike Image Library.
  • Worked on Advanced Reporting and Information Analytics (ARIA) project - datawarehouse designed and developed from scratch.
  • Designed and developed data cleansing engine from scratch.

Senior Data Engineer

Hexaware Technologies
09.2011 - 01.2012
  • Working on Netezza, Oracle and Unix shell scripts and PERL scripts for automating the ETL process.
  • Used Cybermation to automate jobs to automate work schedules across platforms – Unix, Windows.
  • Prepared Database objects and performance tuning the applications.

Senior Data Engineer

Cognizant Technology Solutions
11.2009 - 09.2011
  • Coding PL/SQL programs, writing complex procedures, functions, packages.
  • Working on DM Express (ETL tool from Syncsort Corporation) to convert PL/SQL procedures.
  • Performance tuning SQL queries.
  • Unix shell scripting (parser and data file creation logic implementation).

Data Engineer

Infosys Technologies Ltd
06.2006 - 11.2009
  • Working single handedly for the Contacts, Signup, and Sync application for MobileMe-This was primarily an ETL operation where logs of various applications were scrubbed upon depending on the business logic, parsed, extracted, and eventually loaded into the database.
  • Development (Coding the major scripts, writing procedures, functions, triggers, query level as well as database level tuning).

Education

B.Tech - Civil Engineering

Indian Institute of Engineering Science and Technology (IIEST)

Skills

AWS

Terraform

Docker

Oracle

RDS-MySQL

Snowflake

DynamoDB

Elasticsearch/Opensearch

AWS Neptune

GraphQL

Rest APIs

Pyspark

PERL

SHELL

Python

Databricks

Jenkins

Fusion Chart

Crystal reports

Apache Superset

Splunk

PL/SQL

SQL

Mentoring and coaching

Technical analysis

Product development

Project management

Accomplishments

  • Pioneered Nike’s First Product Merchandising Platform
    Spearheaded the architecture and development of Nike's first Product Merchandising Platform, enabling a 40% reduction in time-to-market for new merchandising features. Delivered a reusable foundation of low-latency (sub-100ms), high-throughput APIs, cloud-native storage, and real-time streaming data pipelines using Apache Kafka. Successfully onboarded two business-critical Line Planning applications, integrated reference data from multiple source systems for high-speed search, and hosted Nike’s first 3rd-party product catalog, reducing manual ingestion effort by 60%.
  • Led Cross-Functional Engineering Team with Dual Technical and Managerial Responsibilities
    Directed a blended team of 3 full-time engineers and 9 contractors across product, platform, and data engineering tracks. Appointed by senior leadership to a stretch role as Engineering Manager, resulting in 25% improved delivery velocity across sprints through optimized planning, mentoring, and cross-functional collaboration. Achieved 95%+ on-time delivery rate for all Platform milestones over two consecutive quarters.
  • Built Line Plan Data Foundation Enabling Multi-Domain Integration
    Architected and deployed the foundational Line Plan Data platform, enabling seamless data integration across 10+ Nike business domains. Onboarded 40+ consumer applications, with APIs serving 5,000+ requests/day, peaking to 10,000+ hits/day based on upstream change frequency. Optimized API throughput and caching strategies to achieve a 30% latency reduction and 50% fewer failures under load.
  • Migrated Legacy Application to Merchandising Platform with High-Performance Data Pipelines
    Led the modernization of legacy data ingestion to the Merchandising Platform by orchestrating large-scale batch jobs using Databricks (Spark) and Apache Airflow. Reduced daily data processing time by 45%, improved pipeline reliability by 40%, and decreased operational overhead through automation. Leveraged Kafka Streams for scalable event processing and engineered custom sink connectors to land data into DynamoDB with 99.9% delivery accuracy. Tuned OpenSearch and DynamoDB (provisioned vs serverless) to optimize cost-performance, resulting in 35% lower infrastructure cost for the application.

Management Skills

Manager – Delivery, Cognizant, 12/31/18, Managed Resourcing for Data Warehousing Org for North America., Conducted technical interviews, mentoring interviewers, mentoring internal candidates to prepare for client interviews., Partnered with clients for user profiles, participated in Request for Proposal (RFP) creation to win projects for Cognizant., Participated in Revenue forecast meetings to present Resourcing progress for the Data warehousing group for Cognizant's Pacific West accounts., Played the role of Engineering Manager as a Stretch Assignment for the Product Merchandising Platform team from 01/01/23 to 12/31/24.

Timeline

Lead Engineer

Nike
04.2023 - Current

Software Engineering Lead

Nike
03.2021 - 04.2023

Senior Data Engineer

Nike
06.2020 - 02.2021

Lead Engineer

Nike
02.2020 - 02.2021

Senior Data Engineer

Nike
01.2018 - 06.2020

Manager, Delivery

Cognizant Technology Solutions
03.2015 - 01.2018

Senior Data Engineer

Cognizant Technology Solutions
01.2012 - 01.2018

Senior Data Engineer

Hexaware Technologies
09.2011 - 01.2012

Senior Data Engineer

Cognizant Technology Solutions
11.2009 - 09.2011

Data Engineer

Infosys Technologies Ltd
06.2006 - 11.2009

B.Tech - Civil Engineering

Indian Institute of Engineering Science and Technology (IIEST)
NILADRI DAS CHOUDHURYLead Engineer / Data Architect