SUJI SURENDRAN K
Kochi,India
Summary
Data Engineer with 4.8 years of experience in the retail domain.
Organized and dependable candidate successful at managing multiple priorities with a positive attitude. Willingness to take on added responsibilities to meet team goals.
Overview
5
5
years of professional experience
Work History
Project Name: Market Place Acceleration
Market Place Acceleration
04.2024 - Current
- Technologies used: Python, Spark, GCP, Airflow, Automic, SQL
- Currently working with client team for accelerating their online shopping worldwide by using different tools and platforms that are leveraged to meet the needs of downstream consumer's consumption patterns.
- Maintenance of seller portal mainly used by the company and sellers for improving their sales.
- Automated batch pipelines and validated end-to-end data flow from source to BigQuery.
- Pulling data from Kafka and publishing to hive tables using Scala Spark jobs through google cloud platform and exporting data to Druid Data source.
Cloud Data Engineer
UST
07.2021 - Current
- Worked extensively with Walmart through UST on enterprise data engineering initiatives.
- Experience in developing end-to-end data pipelines and cloud-based data solutions.
- Developed and optimized large-scale data platforms and distributed data processing solutions.
- Led a successful Airflow migration project by directing a team to deliver results ahead of schedule.
- Hands-on expertise in Apache Spark, Scala, Kafka, Hive, GCP, SQL, Airflow and real-time/batch processing workflows.
- Proficient in Agile methodologies with strong debugging, monitoring, and production support capabilities.
- Delivered high-quality, trusted datasets for business and analytics stakeholders.
- Awarded Rising Star, Shining Star for exceptional contributions.
Project Name: GCP Migration
GCP Migration
02.2023 - 03.2024
- Technologies used: Python, Spark, GCP, Airflow, Automic, SQL
- Was part of platform team consisting of direct interaction with clients and worked in multiple Roles defined to Development, Data migrations, Testing, Production support in various areas
- Migrated cloud-based data solutions.
- Improved data SLAs by addressing production.
- Collaborated with business teams to define workflow requirements and ensure delivery.
Project Name: Airflow Migration
Airflow Migration
07.2021 - 01.2022
- Technologies used: Python, GCP, Airflow, SQL
- Migrated workflows from legacy systems to Airflow
- Built scalable, fault-tolerant DAGs to automate data ingestion and transformation processes on GCP.
- Performed detailed validation across systems to ensure data quality and consistency.
Education
Master of Science - Mathematics
Cochin University Of Science And Technology
Kalamassery03-2020
Bachelor of Science - Mathematics
Christ College Irinjalakuda
Irinjalakuda03-2018
Skills
- Languages: Scala, Python, SQL
- Big Data: Apache Spark, Hadoop, Hive, Sqoop, Kafka, Druid
- Frameworks: Laminar, Spark SQL
- Cloud Platforms: Google Cloud Platform (GCP)
- Databases: Informix, MSSQL, Oracle, BigQuery
- Schedulers: Apache Airflow, Automic
- Version Control & Tools: GitHub, Jira, SuperPutty
- OS: Windows
- Domain: Retail
- Soft Skills: Team Leadership, Communication, Agile Methodology, Problem Solving
DOMAIN EXPERIENCE
- Worked extensively in Retail domain with specialization in Finance and Ecomm operations.
- Managed end-to-end delivery including development, migrations, testing, and support.
- Interacted with clients and third-party teams for requirement analysis and service delivery.
Timeline
Project Name: Market Place Acceleration
Market Place Acceleration
04.2024 - Current
Project Name: GCP Migration
GCP Migration
02.2023 - 03.2024
Cloud Data Engineer
UST
07.2021 - Current
Project Name: Airflow Migration
Airflow Migration
07.2021 - 01.2022
Master of Science - Mathematics
Cochin University Of Science And Technology
Bachelor of Science - Mathematics
Christ College Irinjalakuda