Manoj Kumar Kerala Pulikela
Glassboro
Summary
Data Professional with a Master of Science in Data Science and a Bachelor of Technology in Electronics and Communication Engineering. Delivered impactful data modeling and integration solutions through expertise in Python, Java, R, SQL, and cloud platforms, demonstrated in projects involving Medallion architecture on Databricks. Pursuing Databricks Data Engineer Associate certification to enhance data engineering capabilities. Practical database engineer possessing in-depth knowledge of data manipulation techniques and computer programming paired with expertise in integrating and implementing new software packages and new products into system. Offering several-year background managing various aspects of development, design and delivery of database solutions. Tech-savvy and independent professional bringing outstanding communication and organizational abilities. Meticulous professional brings expertise in testing, validating, and reformulating models. Employs statistical software to manipulate data and forecast outcomes. Proven history of designing and implementing data collection innovations.
Overview
3
3
years of professional experience
1
1
Certification
Work History
Junior Data Engineer
DEF Analytics
New York
06.2023 - Current
- Designed scalable ELT pipelines processing 500M+ records monthly.
- Led migration of legacy SQL Server environment to modern cloud architecture using Azure Data Lake, Snowflake, and Databricks.
- Built Delta Lake architectures in Databricks to enable reliable, scalable analytics.
- Enhanced query performance 45% through advanced indexing, partitioning, and execution plan optimization.
- Provided architectural recommendations that reduced data latency by 30%.
- Collaborated with workforce planning teams to provide accurate forecasting datasets.
- Collaborated with 10+ cross-functional stakeholders including analysts, architects, and leadership.
- Set up replication tasks in MySQL and PostgreSQL to synchronize changes across environments.
Data Engineer
AIG
New York
12.2022 - 06.2023
- Designed and implemented scalable ETL/ELT pipelines using Hive, Spark SQL, PySpark, and Pig, processing data from multiple sources including SQL, Oracle, Excel, JSON, and XML.
- Developed and optimized Spark applications in Scala for data transformation, cleaning, and aggregation, while creating reusable PL/SQL components to enforce business rules.
- Engineered HBase row keys and managed Hadoop Data Lake ingestion, enhancing storage and retrieval efficiency for structured and semi-structured data.
- Built and deployed data pipelines on AWS services, including S3 for data storage, EMR for big data processing, and AWS Lambda for serverless workflow automation.
- Automated workflows using Apache Airflow and implemented CI/CD pipelines with Jenkins, facilitating continuous delivery of data solutions.
- Implemented data quality checks, transformation rules, and pipeline monitoring, ensuring accuracy and reliability of large-scale datasets.
- Built dashboards and reports using Power BI and Tableau, and conducted data exploration and modeling with Zeppelin and Jupyter notebooks.
- Applied UML modeling (use cases, activity diagrams, sequence diagrams, and data flow diagrams) for robust ETL and system design.
- Worked closely with stakeholders in Agile/Scrum teams, participating in sprint planning, daily stand-ups, and retrospectives to deliver incremental data engineering solutions.Data management: managed and arranged massive datasets, maintaining their accessibility and integrity.
- Advance Analytics: To extract significant insights to inform decision-making, extensive data analysis was carried out using Python and other tools.
- Visualization and Reporting: Developed Tableau-based interactive dashboards and reports that made data trends and findings understandable to stakeholders. Created visualizations for data-driven decision-making by emphasizing important findings.
Education
Masters - Data Science
Rowan University
Glassboro, NJ01.2024
Bachelor's - Electronics and communications
Gokaraju Rangaraju Institute of Engineering and Technology
Hyderabad, India01.2022
Skills
Big Data Technologies
Hadoop, MapReduce, Spark (Core, SQL, Streaming, MLlib), Hive, Pig, Sqoop, HDFS, YARN, Oozie, Airflow, Cloudera, Impala, HBase
Programming Languages
Python, PySpark, Scala, SQL, PL/SQL, T-SQL, C, C, PowerShell, Shell scripting
Cloud Services
Azure Data Factory, Blob storage, Data Analytics, Data Bricks Azure SQL DB, Data Bricks, AWS RDS, SaaS, Amazon Redshift, Amazon SQS, Amazon S3, AWS EMR, AWS S3, Redshift, Glue, AWS SNS, BiqQuery
Databases
Snowflake, Teradata, Oracle, SQL Server, PostgreSQL, MySQL, MS Access
NoSQL Data Databases
MongoDB, Cassandra, DynamoDB, HBase, Cosmos DB
ETL & Orchestration Tools
DBT, Informatica, Talend, SSIS, Oozie, Apache Airflow, Prefect, Cloud Composer, Apache NiFi, AWS Step Functions, DataStage, Stitch ETL
Certification
- Rust Essential Training, LinkedIn Learning, 12/01/23
- Databricks - Data Engineer Associate, 05/01/23
- Project Completion on Data Science from Plot My Data - 1stop Solutions, 07/01/21
- Certified Intern on Data Science - 1stop Solutions (IIT Kanpur), 11/01/21
Projects
- Visual Analytics Science and Technology (VAST) Challenge 2018, Tableau, D3, Python, Played a pivotal role in the VAST Challenge 2018-Mine Challenge 3 project, where our objective was to analyze complex datasets. Designed and developed interactive visualizations and dashboards to uncover patterns, trends, and anomalies within the data.
- Bank Segmentation Analysis, Databricks, AWS S3, Conducted bank segmentation analysis using Databricks and AWS S3, leveraging Databricks' advanced data analytics features and AWS S3's reliable storage system to categorize bank clients into specific groups based on demographics, transaction trends, and financial habits.
- Analyzing Public Schools, MongoDB, Tableau Visualizations, Presented MongoDB as a powerful distributed database solution for managing and processing massive data collections.
- Parkinson's Disease Classification, Python, Jupyter, Led a Python project focused on different variables to diagnose the presence of PD through individuals.
Timeline
Junior Data Engineer
DEF Analytics
06.2023 - Current
Data Engineer
AIG
12.2022 - 06.2023
Masters - Data Science
Rowan University
Bachelor's - Electronics and communications
Gokaraju Rangaraju Institute of Engineering and Technology