Abuchi Okeke
Senior Software Engineer
Bay Area,USA
Summary
Final-year Ph.D. Candidate in Information Technology (AI focus) and Senior Data/AI Engineer with extensive expertise in Big Data ecosystems, cloud services (Microsoft Azure, AWS, and Google Cloud Platform), and advanced machine learning methodologies, including neural networks and RAG LLM systems. Highly skilled in building scalable ETL pipelines and real-time data processing using Spark, Spark Streaming, Kafka, Docker, and orchestration tools, with a proven track record in enterprise-level software development and agile project management.
Overview
10
10
years of professional experience
1
1
Certification
Work History
Senior Software Engineer
Walmart
Sunnyvale, USA
07.2021 - Current
- Built and deployed AI models, including retrieval-augmented generation (RAG), to enhance analytics and decision-making processes.
- Wrote and maintained code for large-scale data pipelines using Python, Scala, and Java.
- Designed and built real-time data ingestion pipelines with Spark, NiFi, Kafka, Hive, and Airflow.
- Managed CI/CD workflows using GitHub, Jenkins, Docker, and Kubernetes.
- Developed ETL workflows (batch/backfill) with Spark, Hive, PySpark, and Airflow.
- Created software artifacts with Maven or SBT to support scalable data solutions.
- Composed SQL queries for OLAP databases using Hive Query Language.
- Conducted real-time data analysis with Spark Structured Streaming (Spark/PySpark).
- Designed and implemented Data Lake systems on Google Cloud Storage, leveraging GCP and Microsoft Azure.
- Optimized data processing pipelines and re-architected infrastructure for greater scalability.
- Developed software systems for data manipulation and feature extraction.
- Leveraged machine learning frameworks such as TensorFlow, PyTorch, and scikit-learn for training and deploying AI solutions.
- Performed unit testing, collaborated with cross-functional teams, and provided project leadership.
- Ensured on-time delivery and participated in Agile methodologies (Scrum, sprints).
- Provided on-call support for existing data pipelines and stakeholder engagement.
- Maintained best coding practices, model compliance, and data privacy standards.
Big Data Engineer
Mobile Apps Enterprises LLC d/b/a Enhance IT
Atlanta, USA
09.2020 - 06.2021
- Designed and built real-time and batch data pipelines using Pyspark, Spark Structured Streaming, Flume, Nifi, Kafka, Airflow, and Hive.
- Collected data, organized, visualized, and developed supervised machine learning models with 92% model accuracy.
- Developed analytical dashboards and extracted insights from data using Power BI, Grafana, and Tableau.
- Installed, configured, and set up Apache Spark pipeline (Python and Scala) integrated with different RDBMS, HDFS, and Hive.
- Ingested structured, semi-structured, and unstructured data to HDFS using Spark RDD, Data frames and Dataset APIs.
- Imported data from different databases, such as MySQL, PostgreSQL, SQL Server, to HDFS.
- Set up PySpark pipelines to ingest data in different file formats, such as AVRO, ORC, PARQUET, CSV, and JSON, into HDFS.
- Enabled Hive Support in Spark Pipeline to query HIVE external and internal tables.
- Used Spark SQL to query Hive tables, write, and save to an external RDBMS.
- Used Spark Data frame APIs to query Hive tables for different actions and data transformations.
- Exported queried data from Hive internal tables to external RDBMS.
- Integrated visualization of Spark Data frame using Pandas, Python, Matplotlib, and Power BI.
- Managed, scheduled all workflows in the Apache Spark pipeline using the Airflow orchestration tool.
- Created an Airflow Directed Acyclic Graph (DAG) to automate the workflows into different tasks.
Graduate Research Assistant
University of Kentucky
Lexington, USA
01.2019 - 08.2020
- Planned, modified, and executed research techniques, procedures, and tests.
- Prepared materials for reports, presentations, and submission to peer-reviewed journal publications.
- Designed experiments, collected data, analyzed, and extracted data insights.
- Prototyped machine learning (ML) models for data analyses, classification, and predictions.
- Performed ML model evaluations, data visualization, and result presentations.
- Developed an ETL data pipeline for research data processing.
- Wrote and submitted conference papers for publications.
- Experienced in Machine Learning model deployment and integration using Pickle, Joblib, or MLOps on cloud systems (AWS and Azure).
Software Engineer
Team Apt Limited
Lagos, Nigeria
03.2018 - 12.2018
- Wrote highly maintainable, solid code in Java for Android system, display pipeline (Drawing, Rendering, Compositing), and JNI.
- Integrated multiple systems to move data between layers of the software stack.
- Worked closely with software development and testing team members to design and develop robust mobile app solutions to meet client requirements for functionality, scalability, and performance.
- Created new UI Screens and key resources for layout UI work utilizing XML, Shape Drawable, TextView, ConstraintLayout, Web Views, and so on.
- Fixed bugs and improved application performance.
- Worked with the existing code base, debugged, fixed, and cleaned up crashes.
- Deployed applications to Android APK and to the Google Play Store.
- Worked on the following Apps on Google Play: Sterling OnePay, Sterling AltPay, and Unify by Unity Bank.
Web Developer
Belle Naturals NG LTD
Lagos, Nigeria
01.2015 - 02.2018
- Created new features, functionality, and capabilities on the client’s websites and site administrative front-end using HTML, CSS, JavaScript, and PHP.
- Performed bug fixes and added new features to an existing content management system’s (WordPress) website.
- Developed a full-functioning e-commerce website (https://bellenaturels.com/) using the WooCommerce stack, HTML, CSS, JavaScript, and PHP.
- Experienced in setting up Python REST API Framework using Django.
- Developed web applications and implemented Model View Control architecture using Django, Flask, and Spring web application frameworks.
Education
Doctor of Philosophy (Ph.D.) - Information Technology, Area of specialization in Artificial Intelligence (Large Language Models in chatbot)
University of The Cumberlands
Cumberland, KY05.2026
Master of Science (MSc.) - Biosystems Engineering, Area of specialization in Machine Learning
University of Kentucky
Lexington, Kentucky, USA08.2020
Bachelor of Science - Environmental Engineering
University of Ibadan, Nigeria
NigeriaSkills
- Deep Learning / LLM: Transformer, BERT/BGE, GPT-J/NeoX, RAG, PEFT/LoRA, RLHF
- Recommendation and IR: Two-tower, DSSM, DIN/DIEN, DCN-V2, Faiss, ScaNN, LightFM
- Frameworks: PyTorch, TensorFlow, Hugging Face Transformers, PyG, Ray, Spark MLlib
- Big Data & Orchestration: Spark, Kafka, Airflow, Beam, Flink, NiFi, Hadoop, Hive
- Cloud & Storage: GCP (GCS, Dataproc, BigQuery, Vertex AI), AWS (EMR, S3, SageMaker), Azure
- MLOps and DevOps: MLflow, Kubeflow, Docker, Kubernetes, GitHub Actions, and Jenkins
- Languages: Python, Scala, Java, SQL, Shell
- Research methodology
Certification
- Azure AI Engineer Associate (9D32017423861F85)
Timeline
Senior Software Engineer
Walmart
07.2021 - Current
Big Data Engineer
Mobile Apps Enterprises LLC d/b/a Enhance IT
09.2020 - 06.2021
Graduate Research Assistant
University of Kentucky
01.2019 - 08.2020
Software Engineer
Team Apt Limited
03.2018 - 12.2018
Web Developer
Belle Naturals NG LTD
01.2015 - 02.2018
Doctor of Philosophy (Ph.D.) - Information Technology, Area of specialization in Artificial Intelligence (Large Language Models in chatbot)
University of The Cumberlands
Master of Science (MSc.) - Biosystems Engineering, Area of specialization in Machine Learning
University of Kentucky
Bachelor of Science - Environmental Engineering
University of Ibadan, Nigeria
Similar Profiles
Khylah DawsonKhylah Dawson
Personal Shopper at WalmartPersonal Shopper at Walmart
Tony RoyTony Roy
Grocery Team Lead at WalmartGrocery Team Lead at Walmart
Leona BaucomLeona Baucom
Sam's Club FC Area Manager at WalmartSam's Club FC Area Manager at Walmart
Jana WoodJana Wood
Unloaader/Processor Operator at WalmartUnloaader/Processor Operator at Walmart
ANANTH TIRUANANTH TIRU
Director, Product Strategy, Architecture & Execution at US BANKDirector, Product Strategy, Architecture & Execution at US BANK