Advait Trivedi
Raleigh,NC
Summary
Results-driven Senior Data Engineer with over 5 years of experience in designing, building, and deploying scalable data pipelines
Overview
7
7
years of professional experience
Work History
Senior Data Engineer
Red Hat, Marketing Technology and Operations
Raleigh, NC
01.2022 - Current
- Built scalable, automated data ingestion pipelines (Airflow, PySpark, OpenShift Pipelines), creating a single reliable source for marketing analytics.
- Deployed data science apps and statistical models (e.g., RAPID A/B) on Kubernetes with automated GitLab CI/CD.
- Enforced data quality by embedding automated checks into dbt ingestion workflows.
- Mentored data scientists on production-ready coding, accelerating model deployment and adoption.
- Partnered with data science teams to apply ML/statistical methods to large, heterogeneous datasets.
Senior Data Scientist
Red Hat, Marketing Technology and Operations
Raleigh, NC
08.2019 - 01.2022
- Delivered $2M+ in new pipeline value by leading ML-driven cross-sell/up-sell initiative using XGBoost ensemble models.
- Built a lead recommendation engine and attribution model that transformed prioritization and engagement scoring.
- Collaborated on MLOps workflows running Monte Carlo simulations to forecast long-term customer value.
- Partnered with IBM Research to test Neurosymbolic AI and BERT encoders for automated software fingerprinting.
Machine Learning Intern
Red Hat, Global Partners and Alliances
Raleigh, NC
05.2018 - 05.2019
- Designed PySpark pipeline to parse and clean large-scale system log data from S3.
- Trained LSTM classifier that achieved 90% accuracy in identifying third-party software paths.
- Applied NLP (TopicRank, LDA, NER) to extract software indicators from process strings.
Education
M.S. - Computer Science
North Carolina State University
05.2019
B.Tech - Computer Science
Vellore Institute of Technology
05.2016
Skills
- Languages: Python, PySpark, SQL
- MLOps & DevOps: OpenShift, Containers, Tekton, Airflow, Git/GitLab
- Data & ML Frameworks: Pandas, Polars, NumPy, Scikit-learn, Keras, TensorFlow, XGBoost, LangChain, dbt, mlflow
- Cloud & Databases: S3, Redshift, Snowflake, Databricks, MySQL, MongoDB, REST APIs
Timeline
Senior Data Engineer
Red Hat, Marketing Technology and Operations
01.2022 - Current
Senior Data Scientist
Red Hat, Marketing Technology and Operations
08.2019 - 01.2022
Machine Learning Intern
Red Hat, Global Partners and Alliances
05.2018 - 05.2019
B.Tech - Computer Science
Vellore Institute of Technology
M.S. - Computer Science
North Carolina State University
Publications
- A novel oscillatory activation function that can speed up training and reduce parameters in convolutional neural networks.
- Full list available at Google Scholar