Jacob Carson
WA
Summary
Founding-level Senior Engineer with over 6 years of experience building and scaling high-throughput, real-time AI platforms. Specialized in Voice and Conversational AI Agents, with a proven track record of deploying autonomous systems that handle millions of interactions. Expert in Distributed Systems architecture, Python, and Node.js, with deep practical experience in LLM evaluations, prompt engineering, and guardrail strategies. Thrives in fast-paced startup environments, driving innovation through AI tools to build scalable, robust systems focused on simplicity and efficiency.
Overview
6
6
years of professional experience
Work History
Senior AI Infrastructure Engineer
PortKey
10.2024 - Current
- Lead the development of scalable, user-facing software that simplifies complex service interactions.
- Architected a high-throughput AI Gateway managing multi-turn conversational workflows across 15+ LLM endpoints, focusing on sub-second interaction latency.
- Own the full lifecycle of the AI platform on Kubernetes (EKS), implementing automated failover and cost-monitoring strategies for high-volume agent deployments.
- Leveraged Terraform to provision scalable cloud resources, ensuring the platform autonomously handles peak conversation spikes while maintaining high standards for security and privacy.
- Built custom monitoring dashboards to track agent accuracy and response latency, utilizing real-time interaction data to iterate on system performance and user experience.
Co-Founder & CTO (AI Product Lead)
PullPiece
01.2024 - 10.2024
- Designed and delivered an end-to-end Voice and SMS AI Agent platform enabling local businesses to automate customer interactions and appointment bookings.
- Developed complex multi-step reasoning patterns and orchestration logic using OpenAI and Gemini models, ensuring dependable and interpretable agent behavior.
- Demonstrated ability to work iteratively-rapidly prototyping, testing, and improving features based on real-world feedback to refine products through continuous learning.
- Collaborated with engineering, product, and data science teams to deliver end-to-end functionality with a focus on human-centered design.
Senior Full Stack & Infrastructure Engineer
ClicData
06.2022 - 12.2023
- Designed and maintained distributed data services handling 15,000 rows per second, utilizing Python and Java to power complex real-time analytics for medium-to-large-scale systems.
- Implemented robust backend systems that integrate with diverse data sources and APIs, emphasizing low-latency retrieval and high availability.
- Contributed to technical documentation and recommendations for future scaling, ensuring systems are inclusive, well-designed, and secure.
Software Engineer
VLink Info
03.2020 - 06.2022
- Guided the migration of legacy monoliths to Node.js (TypeScript) microservices architecture to support modernization efforts for complex ecosystems.
- Worked on integrated cross-functional teams to build new systems and make improvements to existing ones, setting high standards for code quality and test coverage.
Education
Bachelor of Science - Computer Science
Cornell University
01.2020
Skills
- Autonomous Voice/SMS Agents
- OpenAI
- Anthropic
- Gemini
- LangChain/LangGraph
- LLM Evaluations (Accuracy/Latency/Cost)
- Guardrail Strategies
- Python (FastAPI/Flask)
- Nodejs (TypeScript)
- Go
- Ruby on Rails
- Distributed Systems
- Microservices
- REST & WebSockets
- AWS (EKS, Lambda, S3, RDS)
- Kubernetes
- Docker
- Terraform (IaC)
- CI/CD (GitHub Actions)
- Monitoring & Observability
- Real-time Conversational Workflows
- Twilio (Voice/SMS)
- Kafka
- PostgreSQL
- Redis Cache
Technical Skills
Autonomous Voice/SMS Agents, OpenAI, Anthropic, Gemini, LangChain/LangGraph, LLM Evaluations (Accuracy/Latency/Cost), Guardrail Strategies, Python (FastAPI/Flask), Node.js (TypeScript), Go, Ruby on Rails, Distributed Systems, Microservices, REST & WebSockets, AWS (EKS, Lambda, S3, RDS), Kubernetes, Docker, Terraform (IaC), CI/CD (GitHub Actions), Monitoring & Observability, Real-time Conversational Workflows, Twilio (Voice/SMS), Kafka, PostgreSQL, Redis Cache
Bonus Points Specialized Ai Expertise
- Proven track record in developing and integrating generative AI applications using models from OpenAI, Anthropic, and Gemini.
- Passionate about building large-scale systems that are inclusive, fast, and secure, with a strong focus on simplicity and empathy for the end-user.
- Advanced experience in DevOps, agile practices, and automated testing to ensure the delivery of functional, resilient software for production.
Personal Information
Title: Senior AI Infrastructure Engineer
Timeline
Senior AI Infrastructure Engineer
PortKey
10.2024 - Current
Co-Founder & CTO (AI Product Lead)
PullPiece
01.2024 - 10.2024
Senior Full Stack & Infrastructure Engineer
ClicData
06.2022 - 12.2023
Software Engineer
VLink Info
03.2020 - 06.2022
Bachelor of Science - Computer Science
Cornell University