SUNANDA THOTA
Jacksonville
Summary
Senior Software Architect skilled in leading cross-functional teams and driving efficiency through innovative solutions. Proven track record of optimizing LLM applications and microservices, achieving significant performance improvements and streamlining operations. Dynamic Senior Data Architect specializing in AWS, Kubernetes, and Java. Proven track record in leading high-impact projects that optimize data processing and enhance system performance.
Overview
12
12
years of professional experience
Work History
Senior Data Architect
CEVA Logistics Inc.
Jacksonville
01.2022 - Current
- Led the design and development of a tools orchestration workflow for an LLM-powered application, managing a team of 4 engineers to build a multi-threaded asynchronous batch processing system using AWS Batch and Docker (AWS ECR). Integrated multiple APIs/tools for data enrichment, optimizing LLM model invocation and handling high-volume processing, improving efficiency by 25%.
- Developed a RAG service leveraging OpenSearch vector search and a multilingual-e5-large LangChain model on SageMaker for embedding generation. Combined similar item retrieval with prompt tuning (zero-shot and few-shot), resulting in a 4% improvement in LLM labeling accuracy.
- Built an Offline Image Similarity Search system using Faiss-Hnsw to index and retrieve high-dimensional image embeddings at scale. Experimented with IVFFlat, IVFPQ, and nmslib-hnsw, ultimately selecting Faiss-Hnsw to prioritize low-latency retrieval over billion-scale embeddings. Integrated AWS Step Functions, Lambda, DynamoDB, and API Gateway to handle high-throughput image retrieval. Designed custom embedding techniques to improve retrieval accuracy, enabling efficient processing of large-scale image datasets.
- Designed and developed a modular ML model invocation framework using AWS CDK, streamlining the separation of ML infrastructure and service logic. Integrated AWS Step Functions, Lambda, and SNS to enable asynchronous ML model execution, allowing seamless invocation and result retrieval. Adopted by 10 clients, reducing deployment time by 2 weeks per customer and improving ML model accessibility at scale
- Developed autonomous AI Agents to interface LLM-powered applications with external tools via AWS Lambda, leveraging multi-agent coordination strategies and GenAI-powered decision-making. Implemented modular design patterns for scalability, enabling seamless tool integration.
- Scaled couple of existing microservices from 10,000 TPS to 45,000 TPS by conducting comprehensive load testing and identifying bottlenecks, leading to a 10% performance improvement. Optimized Auto Scaling Groups (ASG), eliminated redundant API key throttles, and adjusted DynamoDB read/write capacities, resulting in more efficient system operations.
- Designed and developed a real-time cost reporting system, publishing daily client cost reports to enhance spending visibility. Identified around $500K in previously uncategorized expenses, enabling cost optimization and financial transparency.
- Managed on-call responsibilities, resolving an average of 18 tickets per shift, and handled scrum duties for over 12 weeks. Actively participated in code reviews and demos, contributing to code quality and team collaboration.
Senior Data Engineer
Blue Cross and Blue Shield of Florida Inc.
Jacksonville
12.2019 - 12.2021
- Collaborated with product managers and cross-functional teams to develop microservices for the Liquidity Bridge Team at MarketAxess, using Kafka for data flow and Kubernetes (EKS) for orchestration in AWS enhancing system performance and aligning technical solutions with business needs.
- Managed the ingestion and processing of over 500 million messages daily across multiple applications using an event-driven architecture with pub-sub patterns. Leveraged technologies including Apache KStream, MongoDB Atlas, Apache Camel, AWS, and Azure. Utilized Kubernetes for horizontal scaling, ensuring efficiency and reliability under high loads.
- Implemented Kafka MirrorMaker using Terraform to replicate kafka topics across regions, ensuring high availability and fault tolerance of data streams. Configured replication to handle regional failovers and maintain data consistency, optimizing cross-region data flow for enhanced system resilience.
- Designed and developed an Auto Redrive Tool using AWS SQS, Kinesis, Lambda, DynamoDB, APIGateway, Cloudwatch Alarm, CloudWatch logs and Event bridge which was used to redrive failed records in DLQ. Developed the whole cloud infrastructure as code in AWS CDK using Typescript. Decreased the number of on-call tickets every week by 30% using this tool.
Software Engineer
Mouri Tech
Visakhapatnam
10.2013 - 03.2019
- Part of an ‘Enterprise Payments Application’ team of 12, majorly working on US Real Time Business to Consumer Payments. Coordinated with all stages of software development life cycle from analysis, development, implementation, testing to production release success rate was nearly 95%.
- Developed various API’s (Web API’s & Data API’s) of a micro-services system using Java, Spring, Spring Boot and integrated them using MuleSoft Anypoint studio by utilizing the bank’s internal framework; Testing: 100% Unit tests coverage.
- Improved the applications lifetime by reducing complexities, duplications and potential bugs in the code by integrating SonarQube for all the API’s and increased the unit test coverage by 40%.
- Worked on Swagger API and auto-generated documentation for the REST calls present in all the API’s which saved 30% of the time of developers and testers.
- Set up CI/CD infrastructure using Jenkins to auto-deploy the APIs in different environments, which improved the team's efficiency by 30%.
- Designed and developed an Auto Redrive Tool using AWS SQS, Kinesis, Lambda, DynamoDB, APIGateway, Cloudwatch Alarm, CloudWatch logs and Event bridge which was used to redrive failed records in DLQ. Developed the whole cloud infrastructure as code in AWS CDK using Typescript. Decreased the number of on-call tickets every week by 30% using this tool.
Education
Bachelor of Science - Information Technology
MVGR College of Engineer
Vizianagaram04-2009
Skills
- Languages: Java, Python, C, C, TypeScript, SQL, HTML, CSS, JavaScript, ReactJS, Linux/Shell scripting Frameworks and other technologies: AWS, GenAI, ML model deployment, ML feature store, SageMaker, ANN search, HNSW, large language models, agents, prompt engineering, Kafka, K-Streams, Docker, HashiCorp Terraform, Spring Boot, Guice, Dagger, Git, JUnit, Mockito, REST API, Postman, TDD, Spark, Hadoop, Google Cloud, Microsoft Azure, UI/UX design, NoSQL, Redis
- Relevant coursework: Data structures and algorithms, distributed systems, analysis of algorithms, computer networks, big data analytics, data science, and machine learning
Timeline
Senior Data Architect
CEVA Logistics Inc.
01.2022 - Current
Senior Data Engineer
Blue Cross and Blue Shield of Florida Inc.
12.2019 - 12.2021
Software Engineer
Mouri Tech
10.2013 - 03.2019
Bachelor of Science - Information Technology
MVGR College of Engineer