Shrikant Karamkar
Fuquay-Varina,North Carolina
Summary
Automation Engineer with over 18 years of experience in evaluating and validating large language models for diverse sectors, including finance and retail banking. Proficient in LLM evaluation, RAG pipeline testing, and database validation across multiple platforms. Expertise in performance engineering tools and cross-platform automation, alongside significant experience in big data testing. Proven track record in mentoring software development engineers in test (SDETs).
Overview
19
19
years of professional experience
1
1
Certification
Work History
Principal Software Developer in Test
Ascensus
Remote, NC
02.2017 - Current
- Deployed DeepEval to validate multiple Azure OpenAI LLM models’ outputs in Azure Pipeline, achieving a 99.99% prompt accuracy rate across 5,000+ automated test cases, enhancing the reliability of AI-driven features.
- Identified and resolved 25+ critical prompts for RAG, Conversational AI, Summarizations, and auto draft inaccuracies before production deployment, ensuring high-quality user experiences using LLM metrics.
- Developed 95% of UI regression test cases using Playwright and PyTest, 100% of regression on FASTApi endpoints, reducing manual testing effort by over 40 hours per release, and accelerating delivery cycles by 50%.
- Engineered automated test frameworks with PyTest, C#, Selenium, and N/Xunit to validate data integrity across 10+ GraphQL-integrated sources, including REST APIs, Sybase, PostgreSQL, Vector Databases, and MySQL server, enhancing data quality, and reducing integration errors by 15% before production.
- Implemented multiple types of synthetic alerts using New Relic to act as a first line of quality control.
- Established a performance testing framework with JMeter and Taurus, identifying and resolving bottlenecks early, which reduced average response times by 25% and improved system stability by adding a CI/CD pipeline, TeamCity, and Octopus.
Senior Software Developer in Test
Comcast Corporation
Philadelphia, PA
11.2013 - 02.2017
- Led the design of UI automation solutions for Comcast Xfinity Website, Mobile applications that eliminated 90% of repetitive manual testing, ensuring higher consistency and faster feedback loops in Agile sprints.
- Spearheaded mobile and web automation initiatives using Cucumber, Calabash, and Capybara (Ruby), enhancing cross-platform test coverage and reliability.
- Engineered a Python-based MITM (Man-in-the-Middle) framework for comprehensive API mocking and validation, streamlining backend testing processes.
- Delivered robust automation solutions across platforms by leveraging Selenium, Appium, REST Sharp, and Jenkins, resulting in improved integration and accelerated delivery pipelines.
- Introduced baseline monitoring and performance thresholds for APIs, resulting in 40% quality improvement and a 60% reduction in API-related bugs.
Senior Associate
Cognizant Technology Solutions
Laurel, MD
08.2011 - 11.2013
- Reduced defect leakage to production by 35% by integrating comprehensive end-to-end automation, leading to higher product quality and improved customer satisfaction.
- Successfully migrated QA processes and tools from QTP to Selenium, JMeter, and the Jira ecosystem, enhancing automation capabilities and streamlining test management.
- Designed and implemented hybrid keyword- and data-driven automation frameworks using Excel and VBScript, significantly increasing test efficiency and maintainability.
- Led end-to-end QA automation for web and desktop applications, effectively coordinating efforts between onsite and offshore teams to ensure seamless project delivery.
Senior System Engineer
Infosys Technologies
Durham, NC
03.2011 - 08.2011
- Automated testing benefits large-scale projects that undergo frequent changes by speeding up the testing process and making deliveries within a stipulated timeline.
- Created SQL scripts to validate UI data and generated the reports for the same.
Senior System Engineer
Infosys Technologies
Pune, India
11.2006 - 08.2011
- Implemented testing for mobile apps on Android/iOS using C#, ASP.NET, and Increased team productivity by 25% through standardizing automation frameworks and minimizing repetitive manual tasks.
- Created advanced SQL and shell scripts to automate test data generation and streamline reporting processes, enhancing data accuracy and testing efficiency.
Education
Bachelor of Engineering - Information Technology
Nagpur University
Nagpur, Maharashtra, India05-2006
Skills
- Test framework design
- Continuous integration
- Performance testing
- API validation
- Test automation frameworks
- Cross-platform testing
- Microsoft Azure
Certification
- ISTQB – CTFL, ITB-CTFL-00105026-INDIA
- ISTQB Agile Tester, ASTQB 21-CTFL-AT-00042-USA
- PMI – Generative AI for Project Managers
Timeline
Principal Software Developer in Test
Ascensus
02.2017 - Current
Senior Software Developer in Test
Comcast Corporation
11.2013 - 02.2017
Senior Associate
Cognizant Technology Solutions
08.2011 - 11.2013
Senior System Engineer
Infosys Technologies
03.2011 - 08.2011
Senior System Engineer
Infosys Technologies
11.2006 - 08.2011
Bachelor of Engineering - Information Technology
Nagpur University
Similar Profiles
STEPHANIE WENDLERSTEPHANIE WENDLER
Office Administrator at AscensusOffice Administrator at Ascensus
Katie StroupeKatie Stroupe
Retirement Service Consultant at AscensusRetirement Service Consultant at Ascensus
Todd BrookerTodd Brooker
Client Relationship Manager/Senior Retirement Services Consultant at AscensusClient Relationship Manager/Senior Retirement Services Consultant at Ascensus
Esther AneyoEsther Aneyo
Customer Service Representative at AscensusCustomer Service Representative at Ascensus
Matthew SlentzMatthew Slentz
Office Assistant at Food LionOffice Assistant at Food Lion