Santiago A. Bueno IV
San Antonio
Summary
Dynamic Test Management Psychologist with a growing track record at the United States Air Force, specializing in psychometric testing and research methodology. Skilled in data analysis and generative AI prompt engineering, I successfully automated processes, enhancing efficiency by up to 80%. Adept at collaborating with stakeholders and subject matter experts to drive impactful test solutions.
Overview
6
6
years of professional experience
Work History
Test Management Psychologist
Studies and Analysis Squadron: Airman Advancement, United States Air Force
Randolph AFB
07.2024 - Current
- Aided in the development of job knowledge tests to be used for promotion of enlisted Airmen using psychometrics, subject matter experts, and relevant references for approximately 16 tests of 9 career different fields.
- Validated the use of situational judgment test items (SJT) as a part of military promotion testing, including ongoing analyses on predicting SJT item difficulty, adverse impact, and the processes involved in the development of SJT items for approximately 40,000 test takers annually.
- Developed an Excel tool designed to automate the filling out of score keys. The tool can reduce a mandatory task that originally took over an hour to complete down to only 20 minutes.
- Developed an excel tool that can review a batch of 100 test items for the item-writing flaw of clueing. The excel tool was utilized to analyze a pool of 2358 items for the presence of clueing in order to determine the effects of clueing balancing methods across different specialty knowledge tests. The tool can be deployed in under 10 mins to catch clueing item-writing flaws that even the most experienced TMPs have missed.
- Wrote a paper that aimed to validate the use of AAA specific clueing balancing methods. The paper utilized a confirmatory factor analysis to provide evidence for convergent validity.
- Created prompts to utilize two different AI tools to develop new test items from scratch. The prompt has been utilized to develop items for 12 different tests across 7 different career fields.
- Identified and created a prompt for a second use case is to revive reliable obsolete items. This prompt is able to create items faster and more reliably than writing new items from scratch.
- Developed an excel tool that can automatically generate prompts to revive reliable obsolete items.
- I was one of the leads on the exploration of two AI tool use cases within AAA. Developed key metrics to capture the utility of these tools and represented AAA in dealing with AI stakeholders.
- Created and assisted in the expansion of the item difficulty scale worksheet to include new criteria to encompass innovative item types.
- Assisted with the development and roll out for the process for 27E innovative items.
- Aided in revising AAA’s standards and procedures for test development. I participated in group discussions, group edits, and developed an excel tool that can aid in the selection of a project’s length.
Accounting Specialist I
Choice Bank
Fargo
04.2022 - 05.2024
- Designed macros to partially automate the process of importing insurance statements.
- Processed statements monthly from over 20 different insurance companies valued at over $600,000.
- Insured that sensitive bank information was stored safely by following data stewardship practices.
- Collaborated and prepared data for insurance agents and their team in order to ensure that transactions were properly tracked and documented.
- Aided in the training of two additional accounting specialists. I trained them on the importing process which can be up to 90% faster than manually processing statements.
Research Psychologist Trainee: PCIP
Studies and Analysis Squadron: Airman Advancement, United States Air Force
Randolph AFB
06.2023 - 08.2023
- Created a quick guide of different innovative item types that has been utilized to develop prototype items for the PFE and has provided a blueprint for future item development.
- Conducted a literature review for over 10 different innovative item types for future item development use.
- Created and conducted a focus group for TMPs to gather evidence on the best use case for innovative item types and to highlight the most promising items to focus initial resources on.
- Briefed SAS and members of AFPC on the finding from the innovative item type literature review and focus group.
- Participated in the PCIP symposium with other interns from across the country at Hill AFB.
Accounting Specialist
Tracking Transactions
Boerne
04.2020 - 03.2022
- Designed macros specifically for the Tracking Transactions company to speed up micro-tasks involved in the formatting of commonly used excel forms.
- Processed statements monthly from over 15 different insurance companies valued at over $500,000.
- Insured that sensitive bank information was stored safely by following data stewardship practices.
Education
Master of Science - Industrial-Organizational Psychology
St. Mary’s University
San Antonio, TX05.2024
Bachelor of Arts - Psychology
St. Mary’s University
San Antonio, TX05.2020
Skills
- Microsoft Office
- RStudio
- SPSS
- Qualtrics
- PearsonVue
- Google Forms
- Generative AI prompt engineering
- Envision
- AskSage
- Psychometric testing
- Situational judgment tests
- Test development
- Data analysis
- Content validation
- Research methodologies
Conference Presentations
Bueno, S. A, 2024, The Impact of Techno-complexity on Productivity and Role Overload, Society for Industrial and Organizational Psychology Annual Conference, Chicago, IL, United States
Accomplishments
CAT II (Non-Supervisory) Civilian of the 3rd Quarter 1 July - 30 September 2024
Timeline
Test Management Psychologist
Studies and Analysis Squadron: Airman Advancement, United States Air Force
07.2024 - Current
Research Psychologist Trainee: PCIP
Studies and Analysis Squadron: Airman Advancement, United States Air Force
06.2023 - 08.2023
Accounting Specialist I
Choice Bank
04.2022 - 05.2024
Accounting Specialist
Tracking Transactions
04.2020 - 03.2022
Master of Science - Industrial-Organizational Psychology
St. Mary’s University
Bachelor of Arts - Psychology
St. Mary’s University