The AI-IP: Minimizing the guesswork of personality scale item development through artificial intelligence

Simple item page
dc.contributor.authorHernandez, Ivanen
dc.contributor.authorNie, Weiwenen
dc.date.accessioned2023-01-05T15:48:17Zen
dc.date.available2023-01-05T15:48:17Zen
dc.date.issued2022en
dc.description.abstractWe propose a framework for integrating various modern natural language processing (NLP) models to assist researchers with developing valid psychological scales. Transformer-based deep neural networks offer state-ofthe- art performance on various natural language tasks. This project adapts the transformer model GPT-2 to learn the structure of personality items, and generate the largest openly available pool of personality items, consisting of one million new items. We then use that artificial intelligencebased item pool (AI-IP) to provide a subset of potential scale items for measuring a desired construct. To better recommend construct-related items, we train a paired neural network-based classification BERT model to predict the observed correlation between personality items using only their text. We also demonstrate how zero-shot models can help balance desired content domains within the scale. In combination with the AI-IP, these models narrow the large item pool to items most correlated with a set of initial items. We demonstrate the ability of this multimodel framework to develop longer cohesive scales from a small set of construct-relevant items. We found reliability, validity, and fit equivalent for AI-assisted scales compared to scales developed and optimized by traditional methods. By leveraging neural networks’ ability to generate text relevant to a given topic and infer semantic similarity, this project demonstrates how to support creative and open-ended elements of the scale development process to increase the likelihood of one’s initial scale being valid, and minimize the need to modify and revalidate the scale.en
dc.description.versionPublished versionen
dc.format.mimetypeapplication/pdfen
dc.identifier.doihttps://doi.org/10.1111/peps.12543en
dc.identifier.urihttp://hdl.handle.net/10919/113042en
dc.identifier.volume2022en
dc.language.isoenen
dc.publisherWileyen
dc.rightsCreative Commons Attribution 4.0 Internationalen
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/en
dc.subjectArtificial intelligenceen
dc.subjectBig dataen
dc.subjectMachine learningen
dc.subjectPersonalityen
dc.subjectPersonality assessmenten
dc.subjectTechnologyen
dc.titleThe AI-IP: Minimizing the guesswork of personality scale item development through artificial intelligenceen
dc.title.serialPersonnel Psychologyen
dc.typeArticle - Refereeden
dc.type.dcmitypeTexten

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Personnel Psychology - 2022 - Hernandez.pdf
Size:
654.19 KB
Format:
Adobe Portable Document Format
Description:
Published version
Download
License bundle
Now showing 1 - 1 of 1
Name:
license.txt
Size:
1.5 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

Scholarly Works, Psychology