Using artificial intelligence to assess personal qualities in college admissions

Simple item page
dc.contributor.authorLira, Benjaminen
dc.contributor.authorGardner, Margoen
dc.contributor.authorQuirk, Abigailen
dc.contributor.authorStone, Cathlynen
dc.contributor.authorRao, Arjunen
dc.contributor.authorUngar, Lyleen
dc.contributor.authorHutt, Stephenen
dc.contributor.authorHickman, Louisen
dc.contributor.authorD'Mello, Sidney K.en
dc.contributor.authorDuckworth, Angela L.en
dc.date.accessioned2023-12-20T20:24:28Zen
dc.date.available2023-12-20T20:24:28Zen
dc.date.issued2023-10-13en
dc.description.abstractPersonal qualities like prosocial purpose and leadership predict important life outcomes, including college success. Unfortunately, the holistic assessment of personal qualities in college admissions is opaque and resource intensive. Can artificial intelligence (AI) advance the goals of holistic admissions? While cost-effective, AI has been criticized as a "black box" that may inadvertently penalize already disadvantaged subgroups when used in high-stakes settings. Here, we consider an AI approach to assessing personal qualities that aims to overcome these limitations. Research assistants and admissions officers first identified the presence/absence of seven personal qualities in n = 3131 applicant essays describing extracurricular and work experiences. Next, we fine-tuned pretrained language models with these ratings, which successfully reproduced human codes across demographic subgroups. Last, in a national sample (N = 309,594), computer-generated scores collectively demonstrated incremental validity for predicting 6-year college graduation. We discuss challenges and opportunities of AI for assessing personal qualities.en
dc.description.versionPublished versionen
dc.format.extent10 page(s)en
dc.format.mimetypeapplication/pdfen
dc.identifierARTN eadg9405 (Article number)en
dc.identifier.doihttps://doi.org/10.1126/sciadv.adg9405en
dc.identifier.eissn2375-2548en
dc.identifier.issn2375-2548en
dc.identifier.issue41en
dc.identifier.orcidHickman, Louis [0000-0002-2752-7705]en
dc.identifier.pmid37824610en
dc.identifier.urihttps://hdl.handle.net/10919/117238en
dc.identifier.volume9en
dc.language.isoenen
dc.publisherAAASen
dc.relation.urihttps://www.ncbi.nlm.nih.gov/pubmed/37824610en
dc.rightsCreative Commons Attribution 4.0 Internationalen
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/en
dc.subjectArtificial intelligenceen
dc.subjectCollege admissionsen
dc.subjectPersonal qualitiesen
dc.subject.meshHumansen
dc.subject.meshLanguageen
dc.subject.meshUniversitiesen
dc.subject.meshArtificial Intelligenceen
dc.titleUsing artificial intelligence to assess personal qualities in college admissionsen
dc.title.serialScience Advancesen
dc.typeArticle - Refereeden
dc.type.dcmitypeTexten
dc.type.otherArticleen
dc.type.otherJournalen
pubs.organisational-group/Virginia Techen
pubs.organisational-group/Virginia Tech/Scienceen
pubs.organisational-group/Virginia Tech/Science/Psychologyen
pubs.organisational-group/Virginia Tech/All T&R Facultyen
pubs.organisational-group/Virginia Tech/Science/COS T&R Facultyen

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Using artificial intelligence to assess personal qualities in college admissions.pdf
Size:
2.26 MB
Format:
Adobe Portable Document Format
Description:
Published version
Download
License bundle
Now showing 1 - 1 of 1
Name:
license.txt
Size:
1.5 KB
Format:
Plain Text
Description:
Download

Collections

All Faculty Deposits
Scholarly Works, Psychology