Backdrop Explorer:  A Human-AI Collaborative Approach for Exploring Studio Backdrops in Civil War Portraits

dc.contributor.authorLim, Ken Yoongen
dc.contributor.committeechairLuther, Kurten
dc.contributor.committeememberLee, Sang Wonen
dc.contributor.committeememberGitre, Edward Joseph Khairen
dc.contributor.departmentComputer Science and Applicationsen
dc.date.accessioned2023-06-15T08:00:17Zen
dc.date.available2023-06-15T08:00:17Zen
dc.date.issued2023-06-14en
dc.description.abstractIn historical photo research, the presence of painted backdrops have the potential to help identify subjects, photographers, locations, and jl{events surrounding} certain photographs. Yet, research processes around these backdrops are poorly documented, with no known tools to aid in the task. We propose a four-step human-AI collaboration workflow to support the jl{discovery} and clustering of these backdrops. Focusing on the painted backdrops of the American Civil War (1861 -- 1865), we present Backdrop Explorer, a content-based image retrieval (CBIR) system incorporating computer vision and novel user interactions. We evaluated Backdrop Explorer on nine users of diverse experience levels and found that all were able to effectively utilize Backdrop Explorer to find photos with similar backdrops. We also document current practices and pain points in Civil War backdrop research through user interviews. Finally, we discuss how our findings and workflow can be applied to other topics and domains.en
dc.description.abstractgeneralIn historical photo research, the presence of painted backdrops have the potential to help identify subjects, photographers, locations, and events surrounding certain photographs. Yet, research processes around these backdrops are poorly documented, with no known tools to aid in the largely manual task. We present Backdrop Explorer, a reverse image search system that helps users discover and subsequently group photos with similar backdrops. We evaluated the system and found that it effectively supported the tasks. We also document current practices and pain points in Civil War backdrop research. Finally, we discuss how our findings and system can be applied to other domains.en
dc.description.degreeMaster of Scienceen
dc.format.mediumETDen
dc.identifier.othervt_gsexam:38060en
dc.identifier.urihttp://hdl.handle.net/10919/115427en
dc.language.isoenen
dc.publisherVirginia Techen
dc.rightsIn Copyrighten
dc.rights.urihttp://rightsstatements.org/vocab/InC/1.0/en
dc.subjectHuman-AI Interactionen
dc.subjectComputer Visionen
dc.subjectContent-Based Image Retrievalen
dc.subjectDigital Humanitiesen
dc.titleBackdrop Explorer:  A Human-AI Collaborative Approach for Exploring Studio Backdrops in Civil War Portraitsen
dc.typeThesisen
thesis.degree.disciplineComputer Science and Applicationsen
thesis.degree.grantorVirginia Polytechnic Institute and State Universityen
thesis.degree.levelmastersen
thesis.degree.nameMaster of Scienceen

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Lim_KY_T_2023.pdf
Size:
25.7 MB
Format:
Adobe Portable Document Format

Collections