Research articles, presentations, and other scholarship

Recent Submissions

  • Studies In Spatial Aural Perception: Establishing Foundations For Immersive Sonification 

    Bukvic, Ivica Ico; Earle, Gregory D.; Sardana, Disha; Joo, Woohun (Georgia Institute of Technology, 2019-06)
    The Spatial Audio Data Immersive Experience (SADIE) project aims to identify new foundational relationships pertaining to human spatial aural perception, and to validate existing relationships. Our infrastructure consists ...
  • Reimagining Human Capacity For Location-Aware Aural Pattern Recognition: A Case For Immersive Exocentric Sonification 

    Bukvic, Ivica Ico; Earle, Gregory D. (Georgia Institute of Technology, 2018-06)
    The following paper presents a cross-disciplinary snapshot of 21st century research in sonification and leverages the review to identify a new immersive exocentric approach to studying human capacity to perceive spatial ...
  • #VTDITC vol. 9: Gender & Hip Hop 

    Smith, Blair Ebony; Jennings, Kyesha (Virginia Tech. University Libraries, 2018-04-19)
    Join Blair Ebony Smith [PhD Candidate at Syracuse University and artist-scholar with organizing collective Saving Our Lives Hear Our Truths (SOLHOT) as well as girl-band We Levitate], and Kyesha Jennings (Hip Hop Scholar ...
  • #VTDITC Vol 8: Hip Hop & Liberation 

    Faulkner, Brandy S.; Offendum, Omar; Right, Dumi; Taj, Saba (Virginia Tech. University Libraries, 2018-03-15)
    Join Dumi Right (DC), Omar Offendum (LA), Saba Taj (NC), and Dr. Brandy Faulkner (VT Department of Political Science) for a discussion of hip hop as a tool for liberation. Performances and an open cypher to follow. #VTDITC
  • #VTDITC Vol 6: Hip Hop & Digital Literacy 

    Carson, A. D.; Harrison, Anthony Kwame; Sum; Zed, Nathan; Jones, Stimulator (Virginia Tech. University Libraries, 2017-12-05)
    Join Dr. AD Carson (University of Virginia, Assistant Professor of Hip Hop), Sum (Los Angeles based recording artist and organizer), Nathan Zed (Virginia Tech student and creator), Stimulator Jones (Stones Throw Records), ...
  • Affective Feedback in a Virtual Reality based Intelligent Supermarket 

    Saha, Deba Pratim; Martin, Thomas L.; Knapp, R. Benjamin (ACM, 2017)
    The probabilistic nature of the inferences in a context-aware intelligent environment (CAIE) renders them vulnerable to erroneous decisions resulting in wrong services. Learning to recognize a user’s negative reactions to ...
  • Inner-Active Art: An examination of aesthetic and mapping issues in physiologically based artworks 

    Coghlan, N.; Knapp, R. Benjamin (ISEA, 2009)
    Much art seeks to describe or stimulate the feelings and emotions of the viewer, through both abstract and literal representation. With the exponential increase in computing power over recent years we also seek new ways ...
  • Lantern Field: Exploring Participatory Design of a Communal, Spatially Responsive Installation 

    Bortz, Brennon; Ishida, Aki; Bukvic, Ivica Ico; Knapp, R. Benjamin (NIME, 2013-05)
    Lantern Field is a communal, site-specific installation that takes shape as a spatially responsive audio-visual field. The public participates in the creation of the installation, resulting in shared ownership of the work ...
  • Creating Biosignal Algorithms for Musical Applications from an Extensive Physiological Database 

    Jaimovich, Javier; Knapp, R. Benjamin (NIME, 2015)
    Previously the design of algorithms and parameter calibration for biosignal music performances has been based on testing with a small number of individuals - in fact usually the performer themselves. This paper uses the ...
  • Biosignal-driven Art: Beyond biofeedback 

    Ortiz, Miguel; Coghlan, Niall; Jaimovich, Javier; Knapp, R. Benjamin (CMMAS, 2011)
    Biosignal monitoring in interactive arts, although present for over forty years, remains a relatively little known field of research within the artistic community as compared to other sensing technologies. Since the early ...
  • Multimodal Interaction in Music Using the Electromyogram and Relative Position Sensing 

    Tanaka, Atau; Knapp, R. Benjamin (NIME, 2002)
    This paper describes a technique of multimodal, multichannel control of electronic musical devices using two control methodologies, the Electromyogram (EMG) and relative position sensing. Requirements for the application ...
  • AffecTech-an affect-aware interactive AV Artwork 

    Coghlan, N.; Jaimovich, J.; Knapp, R. Benjamin; O’Brien, D.; Ortiz, M.A. (ISEA International, 2009)
    New developments in real-time computing and body-worn sensor technology allow us to explore not just visible gestures using inertial sensors, but also invisible changes in an individual’s physiological state using bio-sensors ...
  • Contagion of Physiological Correlates of Emotion between Performer and Audience: An Exploratory Study 

    Jaimovich, Javier; Coghlan, Niall; Knapp, R. Benjamin (2010)
    Musical and performance experiences are often described as evoking powerful emotions, both in the listener/observer and player/performer. There is a significant body of literature describing these experiences along with ...
  • The Emotion in Motion Experiment: Using an Interactive Installation as a Means for Understanding Emotional Response to Music 

    Jaimovich, Javier; Otiz, Miguel; Coghlan, Niall; Knapp, R. Benjamin (NIME, 2012)
    In order to further understand our emotional reaction to music, a museum-based installation was designed to collect physiological and self-report data from people listening to music. This demo will describe the technical ...
  • Sensory Chairs: A System for Biosignal Research and Performance 

    Coghlan, Niall; Knapp, R. Benjamin (NIME, 2008-06)
    Music and sound have the power to provoke strong emotional and physical responses within us. Although concepts such as emotion can be hard to quantify in a scientific manner there has been significant research into how the ...
  • Creating a Network of Integral Music Controllers 

    Knapp, R. Benjamin; Cook, Perry R. (NIME, 2006)
    In this paper, we describe the networking of multiple Integral Music Controllers (IMCs) to enable an entirely new method for creating music by tapping into the composite gestures and emotions of not just one, but many ...
  • The integral Music controller: Introducing a Direct Emotional Interface to gestural control of sound synthesis. 

    Knapp, R. Benjamin; Cook, Perry R. (Michigan Publishing, 2005-09)
    This paper describes the concept of the integral music controller (IMC), a controller that combines gestural interface with direct emotional control of a digital musical instrument. This new controller enables the performer ...
  • Emotion in Motion: A Reimagined Framework for Biomusical/Emotional Interaction 

    Bortz, Brennon; Jaimovich, Javier; Knapp, R. Benjamin (NIME, 2015)
    Over the past four years Emotion in Motion, a long running experiment, has amassed the world’s largest database of human physiology associated with emotion in response to the presentation of various selections of musical ...
  • YourWellness: Designing an Application to Support Positive Emotional Wellbeing in Older Adults 

    Doyle, Julie; O’Mullane, Brian; McGee, Shauna; Knapp, R. Benjamin (BISL, 2012)
    Emotional wellbeing is an important indicator of overall health in adults over 65. For some older people, age-related declines to physical, cognitive or social wellbeing can negatively impact on their emotional wellbeing, ...
  • Design of a Mobile Brain Training Tool for Seniors: Motivational Requirements 

    O’Brien, Donal; Knapp, R. Benjamin; Thompson, Oonagh; Craig, David; Barrett, Suzanne (ICST, 2012)
    The overall goal of this project is to design, develop, and validate a mobile phone-based ‘brain training’ software suite targeted at senior users, using iterative person-centered design methodologies, that will permit a ...

View more