Experiential Graphic Sonification for Visual and Auditory Communication Design and Musical Expression
| dc.contributor.author | Joo, Woohun | en |
| dc.contributor.committeechair | Nichols, Charles Sabin | en |
| dc.contributor.committeemember | Duer, Zachary Raymond | en |
| dc.contributor.committeemember | Jeon, Myounghoon | en |
| dc.contributor.committeemember | Finley, Patrick | en |
| dc.contributor.department | Human Development | en |
| dc.date.accessioned | 2022-06-29T08:00:49Z | en |
| dc.date.available | 2022-06-29T08:00:49Z | en |
| dc.date.issued | 2022-06-28 | en |
| dc.description.abstract | This dissertation explains two sonification platforms designed for image-sound association study and art, and the study results. A platform for user study was developed first and an artistic audiovisual platform was derived based on it. First, the five image-sound association studies were conducted to see whether people can successfully associate sounds and fundamental shapes (i.e., a circle, a triangle, a square, lines, curves, and other custom shapes) and the correct answer rate was high. Then, the same sonification platform was transformed by adding colors to the audiovisual platform for artistic/musical expression. A line-by-line sonification method and an object-oriented method were newly developed to sonify the background and the shapes separately. To enhance user experience, the sound of each shape was spatialized in a multi-layer speaker environment or a virtual listening environment. | en |
| dc.description.abstractgeneral | This dissertation introduces two sonification platforms designed for image-sound association study and art, and the study results. A platform for user study was developed first and an artistic audiovisual platform was derived based on it. First, the five image-sound association studies were conducted to see whether people can successfully associate sounds and fundamental shapes (i.e., a circle, a triangle, a square, lines, curves, and other custom shapes) and the correct answer rate was high. Then, the same sonification platform was transformed by adding colors to the audiovisual platform for artistic/musical expression. A line-by-line sonification method and an object-oriented method were newly developed to sonify the background and the shapes separately. To enhance user experience, the sound of each shape was spatialized in a multi-layer speaker environment or a virtual listening environment. | en |
| dc.description.degree | Doctor of Philosophy | en |
| dc.format.medium | ETD | en |
| dc.identifier.other | vt_gsexam:35012 | en |
| dc.identifier.uri | http://hdl.handle.net/10919/110969 | en |
| dc.language.iso | en | en |
| dc.publisher | Virginia Tech | en |
| dc.rights | Creative Commons Attribution-ShareAlike 4.0 International | en |
| dc.rights.uri | http://creativecommons.org/licenses/by-sa/4.0/ | en |
| dc.subject | human computer interaction | en |
| dc.subject | sonification | en |
| dc.subject | communication design | en |
| dc.subject | interaction design | en |
| dc.subject | sound art | en |
| dc.subject | visual arts | en |
| dc.subject | visualization | en |
| dc.title | Experiential Graphic Sonification for Visual and Auditory Communication Design and Musical Expression | en |
| dc.type | Dissertation | en |
| thesis.degree.discipline | Individual Interdisciplinary PhD | en |
| thesis.degree.grantor | Virginia Polytechnic Institute and State University | en |
| thesis.degree.level | doctoral | en |
| thesis.degree.name | Doctor of Philosophy | en |
Files
Original bundle
1 - 1 of 1