Language, Vision and Music
Selected papers from the 8th International Workshop on the Cognitive Science of Natural Language Processing, Galway, 1999
Editors
Language, vision and music: what common cognitive patterns underlie our competence in these disparate modes of thought? Language (natural & formal), vision and music seem to share at least the following attributes: a hierarchical organisation of constituents, recursivity, metaphor, the possibility of self-reference, ambiguity, and systematicity. Can we propose the existence of a general symbol system with instantiations in these three modes or is the only commonality to be found at the level of such entities as cerebral columnar automata? Answers are to be found in this international collection of work which recognises that one of the basic features of consciousness is its MultiModality, that there are possibilities to model this with contemporary technology, and that cross-cultural commonalities in the experience of, and creativity within, the various modalities are significant. With the advent of Intelligent MultiMedia this aspect of consciousness implementation in mind/brain acquires new significance. (Series B)
[Advances in Consciousness Research, 35] 2002. xii, 433 pp.
Publishing status: Available
Published online on 21 October 2008
Published online on 21 October 2008
© John Benjamins Publishing Company
Table of Contents
-
Dedication | pp. v–vi
-
About the Editors | pp. xi–xii
-
IntroductionPaul Mc Kevitt, Seán Ó Nualláin and Conn Mulvihill | pp. 1–8
-
Part I: Language & visionPaul Mc Kevitt |
-
Multimedia integration: A system-theoretic perspectiveJohn H. Connolly | pp. 15–27
-
Visualising lexical prosodic representations for speech applicationsJulie Carson-Berndsen and Dafydd Gibbon | pp. 29–38
-
A simulated language understanding agent using virtual perceptionJohn Gurney, Elizabeth Klipple and Robert Winkler | pp. 39–53
-
The Hitchhiker’s Guide to the GalaxyA.L. Cohen-Rose and S. B. Christiansen | pp. 55–66
-
Affective multimodal interaction with a 3D agentTom Brøndsted, Thomas Dorf Nielsen and Sergio Ortega Gonzalez | pp. 67–78
-
CHAMELEON: A general platform for performing intellimediaTom Brøndsted, Paul Dalsgaard, Lars Bo Larsen, Michael Manthey, Paul Mc Kevitt, Thomas B. Moeslund and Kristian G. Olesen | pp. 79–96
-
Machine perception of real-time multimodal natural dialogueKris Thórisson | pp. 97–115
-
Communicative rhythm in gesture and speechIpke Wachsmuth | pp. 117–132
-
Signals and meanings of gaze in animated facesIsabella Poggi and Catherine Pelachaud | pp. 133–144
-
Speech, vision and aphasic communicationElisabeth Ahlsén | pp. 145–156
-
Synaesthesia and knowingJohn G. Gammack | pp. 157–170
-
What synaesthesia is (and is not)Sean A. Day | pp. 171–180
-
Synaesthesia is not a psychic anomaly, but a form of non-verbal thinkingBulat M. Galeyev | pp. 181–187
-
Part II: Language & musicSeán Ó Nualláin |
-
Music and language: Metaphor and causationNiall J.L. Griffith | pp. 191–203
-
Expression, content and meaning in language and music: An integrated semiotic analysisJean Callaghan and Edward McDonald | pp. 205–220
-
Auditory structuring in explaining dyslexiaKai Karma | pp. 221–230
-
A comparative review of priming effects in language and musicBarbara Tillmann and Emmanuel Bigand | pp. 231–240
-
The respective roles of conscious- and subconscious processes for interpreting language and musicGérard Sabah | pp. 241–253
-
Aesthetic forms of expression as information delivery unitsPaul Nemirovsky and Glorianna Davenport | pp. 255–270
-
The lexicon of the Conductor’s faceIsabella Poggi | pp. 271–284
-
How do interactive virtual operas shift relationships between music, text and image?Alain Bonardi and Francis Rousseaux | pp. 285–294
-
“Let’s Improvise Together”: A testbed for a formalism in language vision and sounds integrationRiccardo Antonini | pp. 295–302
-
On tonality in Irish traditional musicSeán Ó Nualláin | pp. 303–312
-
The relationship between the imitation and recognition of non-verbal rhythms and language comprehensionDilys Treharne | pp. 313–324
-
Rising-falling contours in speech: A metaphor of tension-resolution schemes in European musical traditions? Evidence from regional varieties of ItalianAntonio Romano | pp. 325–337
-
Part III: CreativityConn Mulvihill |
-
Plenary panel session: What is creativity?Riccardo Antonini, Micheál Colhoun, Sean A. Day, Paul Hodgson, Sheldon Klein, Julia E. Lonergan, Paul Mc Kevitt, Conn Mulvihill, Stephen Nachmanovitch, Francisco Camara Pereira, Gérard Sabah and Ipke Wachsmuth | pp. 341–345
-
The analogical foundations of creativity in language, culture & the arts: “The Upper Paleolithic to 2100CE”Sheldon Klein | pp. 347–371
-
Creativity in humans, computers, and the rest of God’s creatures: A meditation from within the economic worldTudor Rickards | pp. 373–384
-
The origins of Mexican metaphor in Tarahumara Indian religionJulia E. Lonergan | pp. 385–399
-
Is creativity algorithmic?Conn Mulvihill and Micheál Colhoun | pp. 401–409
-
Subject Index | pp. 411–425
-
Author Index | pp. 427–433
“Initiatives such as that represented here which bring together scholars from a wide range of cultural and linguistic backgrounds throw much light on natural language and alternative communicative systems and illuminate our understanding of the complex relationships that exist between language, mind and reality.”
Professor Ailbhe Ó Corráin, Faculty of Arts, University of Ulster (Magee), Northern Ireland
“A vision on how modalities can get together to support creativity.”
Dr. Joseph Mariani, Department of Information Technologies and Communication, Ministry of Research and New Technologies, France
“A guiding premise of this book is that an integrative approach to language, vision and music can inform us about the nature of both natural language and artificial communication systems and the complex interrelationships that exist between language, mind and machine. Contained in this volume are exciting examples of several sophisticated multimodal computer systems, architectures and interfaces, original experimental approaches relating language and music and some interesting work on the difficult topic of creativity.”
Daniel Mauro, Carleton University, Canada, on Metapsychology Online, October 2004
“A unique and diversified collection that takes an integrative approach to adress language, vision and music.”
Dr. Mark Maybury, The Mitre Corporation, Massachusetts, USA
“We have here an exciting international collection of work to reveal the similarities and differences between language, vision and music which will certainly create the next communicative systems.”
Professor Ryuichi Oka, University of Aizu, and Professor Naoyuki Okada, Kyushu Institute of Technology, Japan
Cited by (1)
Cited by one other publication
Navarro Cebrian, Ana & Petr Janata
2010. Influences of multiple memory systems on auditory mental image acuity. The Journal of the Acoustical Society of America 127:5 ► pp. 3189 ff. 
This list is based on CrossRef data as of 10 january 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.
Subjects
Consciousness Research
Psychology
Main BIC Subject
CF: Linguistics
Main BISAC Subject
LAN009000: LANGUAGE ARTS & DISCIPLINES / Linguistics / General