Language, Vision and Music

Selected papers from the 8th International Workshop on the Cognitive Science of Natural Language Processing, Galway, 1999

Editors
| University of Ulster (Magee)
| Nous Research, Dublin
| National University of Ireland, Galway
PaperbackAvailable
ISBN 9789027251558 (Eur) | EUR 83.00
ISBN 9781588111098 (USA) | USD 125.00
 
e-Book
ISBN 9789027297099 | EUR 83.00 | USD 125.00
 
Language, vision and music: what common cognitive patterns underlie our competence in these disparate modes of thought? Language (natural & formal), vision and music seem to share at least the following attributes: a hierarchical organisation of constituents, recursivity, metaphor, the possibility of self-reference, ambiguity, and systematicity. Can we propose the existence of a general symbol system with instantiations in these three modes or is the only commonality to be found at the level of such entities as cerebral columnar automata? Answers are to be found in this international collection of work which recognises that one of the basic features of consciousness is its MultiModality, that there are possibilities to model this with contemporary technology, and that cross-cultural commonalities in the experience of, and creativity within, the various modalities are significant. With the advent of Intelligent MultiMedia this aspect of consciousness implementation in mind/brain acquires new significance. (Series B)
[Advances in Consciousness Research, 35]  2002.  xii, 433 pp.
Publishing status: Available
Table of Contents
Dedication
v
About the Editors
xi
Introduction
Paul Mc Kevitt, Seán Ó Nualláin and Conn Mulvihill
1–8
Part I: Language & vision
9–14
Multimedia integration: A system-theoretic perspective
John H. Connolly
15–27
Visualising lexical prosodic representations for speech applications
Julie Carson-Berndsen and Dafydd Gibbon
29–38
A simulated language understanding agent using virtual perception
John Gurney, Elizabeth Klipple and Robert Winkler
39–53
The Hitchhiker’s Guide to the Galaxy
A.L. Cohen-Rose and S. B. Christiansen
55–66
Affective multimodal interaction with a 3D agent
Tom Brøndsted, Thomas Dorf Nielsen and Sergio Ortega Gonzalez
67–78
CHAMELEON: A general platform for performing intellimedia
Tom Brøndsted, Paul Dalsgaard, Lars Bo Larsen, Michael Manthey, Paul Mc Kevitt, Thomas B. Moeslund and Kristian G. Olesen
79–96
Machine perception of real-time multimodal natural dialogue
Kris Thórisson
97–115
Communicative rhythm in gesture and speech
Ipke Wachsmuth
117–132
Signals and meanings of gaze in animated faces
Isabella Poggi and Catherine Pelachaud
133–144
Speech, vision and aphasic communication
Elisabeth Ahlsén
145–156
Synaesthesia and knowing
John G. Gammack
157–170
What synaesthesia is (and is not)
Sean A. Day
171–180
Synaesthesia is not a psychic anomaly, but a form of non-verbal thinking
Bulat M. Galeyev
181–187
Part II: Language & music
189–190
Music and language: Metaphor and causation
Niall J.L. Griffith
191–203
Expression, content and meaning in language and music: An integrated semiotic analysis
Jean Callaghan and Edward McDonald
205–220
Auditory structuring in explaining dyslexia
Kai Karma
221–230
A comparative review of priming effects in language and music
Barbara Tillmann and Emmanuel Bigand
231–240
The respective roles of conscious- and subconscious processes for interpreting language and music
Gérard Sabah
241–253
Aesthetic forms of expression as information delivery units
Paul Nemirovsky and Glorianna Davenport
255–270
The lexicon of the Conductor’s face
Isabella Poggi
271–284
How do interactive virtual operas shift relationships between music, text and image?
Alain Bonardi and Francis Rousseaux
285–294
“Let’s Improvise Together”: A testbed for a formalism in language vision and sounds integration
Riccardo Antonini
295–302
On tonality in Irish traditional music
Seán Ó Nualláin
303–312
The relationship between the imitation and recognition of non-verbal rhythms and language comprehension
Dilys Treharne
313–324
Rising-falling contours in speech: A metaphor of tension-resolution schemes in European musical traditions? Evidence from regional varieties of Italian
Antonio Romano
325–337
Part III: Creativity
339–340
Plenary panel session: What is creativity?
Riccardo Antonini, Micheál Colhoun, Sean A. Day, Paul Hodgson, Sheldon Klein, Julia E. Lonergan, Paul Mc Kevitt, Conn Mulvihill, Stephen Nachmanovitch, Francisco Camara Pereira, Gérard Sabah and Ipke Wachsmuth
341–345
The analogical foundations of creativity in language, culture & the arts: “The Upper Paleolithic to 2100CE”
Sheldon Klein
347–371
Creativity in humans, computers, and the rest of God’s creatures: A meditation from within the economic world
Tudor Rickards
373–384
The origins of Mexican metaphor in Tarahumara Indian religion
Julia E. Lonergan
385–399
Is creativity algorithmic?
Conn Mulvihill and Micheál Colhoun
401–409
Subject Index
411–425
Author Index
427–433
“Initiatives such as that represented here which bring together scholars from a wide range of cultural and linguistic backgrounds throw much light on natural language and alternative communicative systems and illuminate our understanding of the complex relationships that exist between language, mind and reality.”
“A vision on how modalities can get together to support creativity.”
“A guiding premise of this book is that an integrative approach to language, vision and music can inform us about the nature of both natural language and artificial communication systems and the complex interrelationships that exist between language, mind and machine. Contained in this volume are exciting examples of several sophisticated multimodal computer systems, architectures and interfaces, original experimental approaches relating language and music and some interesting work on the difficult topic of creativity.”
“A unique and diversified collection that takes an integrative approach to adress language, vision and music.”
“We have here an exciting international collection of work to reveal the similarities and differences between language, vision and music which will certainly create the next communicative systems.”
Cited by

Cited by other publications

McDonald, Edward
2021. The signifying voice. Language, Context and Text. The Social Semiotics Forum 3:1 Crossref logo

This list is based on CrossRef data as of 06 november 2020. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Subjects

Consciousness Research

Consciousness research
BIC Subject: CF – Linguistics
BISAC Subject: LAN009000 – LANGUAGE ARTS & DISCIPLINES / Linguistics / General
U.S. Library of Congress Control Number:  2001056597 | Marc record