Language, Vision and Music

Selected papers from the 8th International Workshop on the Cognitive Science of Natural Language Processing, Galway, 1999

| University of Ulster (Magee)
| Nous Research, Dublin
| National University of Ireland, Galway
ISBN 9789027251558 (Eur) | EUR 83.00
ISBN 9781588111098 (USA) | USD 125.00
ISBN 9789027297099 | EUR 83.00 | USD 125.00
Language, vision and music: what common cognitive patterns underlie our competence in these disparate modes of thought? Language (natural & formal), vision and music seem to share at least the following attributes: a hierarchical organisation of constituents, recursivity, metaphor, the possibility of self-reference, ambiguity, and systematicity. Can we propose the existence of a general symbol system with instantiations in these three modes or is the only commonality to be found at the level of such entities as cerebral columnar automata? Answers are to be found in this international collection of work which recognises that one of the basic features of consciousness is its MultiModality, that there are possibilities to model this with contemporary technology, and that cross-cultural commonalities in the experience of, and creativity within, the various modalities are significant. With the advent of Intelligent MultiMedia this aspect of consciousness implementation in mind/brain acquires new significance. (Series B)
[Advances in Consciousness Research, 35]  2002.  xii, 433 pp.
Publishing status: Available
Table of Contents
About the Editors
Paul Mc Kevitt, Seán Ó Nualláin and Conn Mulvihill
Part I: Language & vision
Multimedia integration: A system-theoretic perspective
John H. Connolly
Visualising lexical prosodic representations for speech applications
Julie Carson-Berndsen and Dafydd Gibbon
A simulated language understanding agent using virtual perception
John Gurney, Elizabeth Klipple and Robert Winkler
The Hitchhiker’s Guide to the Galaxy
A.L. Cohen-Rose and S. B. Christiansen
Affective multimodal interaction with a 3D agent
Tom Brøndsted, Thomas Dorf Nielsen and Sergio Ortega Gonzalez
CHAMELEON: A general platform for performing intellimedia
Tom Brøndsted, Paul Dalsgaard, Lars Bo Larsen, Michael Manthey, Paul Mc Kevitt, Thomas B. Moeslund and Kristian G. Olesen
Machine perception of real-time multimodal natural dialogue
Kris Thórisson
Communicative rhythm in gesture and speech
Ipke Wachsmuth
Signals and meanings of gaze in animated faces
Isabella Poggi and Catherine Pelachaud
Speech, vision and aphasic communication
Elisabeth Ahlsén
Synaesthesia and knowing
John G. Gammack
What synaesthesia is (and is not)
Sean A. Day
Synaesthesia is not a psychic anomaly, but a form of non-verbal thinking
Bulat M. Galeyev
Part II: Language & music
Music and language: Metaphor and causation
Niall J.L. Griffith
Expression, content and meaning in language and music: An integrated semiotic analysis
Jean Callaghan and Edward McDonald
Auditory structuring in explaining dyslexia
Kai Karma
A comparative review of priming effects in language and music
Barbara Tillmann and Emmanuel Bigand
The respective roles of conscious- and subconscious processes for interpreting language and music
Gérard Sabah
Aesthetic forms of expression as information delivery units
Paul Nemirovsky and Glorianna Davenport
The lexicon of the Conductor’s face
Isabella Poggi
How do interactive virtual operas shift relationships between music, text and image?
Alain Bonardi and Francis Rousseaux
“Let’s Improvise Together” A testbed for a formalism in language vision and sounds integration
Riccardo Antonini
On tonality in Irish traditional music
Seán Ó Nualláin
The relationship between the imitation and recognition of non-verbal rhythms and language comprehension
Dilys Treharne
Rising-falling contours in speech: A metaphor of tension-resolution schemes in European musical traditions? Evidence from regional varieties of Italian
Antonio Romano
Part III: Creativity
Plenary panel session: What is creativity?
Riccardo Antonini, Micheál Colhoun, Sean A. Day, Paul Hodgson, Sheldon Klein, Julia E. Lonergan, Paul Mc Kevitt, Conn Mulvihill, Stephen Nachmanovitch, Francisco Camara Pereira, Gérard Sabah and Ipke Wachsmuth
The analogical foundations of creativity in language, culture & the arts: “The Upper Paleolithic to 2100CE”
Sheldon Klein
Creativity in humans, computers, and the rest of God’s creatures: A meditation from within the economic world
Tudor Rickards
The origins of Mexican metaphor in Tarahumara Indian religion
Julia E. Lonergan
Is creativity algorithmic?
Conn Mulvihill and Micheál Colhoun
Subject Index
Author Index
“Initiatives such as that represented here which bring together scholars from a wide range of cultural and linguistic backgrounds throw much light on natural language and alternative communicative systems and illuminate our understanding of the complex relationships that exist between language, mind and reality.”
“A vision on how modalities can get together to support creativity.”
“A guiding premise of this book is that an integrative approach to language, vision and music can inform us about the nature of both natural language and artificial communication systems and the complex interrelationships that exist between language, mind and machine. Contained in this volume are exciting examples of several sophisticated multimodal computer systems, architectures and interfaces, original experimental approaches relating language and music and some interesting work on the difficult topic of creativity.”
“A unique and diversified collection that takes an integrative approach to adress language, vision and music.”
“We have here an exciting international collection of work to reveal the similarities and differences between language, vision and music which will certainly create the next communicative systems.”
Cited by

Cited by 1 other publications

McDonald, Edward
2021. The signifying voice. Language, Context and Text. The Social Semiotics Forum 3:1 Crossref logo

This list is based on CrossRef data as of 07 february 2021. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Subjects & Metadata

Consciousness Research

Consciousness research
BIC Subject: CF – Linguistics
BISAC Subject: LAN009000 – LANGUAGE ARTS & DISCIPLINES / Linguistics / General
ONIX Metadata
ONIX 2.1
ONIX 3.0
U.S. Library of Congress Control Number:  2001056597 | Marc record