The Structure of Multimodal Dialogue II

Editors

M. Martin Taylor | Defence and Civil Institute of Environmental Medicine, Toronto

Françoise Néel | LIMSI-CNRS, Orsay, France

Don Bouwhuis | Institute for Perception Research (IPO), Eindhoven

Hardbound – Available

ISBN 9789027221902 (Eur) | EUR 140.00

ISBN 9781556197628 (USA) | USD 210.00

e-Book –

ISBN 9789027273871 | EUR 140.00 | USD 210.00

Most dialogues are multimodal. When people talk, they use not only their voices, but also facial expressions and other gestures, and perhaps even touch. When computers communicate with people, they use pictures and perhaps sounds, together with textual language, and when people communicate with computers, they are likely to use mouse “gestures” almost as much as words. How are such multimodal dialogues constructed? This is the main question addressed in this selection of papers of the second “Venaco Workshop”, sponsored by the NATO Research Study Group RSG-10 on Automatic Speech Processing, and by the European Speech Communication Association (ESCA).

[Not in series, 99] 2000. xviii, 522 pp.

Publishing status: Available

https://doi.org/10.1075/z.99

Table of Contents

Foreword | p. xiii

Prologue

1. The Structure of Dialogue

Jens Allwood | p. 3

2. Give us the tools: a personal view of multimodal computer-human dialogue

David Hill | p. 25

3. Integrating Multimodal Information: Evidence for Cognitive Integrality

S.J. Selcon and R.M. Taylor | p. 63

Part I: Models and Strategies

4. Toward Multimodal Support of Interpreted Telephone Dialogues

Sharon L. Oviatt | p. 85

5. Human Factors and Error-Handling in Speech Interfaces

A.C. Murray | p. 109

6. Cross-linked modalities make speech drift in rapid dialogue: Global multimedia dialogue, language shifts, and emotion

S. Candelaria de Ram | p. 125

7. Dynamic Interpretation and Dialogue Theory

Harry Bunt | p. 139

8. Dialgoue Acts are Rational Plans

M.D. Sadek | p. 167

9. An approach to oral dialogue modelling

E. Bilange | p. 189

10. A Dynamic Dialogue Model for Human-Machine Communication

D. Luzzati | p. 207

11. Standia: a pragmatically driven man-machine system

Anne Vilnat | p. 223

12. Moves in Dialogue

Robbert-Jan Beun | p. 239

13. Designing Intelligence: A Case of Explicit Models and Layered Protocols

Jack L. Edwards and Donald Sinclair | p. 249

14. SPRUCE: Speech Synthesis

Marcel A.A. Tatham, P. Katherine Morton-Tatham and Eric Lewis | p. 271

Part 2: Architectures and Experiences

15. Multimedia & Multimodal Interaction Structure

Mark T. Maybury and James F. Lee | p. 295

16. Robustness and cooperative multimodal humanmachine communication applications

Jean-Claude Junqua | p. 309

17. Iconicity of Sign Languages

Christian Cuxac | p. 321

18. A Taxonomy for Users’ Behaviour in Human Computer Interaction

Willis J. Edmondson | p. 335

19. Multimodal Interaction Interface using Voice and Gesture

Daniel Teil and Yacine Bellik | p. 349

20. Implementing an Oral and Geographic Multimodal Application: The Géoral Project

F. Gavignet, Marc Guyomard and Jacques Siroux | p. 367

21. Communicative Acts for Multimedia and Multimodal Dialogue

Mark T. Maybury | p. 375

22. Graphical Modes of Human Multimodal Dialogue

Ginette Boudreau and Carol McCann | p. 393

23. Graphics and Natural Language in Multi-Modal Dialogues

James F. Lee | p. 407

24. Referring in a Multimodal Environment: from NL to designation

Bertrand Gaiffe, Jean-Marie Pierrel and Laurent Romary | p. 421

25. Multiplexing, Diviplexing, and the Control of Multimodal Dialogue

M. Martin Taylor and David A. Waugh | p. 439

26. Multimodal Approach to Concept Formation: and Example in Speech and Sketch Mode

A.K. Datta | p. 457

27. Processing Facial Images to Enhance Speech Communication

N. Michael Brooke and M.J. Tomlinson | p. 465

28. The Intrinsic Bimodality of Speech Communication and the Synthesis of Talking Faces

C. Benoît | p. 485

Index | p. 503

Cited by

Cited by 25 other publications

Order by:

Anderson, John R.

1987. Implementations, algorithms, and more. Behavioral and Brain Sciences 10:3 ► pp. 498 ff.

Anderson, John R.

1987. Methodologies for studying human knowledge. Behavioral and Brain Sciences 10:3 ► pp. 467 ff.

Arbib, Michael A.

1987. Many levels: More than one is algorithmic. Behavioral and Brain Sciences 10:3 ► pp. 478 ff.

Clancey, William J.

1987. Functional principles and situated problem solving. Behavioral and Brain Sciences 10:3 ► pp. 479 ff.

Clark, Austen

1987. The algorithm/implementation distinction. Behavioral and Brain Sciences 10:3 ► pp. 480 ff.

Ericsson, K. Anders

1987. The scientific induction problem: A case for case studies. Behavioral and Brain Sciences 10:3 ► pp. 480 ff.

Ewert, J.-P.

1987. The evolutionary aspect of cognitive functions. Behavioral and Brain Sciences 10:3 ► pp. 481 ff.

Glaser, Robert

1987. The study of cognition and instructional design: Mutual nurturance. Behavioral and Brain Sciences 10:3 ► pp. 483 ff.

Goldman, Alvin I.

1987. Ambiguities in “the algorithmic level”. Behavioral and Brain Sciences 10:3 ► pp. 484 ff.

Hendler, James

1987. A flawed analogy?. Behavioral and Brain Sciences 10:3 ► pp. 485 ff.

Kleeck, Michael Van

1987. Underestimating the importance of the implementational level. Behavioral and Brain Sciences 10:3 ► pp. 497 ff.

Knight, Dawn, David Evans, Ronald Carter & Svenja Adolphs

2009. HeadTalk, HandTalk and the corpus: towards a framework for multi-modal, multi-media corpus development. Corpora 4:1 ► pp. 1 ff.

Larkin, Jill H.

1987. Generality and applications. Behavioral and Brain Sciences 10:3 ► pp. 486 ff.

Levine, Daniel S.

1987. Connectionism and motivation are compatible. Behavioral and Brain Sciences 10:3 ► pp. 487 ff.

Mortensen, Chris

1987. Nonverbal knowledge as algorithms. Behavioral and Brain Sciences 10:3 ► pp. 487 ff.

Reed, Adam V.

1987. Ways and means. Behavioral and Brain Sciences 10:3 ► pp. 488 ff.

Reilly, Ronan G.

1987. Is there more than one type of mental algorithm?. Behavioral and Brain Sciences 10:3 ► pp. 489 ff.

Rosenbloom, Paul S.

1987. Weak versus strong claims about the algorithmic level. Behavioral and Brain Sciences 10:3 ► pp. 490 ff.

Seifert, Colleen & Donald A. Norman

1987. Levels of research. Behavioral and Brain Sciences 10:3 ► pp. 490 ff.

Smolensky, Paul

1987. Connectionism and implementation. Behavioral and Brain Sciences 10:3 ► pp. 492 ff.

Stabler, Edward P.

1987. Interactive instructional systems and models of human problem solving. Behavioral and Brain Sciences 10:3 ► pp. 493 ff.

Stenning, Keith

1987. Applying Marr to memory. Behavioral and Brain Sciences 10:3 ► pp. 494 ff.

Taylor, M. M. & R. A. Pigeau

1987. What is the algorithmic level?. Behavioral and Brain Sciences 10:3 ► pp. 495 ff.

Touretzky, David S.

1987. Connectionist models are also algorithmic. Behavioral and Brain Sciences 10:3 ► pp. 496 ff.

Townsend, James T.

1987. Learning is critical, not implementation versus algorithm. Behavioral and Brain Sciences 10:3 ► pp. 497 ff.

This list is based on CrossRef data as of 19 march 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Subjects

Linguistics

Natural language processing

Main BIC Subject

CF: Linguistics

Main BISAC Subject

LAN009000: LANGUAGE ARTS & DISCIPLINES / Linguistics / General

ONIX Metadata

ONIX 2.1

ONIX 3.0

U.S. Library of Congress Control Number: 2001268929 | Marc record