This book is a manual on how to conduct NLP evaluation and presents an analysis of the concepts involved in it. The book is divided into three chapters. Chapter 1 gives the general framework and defines the concepts used throught the rest of the volume. Chapter 2 is mainly historical but presents work done in NLP evaluation in the framework defined in chapter 1. Chapter 3 proposes the author's methodological and practical recommendations for performing an evaluation.