In this article, the author makes a distinction between the quality-oriented assessment prevalent in translation and interpreting and the psychometric evaluation common in other disciplines. He suggests that the latter is a more appropriate approach for interpreter certification, an assessment situation where inferential decisions are made. He demonstrates how such research might be carried out in interpreting by validating both an existing conference interpreter certification test and a new test constructed according to measurement and evaluation principles.