This Ph.D. dissertation describes memory and context mechanisms for natural language text processing. The memory is concerned with representing and retrieving various kinds of knowledge, the context mechanism with accumulating and applying information specifying what fragments of knowledge are currently more salient.