Token

« Back to Glossary Index

The basic unit of data processed by an LLM. A token can be a word, part of a word, or a punctuation mark. The length of a prompt and its response is measured in tokens.