« Back to Glossary Index
The basic unit of data processed by an LLM. A token can be a word, part of a word, or a punctuation mark. The length of a prompt and its response is measured in tokens.
The basic unit of data processed by an LLM. A token can be a word, part of a word, or a punctuation mark. The length of a prompt and its response is measured in tokens.
To provide the best experiences, we use technologies like cookies in compliance with GDPR and CCPA to store and/or access device information. Consenting will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions.