Latency

« Back to Glossary Index

The time delay between a cause and its effect. In technology, it’s the time it takes for a packet of data to get from one point to another. For an AI model, it’s the time you wait for a response after sending your prompt. Low latency is crucial for a good user experience.