URL has been copied successfully!

Time to first token (TTFT)

Time to first token (TTFT)

by Erik Bouwer

Time to First Token (TTFT) is the time between sending a request to a chatbot or language model and the presentation of the first response. TTFT directly affects the user experience of realtime applications such as chatbots or voice assistants.

See also Tokenizer

Give a reaction

Your email address will not be published. Required fields are marked with *

Top