generationlatency
nounUK /ˌdʒenəˈreɪʃən ˈleɪtənsi/
US /ˌdʒenəˈreɪʃən ˈleɪtənsi/
The short wait before a computer starts making something for you.
The generation latency was so small that the picture appeared almost instantly.
RELATED WORDS
OTHER MEANINGS
2. The time a model takes to produce its first output token.
Engineers measured the generation latency to see how quickly the chatbot replied.
3. The gap between requesting new content and receiving it.
High generation latency made the game's new levels load slowly.
4. A delay in producing a finished product from raw input.
The factory tracked generation latency from order to delivery.