docker / genai-stack
QueueCallback

Callback handler for streaming LLM responses to a queue.

Methods

  • on_llm_new_token

  • on_llm_end

Show
Question
Show
BaseTicket
Show
StreamHandler

Methods

  • on_llm_new_token

Show
StreamHandler

Methods

  • on_llm_new_token

Show
BaseLogger
Show