scalaer
V2EX  ›  问与答

写了一篇 blog 关于 langchain llm streaming

  •  
  •   scalaer · Oct 18, 2023 · 872 views
    This topic created in 1008 days ago, the information mentioned may be changed or developed.

    Langchain 通过 callback 机制,可以将 LLM 输出的 token 实时处理. 同时支持同步 IO 和异步 IO 的方式来输出 token ,分别对应 StreamingStdOutCallbackHandler 和 AsyncIteratorCallbackHandler

    Langchian LLM Streaming

    No Comments Yet
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   3167 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 42ms · UTC 12:28 · PVG 20:28 · LAX 05:28 · JFK 08:28
    ♥ Do have faith in what you're doing.