Skip to main content

Token Streaming Support in SDK

  • Problem: Users perceive latency because initial tokens are delayed visually even when backend completion is fast.

  • Use case: Improve UX for long-running tasks in web apps by showing progress immediately.

  • Functionality: Dual token streams (output and process), a "processing response" JSON key for intermediate node updates, and an async streaming API that can pipe data directly into React components.

Log in to comment and vote

No comments yet

Be the first to share your thoughts.