Skip to content

[Bug] LLM Token Usage and Metadata Lost in Runtime Layer — Not Exposed in API Responses #75

@xuehuitian45

Description

@xuehuitian45

Description

The core Agent framework correctly captures and returns TokenUsage and other metadata in response.
However, the Runtime layer discards this information when adapting and passing the final response to clients.

As a result:

  • End users or frontend cannot see how many tokens were used
  • Billing, auditing, and optimization use cases are blocked
  • Observability is incomplete despite data being available internally

This is a data loss issue in the runtime pipeline

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions