Skip to content

/changelog summarize should not consume tokens #3910

Description

@chrstphrbrns

Since the summary is not user-specific, the responses can be cached and reused. This will also improve latency

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:modelsModel selection, availability, switching, rate limits, and model-specific behavior
    No fields configured for Feature.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions