What would you like to be added:
Add Token/$ to gateway to measure the cost efficiency, indispensable for benchmarkings. Have no idea whether Envoy AI gateway supports this or not.
Why is this needed:
Completion requirements:
This enhancement requires the following artifacts:
The artifacts should be linked in subsequent comments.
What would you like to be added:
Add Token/$ to gateway to measure the cost efficiency, indispensable for benchmarkings. Have no idea whether Envoy AI gateway supports this or not.
Why is this needed:
Completion requirements:
This enhancement requires the following artifacts:
The artifacts should be linked in subsequent comments.