same. also—from the reviewer end—LLM generated PR descriptions are loooooooooooooong.

> [others] Output tokens: ~5x more expensive than input tokens.

> [them] Output tokens: FREE (too cheap to meter).

I'm very confused by this.

They're not doing autoregression, so all the outputs are computed in one big forward pass. Very cheap.

I think OP is confused about "others" vs "them".

they’re talking about two totally different things, right?

The output tokens are just responses to your inputed questions and their probability. So relatively few output tokens. No unstructured text back in the response.

it's our output tokens that are free (under the system one / jev column)

This is not confusing