Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I've been wondering about adaptive decoding! It seems obvious to me that at some points during decoding (reasoning, "creative thinking") you would want a higher temperature, while at other points (emitting syntactically correct code, following a plan that was already established) you would want lower temperature.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: