Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

You should be able to provide more data than that in the input if the output doesn't use the full 4k tokens. So limit is context_size minus expected length of output.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: