Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Not feasible for Large models, it takes 2x M3 512GB Ultra's to run the full Kimi K2.5 model at a respectable 24 tok/s. Hopefully the M5 Ultra will can improve on that.
 help



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: