Louis Aeilot's Blog
blog.aeilot.top
A language model may already know which word it will write before it reaches its last layer. If so, the remaining layers look like an opportunity: stop early, emit the token, and spend less computatio…
讨论
登录后参与讨论
还没有评论，来说第一句吧。