Hacker NewsSocial / Discussion
797DSpark: Speculative decoding accelerates LLM inference [pdf]
793 points · 361 comments
Hacker NewsSocial / Discussion
797793 points · 361 comments
Hacker NewsSocial / Discussion
1,1511151 points · 1074 comments
Hacker NewsSocial / Discussion
948948 points · 276 comments
Hacker NewsSocial / Discussion
403403 points · 236 comments
Hacker NewsSocial / Discussion
304304 points · 248 comments
Hacker NewsSocial / Discussion
402402 points · 72 comments
Hacker NewsSocial / Discussion
402402 points · 216 comments
Hacker NewsSocial / Discussion
215215 points · 49 comments
Hacker NewsSocial / Discussion
213213 points · 76 comments
Hacker NewsSocial / Discussion
152152 points · 52 comments
Hacker NewsSocial / Discussion
143143 points · 1 comments
Hacker NewsSocial / Discussion
118118 points · 111 comments
Hacker NewsSocial / Discussion
186186 points · 256 comments
Hacker NewsSocial / Discussion
196196 points · 67 comments
Hacker NewsSocial / Discussion
123123 points · 56 comments
Hacker NewsSocial / Discussion
116116 points · 195 comments
Hacker NewsSocial / Discussion
156156 points · 80 comments
Hacker NewsSocial / Discussion
120120 points · 20 comments
Hacker NewsSocial / Discussion
128128 points · 39 comments
Hacker NewsSocial / Discussion
118118 points · 121 comments