Hacker NewsSocial / Discussion
797DSpark: Speculative decoding accelerates LLM inference [pdf]
793 points · 361 comments
Hacker NewsSocial / Discussion
797793 points · 361 comments
Hacker NewsSocial / Discussion
1,1511151 points · 1074 comments
Hacker NewsSocial / Discussion
948948 points · 276 comments
Hacker NewsSocial / Discussion
403403 points · 236 comments
Hacker NewsSocial / Discussion
304304 points · 248 comments
Hacker NewsSocial / Discussion
402402 points · 72 comments
Hacker NewsSocial / Discussion
402402 points · 216 comments
Hacker NewsSocial / Discussion
215215 points · 49 comments
Hacker NewsSocial / Discussion
213213 points · 76 comments
Hacker NewsSocial / Discussion
152152 points · 52 comments
Hacker NewsSocial / Discussion
143143 points · 1 comments
Hacker NewsSocial / Discussion
118118 points · 111 comments
Hacker NewsSocial / Discussion
186186 points · 256 comments
Hacker NewsSocial / Discussion
196196 points · 67 comments
Hacker NewsSocial / Discussion
123123 points · 56 comments
Hacker NewsSocial / Discussion
116116 points · 195 comments
Hacker NewsSocial / Discussion
156156 points · 80 comments
Hacker NewsSocial / Discussion
120120 points · 20 comments
Hacker NewsSocial / Discussion
128128 points · 39 comments
Hacker NewsSocial / Discussion
118118 points · 121 comments
Hacker NewsSocial / Discussion
121121 points · 114 comments
Hacker NewsSocial / Discussion
104104 points · 29 comments
Hacker NewsSocial / Discussion
891 points · 454 comments
Hacker NewsSocial / Discussion
804 points · 587 comments
Hacker NewsSocial / Discussion
648 points · 207 comments
Hacker NewsSocial / Discussion
915 points · 134 comments
Hacker NewsSocial / Discussion
713 points · 326 comments
Hacker NewsSocial / Discussion
666 points · 479 comments
Hacker NewsSocial / Discussion
905 points · 386 comments
Hacker NewsSocial / Discussion
832 points · 295 comments
Hacker NewsSocial / Discussion
737 points · 314 comments
Hacker NewsSocial / Discussion
940 points · 599 comments
Hacker NewsSocial / Discussion
897 points · 421 comments
Hacker NewsSocial / Discussion
711 points · 271 comments
Hacker NewsSocial / Discussion
773 points · 606 comments
Hacker NewsSocial / Discussion
1202 points · 439 comments
Hacker NewsSocial / Discussion
734 points · 416 comments
Hacker NewsSocial / Discussion
869 points · 185 comments
Hacker NewsSocial / Discussion
862 points · 504 comments
Hacker NewsSocial / Discussion
1773 points · 1628 comments
Hacker NewsSocial / Discussion
716 points · 101 comments
Hacker NewsSocial / Discussion
962 points · 234 comments
Hacker NewsSocial / Discussion
655 points · 735 comments
Hacker NewsSocial / Discussion
1122 points · 275 comments
Hacker NewsSocial / Discussion
718 points · 1223 comments
Hacker NewsSocial / Discussion
1351 points · 1056 comments
Hacker NewsSocial / Discussion
919 points · 332 comments
Hacker NewsSocial / Discussion
812 points · 439 comments
Hacker NewsSocial / Discussion
984 points · 582 comments
Hacker NewsSocial / Discussion
696 points · 474 comments
Hacker NewsSocial / Discussion
1654 points · 1261 comments
Hacker NewsSocial / Discussion
970 points · 136 comments
Hacker NewsSocial / Discussion
618 points · 117 comments
Hacker NewsSocial / Discussion
1050 points · 168 comments
Hacker NewsSocial / Discussion
866 points · 343 comments
Hacker NewsSocial / Discussion
1040 points · 447 comments
Hacker NewsSocial / Discussion
739 points · 98 comments
Hacker NewsSocial / Discussion
699 points · 186 comments
Hacker NewsSocial / Discussion
800 points · 237 comments
Hacker NewsSocial / Discussion
1592 points · 131 comments