How to Quadruple LLM Decoding Performance with Speculative Decoding (SpD) and Microscaling (MX) Formats on Qualcomm® Cloud AI 100
How to Quadruple LLM Decoding Performance with Speculative Dec…
Aug 1, 2024
qualcomm.com
Faster LLMs: Accelerate Inference with Speculative Decoding
Faster LLMs: Accelerate Inference with Speculative Decoding
10 months ago
ibm.com
As AI labs race to train and deploy new frontier models, existing models become more affordable with better tokenomics. ✨ "Everybody's trying to get to the next frontier. And every time they get to the next frontier, the last generation AI tokens, the cost starts to decline about a factor of 10x every year," said NVIDIA CEO Jensen Huang in a recent keynote. Model optimization techniques such as speculative decoding and multi-token prediction, combined with inference serving platforms like NVIDIA
0:46
As AI labs race to train and deploy new frontier models, existing mod…
12.4K views2 months ago
FacebookNVIDIA AI
AI Explained: Speculative decoding with vLLM
2:42
AI Explained: Speculative decoding with vLLM
1K views3 weeks ago
YouTubeRed Hat
LLM Explained: How Transformers Predict Your Next Word
0:55
LLM Explained: How Transformers Predict Your Next Word
117 views2 weeks ago
YouTubeCode & Capital
IBM Granite 4.0 1B Speech: Compact Multilingual Speech AI Built for Edge Deployment
5:40
IBM Granite 4.0 1B Speech: Compact Multilingual Speech AI B…
128 views2 weeks ago
YouTubeCosmoX
NVIDIA's VP of AI Explains Why They Give Away Their Best Models | Kari Briski × Kim Isenberg
21:17
NVIDIA's VP of AI Explains Why They Give Away Their Best Model…
1.2K views1 week ago
YouTubeSuperintelligence
4:43
26. Transformer Inference Process: How LLMs Predict the Next Word (…
78 views1 month ago
YouTubeNeuro Splash (Telugu)
3:40
How Does AI Autocomplete Work? LSP, FIM & Model Inference Explai…
7 views4 weeks ago
YouTubeCodeSprint Lab
8:26
Beyond Speculative Decoding: Jacobi Forcing in LLMs
89 views1 month ago
YouTubeTales Of Tensors
4:39
DFlash: Faster LLM Inference via Block Diffusion
30 views1 month ago
YouTubeAI Research Roundup
40:19
Speculation is all you need: Intro to Speculative Decoding for High Per…
16 views3 weeks ago
YouTubeModal
1:47
Make Large Language Models 4× Faster! Jacobi Forcing for Causal …
3 months ago
YouTubeAITech_Trends
1:05
What is Speculative decoding - Speculative decoding Explained #…
273 views2 weeks ago
YouTubeMed Bou | AI Tutorials
6:34
AI Frontiers: 101 ML Papers from Nov 21, 2025 - Efficiency, Safety …
15 views4 months ago
YouTubeAI Frontiers
4:57
Step 3.5 Flash: Fast 11B MoE for Agentic Tasks
63 views1 month ago
YouTubeAI Research Roundup
1:02:23
EP5: Speculative Decoding with Nadav Timor
116 views6 months ago
YouTubeThe Information Bottleneck
1:01
SPEED-Bench: A Game-Changer for Speculative Decoding Evaluation …
2 weeks ago
YouTubeAgentFeed
6:29
Inference Optimization: Making AI Faster & Cheaper (Latency, Throu…
33 views2 weeks ago
YouTubewecite
0:31
This Repo Makes LLMs 24x Faster — And Most AI Companies Use It …
963 views1 week ago
YouTubeGithubTrends
6:47
Transformer models: Encoder-Decoders
105.6K viewsJun 14, 2021
YouTubeHugging Face
37:34
Speculative Decoding Explained
7.8K viewsDec 21, 2023
YouTubeTrelis Research
1:02:56
Accelerating AI Model Performance (APAC)
336 views4 months ago
YouTubeMicrosoft Reactor
14:45
ChatGPT-5 Architecture Explained
17.2K views7 months ago
YouTubeResDevEng
13:47
LLM Jargons Explained: Part 4 - KV Cache
10.8K viewsMar 24, 2024
YouTubeSachin Kalsi
2:55
Set Block Decoding: Faster LLM Inference
53 views6 months ago
YouTubeAI Research Roundup
36:12
Deep Dive: Optimizing LLM inference
46.4K viewsMar 11, 2024
YouTubeJulien Simon
3:29
Discrete Diffusion VLA: Faster Action Decoding
128 views7 months ago
YouTubeAI Research Roundup
5:16
LLM System Design Interview: How to Optimise Inference Latency
419 views4 months ago
YouTubePeetha Academy
8:10
The Engineering Behind Instant AI Responses
1.5K views3 months ago
YouTubePY
See more videos
Static thumbnail place holder