P-EAGLE Boosts LLM Inference Speed on NVIDIA GPUs | Rodrigo Prado posted on the topic | LinkedIn
P-EAGLE Boosts LLM Inference Speed on NVIDIA GPUs | Rodrigo Prado posted on the topic | LinkedIn
1 views2 weeks ago
linkedin.com
Faster LLMs: Accelerate Inference with Speculative Decoding
Faster LLMs: Accelerate Inference with Speculative Decoding
10 months ago
ibm.com
How to Quadruple LLM Decoding Performance with Speculative Decoding (SpD) and Microscaling (MX) Formats on Qualcomm® Cloud AI 100
How to Quadruple LLM Decoding Performance with Speculative Decoding (SpD) and Microscaling (MX) Formats on Qualcomm® Cloud AI 100
Aug 1, 2024
qualcomm.com
Apple Workshop on Natural Language and Interactive Systems 2025: Speculative Streaming: Fast LLM Inference Without Auxiliary Models
Apple Workshop on Natural Language and Interactive Systems 2025: Speculative Streaming: Fast LLM Inference Without Auxiliary Models
6 months ago
apple.com
Faster and Lighter Model Inference with ONNX Runtime from Cloud to Client
19:55
Faster and Lighter Model Inference with ONNX Runtime from Cloud to Client
Aug 3, 2022
Microsoftmarkdefalco
LK Losses: Optimizing Speculative Decoding
4:18
LK Losses: Optimizing Speculative Decoding
1 month ago
YouTubeAI Research Roundup
LLM Explained: How Transformers Predict Your Next Word
0:55
LLM Explained: How Transformers Predict Your Next Word
117 views2 weeks ago
YouTubeCode & Capital
GigaWorld-Policy: An Efficient Action-Centered World--Action Model (Mar 2026)
17:46
GigaWorld-Policy: An Efficient Action-Centered World--Action Model (Mar 2026)
17 views1 week ago
YouTubeAI Paper Slop
IBM Granite 4.0 1B Speech: Compact Multilingual Speech AI Built for Edge Deployment
5:40
IBM Granite 4.0 1B Speech: Compact Multilingual Speech AI Built for Edge Deployment
128 views2 weeks ago
YouTubeCosmoX
NVIDIA's VP of AI Explains Why They Give Away Their Best Models | Kari Briski × Kim Isenberg
21:17
NVIDIA's VP of AI Explains Why They Give Away Their Best Models | Kari Briski × Kim Isenberg
1.2K views1 week ago
YouTubeSuperintelligence
26. Transformer Inference Process: How LLMs Predict the Next Word (Telugu) | Part - 10
4:43
26. Transformer Inference Process: How LLMs Predict the Next Word (Telugu) | Part - 10
78 views1 month ago
YouTubeNeuro Splash (Telugu)
Speculative Decoding — Run Two Models, Pay for One #AIEngineering
1:08
Speculative Decoding — Run Two Models, Pay for One #AIEngineering
1.1K views3 weeks ago
YouTubeDPO
Beyond Speculative Decoding: Jacobi Forcing in LLMs
8:26
Beyond Speculative Decoding: Jacobi Forcing in LLMs
89 views1 month ago
YouTubeTales Of Tensors
DFlash: Faster LLM Inference via Block Diffusion
4:39
DFlash: Faster LLM Inference via Block Diffusion
30 views1 month ago
YouTubeAI Research Roundup
Speculation is all you need: Intro to Speculative Decoding for High Performance Inference
40:19
Speculation is all you need: Intro to Speculative Decoding for High Performance Inference
16 views3 weeks ago
YouTubeModal
Make Large Language Models 4× Faster! Jacobi Forcing for Causal Parallel Decoding Explained
1:47
Make Large Language Models 4× Faster! Jacobi Forcing for Causal Parallel Decoding Explained
3 months ago
YouTubeAITech_Trends
GBV: The AI Speed Hack You Need Now (30% Faster Inference) #Shorts
0:58
GBV: The AI Speed Hack You Need Now (30% Faster Inference) #Shorts
1 month ago
YouTubeCollapsedLatents
The Agentic AI Infrastructure Playbook | VentureBeat AI Impact Tour
23:50
The Agentic AI Infrastructure Playbook | VentureBeat AI Impact Tour
166 views1 month ago
YouTubeWEKA
What is Speculative decoding - Speculative decoding Explained #generativeai #RAG #ai #llm
1:05
What is Speculative decoding - Speculative decoding Explained #generativeai #RAG #ai #llm
273 views2 weeks ago
YouTubeMed Bou | AI Tutorials
Step 3.5 Flash: Fast 11B MoE for Agentic Tasks
4:57
Step 3.5 Flash: Fast 11B MoE for Agentic Tasks
63 views1 month ago
YouTubeAI Research Roundup
EP5: Speculative Decoding with Nadav Timor
1:02:23
EP5: Speculative Decoding with Nadav Timor
116 views6 months ago
YouTubeThe Information Bottleneck
10x Faster Inference with this chip!
2:03
10x Faster Inference with this chip!
991 views1 month ago
YouTubeArnitly
Speculative Speculative Decoding (Mar 2026)
19:08
Speculative Speculative Decoding (Mar 2026)
66 views4 weeks ago
YouTubeAI Paper Slop
This Repo Makes LLMs 24x Faster — And Most AI Companies Use It #Shorts #vLLM #LLMInference #GitHub
0:31
This Repo Makes LLMs 24x Faster — And Most AI Companies Use It #Shorts #vLLM #LLMInference #GitHub
963 views2 weeks ago
YouTubeGithubTrends
Fast Inference of Removal-Based Node Influence | Proceedings of the ACM Web Conference 2024
Fast Inference of Removal-Based Node Influence | Proceedings of the ACM Web Conference 2024
May 9, 2024
acm.org
Transformer models: Encoder-Decoders
6:47
Transformer models: Encoder-Decoders
105.6K viewsJun 14, 2021
YouTubeHugging Face
Understanding Porter Stemmer Algorithm | Decoding NLP Libraries (NLTK)
11:13
Understanding Porter Stemmer Algorithm | Decoding NLP Libraries (NLTK)
21.3K viewsNov 24, 2020
YouTubeTechViz - The Data Science Guy
Speculative Decoding Explained
37:34
Speculative Decoding Explained
7.8K viewsDec 21, 2023
YouTubeTrelis Research
LLM Jargons Explained: Part 4 - KV Cache
13:47
LLM Jargons Explained: Part 4 - KV Cache
10.8K viewsMar 24, 2024
YouTubeSachin Kalsi
LLM Based Smart CV/Resume Analyzer | Streamlit | Groq | Transformers | NLP| Data Science Project
21:50
LLM Based Smart CV/Resume Analyzer | Streamlit | Groq | Transformers | NLP| Data Science Project
762 views11 months ago
YouTubeDataTechInfo
See more