Faster LLMs: Accelerate Inference with Speculative Decoding
Faster LLMs: Accelerate Inference with Speculative Decoding
10 months ago
ibm.com
How to Quadruple LLM Decoding Performance with Speculative Decoding (SpD) and Microscaling (MX) Formats on Qualcomm® Cloud AI 100
How to Quadruple LLM Decoding Performance with Speculative Decoding (SpD) and Microscaling (MX) Formats on Qualcomm® Cloud AI 100
Aug 1, 2024
qualcomm.com
AI Explained: Speculative decoding with vLLM
2:42
AI Explained: Speculative decoding with vLLM
1K views3 weeks ago
YouTubeRed Hat
LK Losses: Optimizing Speculative Decoding
4:18
LK Losses: Optimizing Speculative Decoding
1 month ago
YouTubeAI Research Roundup
LLM Explained: How Transformers Predict Your Next Word
0:55
LLM Explained: How Transformers Predict Your Next Word
117 views3 weeks ago
YouTubeCode & Capital
GigaWorld-Policy: An Efficient Action-Centered World--Action Model (Mar 2026)
17:46
GigaWorld-Policy: An Efficient Action-Centered World--Action Model (Mar 2026)
17 views1 week ago
YouTubeAI Paper Slop
Speculative Speculative Decoding for Faster LLM Inference
1:23
Speculative Speculative Decoding for Faster LLM Inference
1.3K views3 weeks ago
YouTubeRajistics - data science, AI, and machine learning
NVIDIA's VP of AI Explains Why They Give Away Their Best Models | Kari Briski × Kim Isenberg
21:17
NVIDIA's VP of AI Explains Why They Give Away Their Best Models | Kari Briski × Kim Isenberg
1.2K views1 week ago
YouTubeSuperintelligence
ggml and llama.cpp join Hugging Face & Custom AI chips for fast inference - Hacker News (Feb 20, ...
20:35
ggml and llama.cpp join Hugging Face & Custom AI chips for fast inference - Hacker News (Feb 20, ...
1 month ago
YouTubeThe Automated Daily
Transformers Project | Article Summarization & Category Classification App using Hugging Face+Gradio
24:35
Transformers Project | Article Summarization & Category Classification App using Hugging Face+Gradio
21 views1 month ago
YouTubeNasir Hussain
GBV: The AI Speed Hack You Need Now (30% Faster Inference) #Shorts
0:58
GBV: The AI Speed Hack You Need Now (30% Faster Inference) #Shorts
1 month ago
YouTubeCollapsedLatents
【論文解説】【爆速化】推測デコーディングをスパース計算で検証！驚きの成果公開！
14:13
【論文解説】【爆速化】推測デコーディングをスパース計算で検証！驚きの成果公開！
12 views1 month ago
YouTube論文解説チャンネル
What is Speculative decoding - Speculative decoding Explained #generativeai #RAG #ai #llm
1:05
What is Speculative decoding - Speculative decoding Explained #generativeai #RAG #ai #llm
273 views3 weeks ago
YouTubeMed Bou | AI Tutorials
AutoKernel: 225 Autonomous GPU Experiments - 21.7x Faster Kernels on RTX 5090
7:09
AutoKernel: 225 Autonomous GPU Experiments - 21.7x Faster Kernels on RTX 5090
50 views2 weeks ago
YouTubeBuildify
EP5: Speculative Decoding with Nadav Timor
1:02:23
EP5: Speculative Decoding with Nadav Timor
116 views6 months ago
YouTubeThe Information Bottleneck
This Repo Makes LLMs 24x Faster — And Most AI Companies Use It #Shorts #vLLM #LLMInference #GitHub
0:31
This Repo Makes LLMs 24x Faster — And Most AI Companies Use It #Shorts #vLLM #LLMInference #GitHub
963 views2 weeks ago
YouTubeGithubTrends
Curriculum Learning for Wide Multimedia-Based Transformer with Graph Target Detection | Proceedings of the 28th ACM International Conference on Multimedia
Curriculum Learning for Wide Multimedia-Based Transformer with Graph Target Detection | Proceedings of the 28th ACM International Conference on Multimedia
Oct 18, 2020
acm.org
Stanford CS224N NLP with Deep Learning | Winter 2021 | Lecture 10 - Transformers and Pretraining
Stanford CS224N NLP with Deep Learning | Winter 2021 | Lecture 10 - Transformers and Pretraining
49.7K viewsOct 29, 2021
YouTubeStanford Online
Encoder Decoder Network - Computerphile
6:20
Encoder Decoder Network - Computerphile
156.6K viewsJun 13, 2018
YouTubeComputerphile
Transformer models: Encoder-Decoders
6:47
Transformer models: Encoder-Decoders
105.6K viewsJun 14, 2021
YouTubeHugging Face
Transformers vs Recurrent Neural Networks (RNN)!
6:28
Transformers vs Recurrent Neural Networks (RNN)!
30.6K viewsOct 22, 2020
YouTubeMachine Learning TV
The Narrated Transformer Language Model
29:30
The Narrated Transformer Language Model
346.3K viewsOct 26, 2020
YouTubeJay Alammar
Problems With Encoders And Decoders- Indepth Intuition
11:09
Problems With Encoders And Decoders- Indepth Intuition
44.1K viewsAug 5, 2020
YouTubeKrish Naik
Neural Networks Part 8: Image Classification with Convolutional Neural Networks (CNNs)
15:24
Neural Networks Part 8: Image Classification with Convolutional Neural Networks (CNNs)
397.8K viewsMar 8, 2021
YouTubeStatQuest with Josh Starmer
Understanding Porter Stemmer Algorithm | Decoding NLP Libraries (NLTK)
11:13
Understanding Porter Stemmer Algorithm | Decoding NLP Libraries (NLTK)
21.3K viewsNov 24, 2020
YouTubeTechViz - The Data Science Guy
Faster and Lighter Model Inference with ONNX Runtime from Cloud to Client
19:56
Faster and Lighter Model Inference with ONNX Runtime from Cloud to Client
3.5K viewsOct 16, 2020
YouTubeMicrosoft Developer
Lecture 10: Neural Machine Translation and Models with Attention
1:21:24
Lecture 10: Neural Machine Translation and Models with Attention
93.1K viewsApr 3, 2017
YouTubeStanford University School of Engineering
Encoder-Decoder Sequence to Sequence(Seq2Seq) model explained by Abhilash | RNN | LSTM | Transformer
16:08
Encoder-Decoder Sequence to Sequence(Seq2Seq) model explained by Abhilash | RNN | LSTM | Transformer
18.1K viewsJan 5, 2021
YouTubeCo-learning Lounge
The Transformer architecture
2:45
The Transformer architecture
90.6K viewsJun 14, 2021
YouTubeHuggingFace
Deep Learning(CS7015): Lec 15.2 Applications of Encoder Decoder models
17:34
Deep Learning(CS7015): Lec 15.2 Applications of Encoder Decoder models
31.9K viewsOct 24, 2018
YouTubeNPTEL-NOC IITM
See more