Practical Strategies for Optimizing LLM Inference Sizing and Performance | NVIDIA Technical Blog
Practical Strategies for Optimizing LLM Inference Sizing and Perform…
Aug 21, 2024
nvidia.com
EfficientML.ai Lecture 12 - Transformer and LLM (Part I) (MIT 6.5940, Fall 2023)
1:17:49
EfficientML.ai Lecture 12 - Transformer and LLM (Part I) (MIT …
11.1K viewsOct 20, 2023
YouTubeMIT HAN Lab
EfficientML.ai Lecture 12 - Transformer and LLM (Part I) (MIT 6.5940, Fall 2023,
1:19:55
EfficientML.ai Lecture 12 - Transformer and LLM (Part I) (MIT …
684 viewsOct 22, 2023
bilibiliMIT-HAN-LAB
Maximizing LLM Performance: Techniques and Strategies
Maximizing LLM Performance: Techniques and Strategies
Nov 14, 2023
medium.com
EfficientML.ai Lecture 12 - Transformer and LLM (Part I) (MIT 6.5940, Fall 2023)
1:19:37
EfficientML.ai Lecture 12 - Transformer and LLM (Part I) (MIT …
3K viewsOct 22, 2023
bilibiliMIT-HAN-LAB
Lec 12 | Efficient LLMs: Part 02
1:01:46
Lec 12 | Efficient LLMs: Part 02
452 views4 months ago
YouTubeLCS2
LLMs | Efficient LLM Decoding-II | Lec15.2
52:54
LLMs | Efficient LLM Decoding-II | Lec15.2
1.8K viewsOct 9, 2024
YouTubeLCS2
54:05
LLMs | Efficient LLM Decoding-I | Lec15.1
2.3K viewsOct 4, 2024
YouTubeLCS2
35:00
The inner workings of LLMs explained - VISUALIZE the self-att…
14.1K viewsMay 13, 2023
YouTubeDiscover AI
33:39
Mastering LLM Inference Optimization From Theory to Cost …
31.7K viewsJan 1, 2025
YouTubeAI Engineer
19:19
5 Levels Of LLM Summarizing: Novice to Expert
65.5K viewsMay 4, 2023
YouTubeGreg Kamradt
34:14
Understanding the LLM Inference Workload - Mark Moyou, NVIDIA
22K viewsOct 1, 2024
YouTubePyTorch
6:28
LLM in a flash: Efficient Large Language Model Inference with Li…
4.8K viewsDec 23, 2023
YouTubeAI Papers Academy
53:35
Yuandong Tian | Efficient Inference of LLMs with Long Context Support
1.2K viewsDec 8, 2023
YouTubeLondon Machine Learning Meetup
36:12
Deep Dive: Optimizing LLM inference
44.6K viewsMar 11, 2024
YouTubeJulien Simon
6:14
Rules of Inference - Basic Terminology
259.4K viewsMay 30, 2018
YouTubeNeso Academy
18:17
How to use open source LLM model | Free | Groq | Faster Inference
1.2K viewsApr 2, 2024
YouTubeNextGenAI with Sai
1:17
Efficient LLM inference solution on Intel GPU
722 viewsJan 18, 2024
bilibiliPaperWeekly
55:39
Understanding LLM Inference | NVIDIA Experts Deconstruct How …
21.2K viewsApr 23, 2024
YouTubeDataCamp
45:11
LLM inference optimization: Model Quantization and Distillation
1.2K viewsSep 22, 2024
YouTubeYanAITalk
1:13:27
CMU LLM Inference (1): Introduction to Language Models and Inference
3K views5 months ago
YouTubeGraham Neubig
36:43
Primer on LLM Inference: Optimization with Prefill and Decode
218 views4 months ago
YouTubeAI Papers Podcast Daily
3:44
Efficient LLM Agents: Memory, Tools, and Planning
44 views1 month ago
YouTubeAI Research Roundup
40:53
Infinite-LLM: Efficient LLM Service for Long Context with DistAttentio…
461 viewsJan 8, 2024
YouTubeArxiv Papers
29:41
LLM Inference Arithmetics: the Theory behind Model Serving
388 views4 months ago
YouTubePyData
10:19
Top LLM and Deep Learning Inference Engines - Curated List
354 viewsMay 9, 2024
YouTubeAbonia Sojasingarayar
1:20
Demo: Efficient FPGA-based LLM Inference Servers
1.8K viewsNov 7, 2024
YouTubeAltera
5:16
LLM System Design Interview: How to Optimise Inference Latency
239 views3 months ago
YouTubePeetha Academy
9:05
Modern LLM Inference: Architecture, Quantization, and Serving Infrastr…
11 views2 months ago
YouTubeUplatz
6:18
What is Speculative Sampling? | Boosting LLM inference speed
3.8K viewsNov 20, 2024
YouTubeAssemblyAI
See more videos
Static thumbnail place holder