In this presentation, I will discuss the design, implementation and engineering experience in building and deploying MegaScale, a production system for training large language models (LLMs) at the scale of more than 10,000 GPUs. Training LLMs at this scale brings unprecedented challenges to training efficiency and stability. Maintaining high efficiency throughout the training process (i.e., stability) is an important consideration in production given the long extent of LLM training jobs. Many ha
0:32
In this presentation, I will discuss the design, implementation and en…
14 viewsJun 5, 2024
FacebookAt Scale
516K views · 6.7K reactions | ⚙️ Extreme Engineering Machines Building The Most Amazing Megastructures ⚙️ There’s something about watching a colossal machine at work that fills us with awe. But is there anything more satisfying than watching something of that scale complete an even more gargantuan task? Let’s check out some of the world’s most extreme engineering machines building amazing megastructures. | Be Amazed | Facebook
13:00
516K views · 6.7K reactions | ⚙️ Extreme Engineering Machines Bu…
516.8K views3 weeks ago
FacebookBe Amazed
Pillars of Precision Giants at Ground and Sky
0:47
Pillars of Precision Giants at Ground and Sky
710 views2 months ago
YouTubeMEGABUİLD WONDERS
Choreography of Giants: The Engineering Ballet of Megaprojects
0:48
Choreography of Giants: The Engineering Ballet of Megaprojects
1 month ago
YouTubeMEGABUİLD WONDERS
This Mine Is Bigger Than a City 😳 #engineering #megascale #shorts #mining #industry
0:07
This Mine Is Bigger Than a City 😳 #engineering #megascale #shorts …
1 views2 months ago
YouTubeBeyondScale
“FROM MINI CUTTERS TO MEGA TITANS 🚂💥 | EXTREME MACHINERY EVOLUTION REVEAL!”
0:13
“FROM MINI CUTTERS TO MEGA TITANS 🚂💥 | EXTREME MACHINERY …
4 views3 months ago
YouTubeMegascale Universe
Inside a Mega Factory Testing Godzilla’s Strength | Ultra-Realistic Industrial Documentary
8:33
Inside a Mega Factory Testing Godzilla’s Strength | Ultra-Realisti…
73 views1 month ago
YouTubeInside Mega factories
0:49
Colossal Engineers: Giants of Demolition and Construction Reim…
67 views3 months ago
YouTubeMEGABUİLD WONDERS
0:47
Colossal Precision: Machines That Redefine Megaprojects
165 views2 months ago
YouTubeMEGABUİLD WONDERS
11:45
This Insane Ocean Project Is Pushing Nature to Its Limits
29 views1 month ago
YouTubeConstruction Time in English
1:22:50
Why ENERGY and Heat Decide a Matrioshka Brain’s Fate
43 views3 weeks ago
YouTubeFuturistic Technology
0:45
Megacrane Mastery: The Tech Behind Mega Structures
2 months ago
YouTubeMEGABUİLD WONDERS
0:26
18 December 2025
145 views2 months ago
YouTubeSai Solu
0:49
Behemoths of Blueprint The Hidden Tech of Megastructures
14 views1 month ago
YouTubeMEGABUİLD WONDERS
1:34:07
Why We Haven't Built An O'NEILL CYLINDER Yet
32 views1 week ago
YouTubeFuturistic Technology
0:40
Monsters of the Build: The Giants Behind Our Skyscrapers
41 views3 months ago
YouTubeMEGABUİLD WONDERS
MindCraze on Instagram: "They’re not sculpting the mountain — they…
11.3K views4 months ago
Instagrammindcraze2
5:45
Exposing a CoX Point Boosting Method For Faster Purples | Use T…
47.8K viewsJul 7, 2022
YouTubeKing Condor
Megascale Engineering: From Space Elevators to the Great Wall of China
Jul 29, 2022
interestingengineering.com
2:25
Science Projects | Balloon Rocket
315.5K viewsSep 22, 2018
YouTubeDIY Projects
20:43
TOP 14 SUPER STEM ACTIVITIES
121.8K viewsJan 14, 2021
YouTubeTHE LAST SURVIVOR TALENT SCOUT
8:53
Elon Musk's Las Vegas Loop Explained
300.7K viewsMay 25, 2021
YouTubeTomorrow's Build
2:49
Ball Launcher: 2018 Engineering Challenge
356.2K viewsDec 21, 2017
YouTubeScience Buddies
5:14
Paper Bridges STEM Challenge Lesson Plan for Students
19.3K viewsJul 25, 2020
YouTubeElementary STEM with Ms. Crosman
9:29
The Nano World (Nanotechnology and Nanoscience)
26.5K viewsDec 2, 2020
YouTubeKen Paul Espinosa
55:54
27. Nuclear Materials — Radiation Damage and Effects in Matter
238K viewsSep 20, 2019
YouTubeMIT OpenCourseWare
11:32
The Engineering Challenges of Renewable Energy: Crash Course …
254.9K viewsJan 3, 2019
YouTubeCrashCourse
4:37
STEM Challenge Index Card Tower
122.5K viewsApr 25, 2017
YouTubeBaker STEM Lab
12:41
Top 10 Fun Engineering Science Projects for Kids in School or Home
332.2K viewsSep 7, 2016
YouTubeTriple Arcade and Yucky Science
3:18
Engineering Games: Crash Course Kids #29.2
277.2K viewsOct 1, 2015
YouTubeCrash Course Kids
See more videos
Static thumbnail place holder