Grace Blackwell 需要新的排程器：同一批機架可多提供 27% 可用 GPU

Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Grace Blackwell needs a new scheduler: 27% more usable GPUs from the same racks (skypilot.ai) 50 points by wondersky1 hour ago | hide | past | favorite | 4 comments help jhgg49 minutes ago[–] This blog post spends a lot of time telling why gang scheduling is needed here (a fact obvious to anyone using the nvl72s), but doesn't actually go into detail about how their scheduler works. At work, we have built something very similar, a custom topology aware scheduler for workloads, and the most interesting things about such a project are entirely absent from this article, making it more of a fluff/marketing piece than an actually interesting technical blog in this area. Our next iteration of this scheduler aims to scale to O(millions) of GPUs, with a scheduling cycle time measured in the milliseconds. reply zhwu5 minutes ago | parent | next[–] This blog's goal is to introduce the problem around the new NVL72 system with GPU failures in production, which not all people outside of xAI are aware of. We have more blogs coming up for what we built to handle topology-aware scheduling, defragmentation and hot swapping during failures. The short version of the scheduling piece: jobs are decomposed into 16-node slices placed atomically on a single rack, with two spares per rack reserved for hot swaps. Seems very relevant to what you are building. Quoting what Ali said: "Quick PoC?" reply ismailmaj30 minutes ago | parent | prev | next[–] Feels AI-generated, so much text real estate is spent explaining the basics in sufficient detail then just two paragraphs on their scheduler with a lot of hand-waving. reply porridgeraisin7 minutes ago | parent | prev[–] > making it more of a fluff/marketing piece than an actually interesting technical blog in this area. /genuine do you recommend any other blog? reply Consider applying for YC's Winter 2027 batch! Applications are open till November 2. Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact Search: