NVIDIA B300

Headlines · 2

1. 28m
   DoubleAI releases debut code execution model to cut GPU and CPU costs

   DoubleAI, a Tel Aviv-based startup, released its debut code execution model aimed at optimizing GPU and CPU performance, according to a Wall Street Journal report. The company describes it as a new category of artificial intelligence that can help companies lower their computing costs, though the report provides no independent measurement of savings. The report also says DoubleAI has raised $220 million and has acquired 1,000 Nvidia B300 chips.

   Techmeme · 🔥 0
2. Oct 9
   Ai2 replaces priority scheduler with fair-share GPU budgets and time-slicing contracts

   Ai2's AI Infrastructure team says it replaced its priority-based cluster scheduler with GPU time budgets, hierarchical fair-share allocation and a time-slicing contract for dividing scarce compute among research projects. Ai2 manages thousands of NVIDIA H100, B200 and B300 GPUs in clusters ranging from 88 to 1024 GPUs, serving about 150 internal researchers, with submitted workloads requesting 2–3x the available capacity at any time. The post says the old setup led to GPU "squatting," priority inflation and manual negotiations over shutting down jobs, and that the new contract asks workloads to declare a minimum runtime during which they cannot be preempted before being requeued. Ai2 also reports a 74% reduction in repairs requiring human intervention, a self-reported figure, and says it is investigating whether capacity fragmentation could increase queue waits for the largest workloads.

   Ai2 Blog · 🔥 0

Experience and discussion from the community

Share my NVIDIA B300 experienceAsk about NVIDIA B300