Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

MaxText

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 2

  1. Streaming DiLoCo Brings WAN-Based LLM Training to MaxText

    Google Developers Blog says MaxText v0.2.5 introduces Streaming DiLoCo, which lets independently located learner groups train across datacenters while reducing cross-slice communication through periodic global updates and fine-grained parameter streaming. In tests using Qwen3-32B on two TPU v5p-32 slices, Google reported about 64–65 times less cross-slice traffic than data parallelism; the worked example says the 10 Gbit/s link required roughly 1.3 Gbit/s for Streaming DiLoCo. The feature is available through MaxText v0.2.5 on PyPI, its Docker images and the GitHub main branch.

    Google Developers Blog · 🔥 0
  2. MaxText v0.2.4 adds long-context training for Cloud TPU

    Google announced that MaxText v0.2.4 supports long-context training on Cloud TPU through four context-parallel strategies: All-gather, A2A (DeepSpeed Ulysses), P2P (Ring Attention), and A2A + P2P (USP). The framework can extend context to 14 million tokens across TPU 5p and TPU 7, and Google reports that Llama 3.1 8B reached 70% Model FLOPs Utilization on TPU 5p for sequences up to 4 million tokens. The release is available on PyPI, Docker images, and GitHub main.

    Google Developers Blog · 🔥 0

Experience and discussion from the community

Share my MaxText experienceAsk about MaxText

Nobody has shared their experience with MaxText yet.