JuiceFS

Headlines · 2

1. 2d
   JuiceFS Adds Fine-Grained Data Warming for Lance Datasets

   JuiceFS has begun supporting fine-grained data warming for Lance datasets, according to pull requests #7398 and #7399. The report describes Lance as organizing and selecting data, while JuiceFS uses a train list and local NVMe caching to prewarm required files near GPU nodes; uncached data can still be fetched from object storage. It also describes an unnamed leading autonomous-driving company using Lance, JuiceFS, and object storage, while noting that publicly documented production practices and cases for the combination remain limited.

   掘金 · 人工智能 · 🔥 1
2. Nov 2
   Meta’s EB-Scale AI Storage Architecture

   A report on Meta’s “Meta’s AI Storage Blueprint at Scale” examines its BLOB Storage architecture for AI training, including simplified metadata, direct client I/O, and multi-tier caching. It also compares Meta’s design with JuiceFS, which the report promotes. Meta’s reported 80% cache-hit rate and 93% average and 97% worst-case reductions in data-loading time were not independently verified in the supplied material.

   掘金 · 人工智能 · 🔥 0

Experience and discussion from the community

Share my JuiceFS experienceAsk about JuiceFS

All

juicefs•4d Pinned

juicefs: A distributed POSIX file system that stores data in object storage and metadata in compatible database engines.

What problem it solves Applications need shared storage that can be mounted like a local POSIX file system while keeping bulk data in object storage and metadata in a separate database. This enables existing applications, Hadoop workloads, Kubernetes deployments, and S3 clients to use the same storage without changing application code. Key features POSIX-compatible file system interface — The clie…

github.comhttps://github.com/juicedata/juicefs