Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

EMR Serverless StarRocks Adds Full Paimon 2.0 Support

AI summary

Alibaba Cloud’s EMR Serverless StarRocks now fully supports Paimon 2.0, according to project and vendor authors. The integration combines vector and full-text search, scalar prefilters, BLOB reads, caching, candidate merging, and relational analysis in one SQL execution architecture for multimodal data and AI data preparation. Alibaba Cloud DLF can manage index construction, compaction, snapshots, partitions, and obsolete-file cleanup.

In-depth insight

The update provides a unified path for searching multimodal lakehouse data and preparing data for AI workflows, although deployment scale and performance claims have not been independently verified.

作者:范振,StarRocks TSC Member;阿里云开源 OLAP 负责人

阿里云 EMR Serverless StarRocks 是面向实时数仓与湖仓分析的全托管服务,Stella 是其企业级内核。围绕企业在开放数据湖上的查询需求,Stella 持续优化存算分离架构、数据读取、缓存与查询执行,让保留在湖中的数据可以直接用于交互式查询、多表关联与业务分析。随着湖中的数据类型与使用方式不断扩展,Stella 也在将湖上分析能力进一步延伸到多模态检索与 AI 数据准备。

这一方向延续了 StarRocks 对 Lakehouse 的长期投入。自 2023 年提出“From OLAP to Lakehouse”技术路线以来,社区持续完善对 Delta Lake、Iceberg、Paimon 等开放湖表的支持。围绕这些湖上查询需求积累的 SQL 优化、分布式执行与数据缓存能力,也为 Stella 在云上承载更大规模、更多类型的分析负载提供了基础。

今天,湖中的分析对象正在扩大。视频、图像、音频、文档和传感器记录,需要与订单、日志、标签和评测指标一起进入计算。模型能够提取这些内容的语义,也让企业有了新的数据使用方式:根据内容发现样本,关联业务记录解释结果,再把选出的数据送入训练与评测。Paimon 2.0 在实时湖表的基础上,进一步将数据管理、特征加工和索引检索连接起来,也让查询引擎需要同时处理大范围分析与低延迟检索。

#Alibaba Cloud#EMR Serverless StarRocks#Paimon 2.0#StarRocks#Stella#Alibaba Cloud DLF#PyPaimon

Original · 16 min readRead the original
Group chat

No comments yet. Start the conversation.