SageMaker AI新增双向流按量计量
Amazon SageMaker AI 为双向流式推理引入按使用量计量,允许模型提供商在实时会话累计用量时上报 AWS Marketplace 软件费用。配套 WebSocket 用于传输增量计量数据,Amazon SageMaker AI 端点基础设施费用仍单独收取。Deepgram 是首发合作伙伴,支持按量计费的语音转文字和文字转语音服务,AWS 还提供了模型服务器集成指南。
该功能填补了长时实时 AI 推理的计费缺口,使 AWS Marketplace 软件费用可与已上报的会话用量相对应,而非单纯按端点可用时长计费。
Usage-based metering for bidirectional streaming solves a software billing problem for real-time speech AI. Customers deploying streaming models on Amazon SageMaker AI bidirectional streaming pay for the endpoint infrastructure that hosts the model. Separately, model providers listing on AWS Marketplace need a way to charge for what customers consume during a live stream. Today, we’re announcing usage-based metering for Amazon SageMaker bidirectional (bidi) streaming inference, so model providers can report actual usage for the AWS Marketplace software charge. Amazon SageMaker AI endpoint infrastructure charges still apply.
Deepgram, the real-time speech AI company, is the launch partner for this capability, bringing usage-based Speech-to-Text (STT) and Text-to-Speech (TTS) billing to AWS Marketplace. This post builds on a series of innovations between Deepgram and AWS. First, we introduced bidirectional streaming for real-time inference on Amazon SageMaker AI, which supports long-lived bidirectional streams between clients and model servers. Then, Deepgram enhanced Amazon SageMaker AI support with AWS Identity and Access Management (AWS IAM) temporary delegation, simplifying secure authentication for enterprise deployments, and expanded observability with enhanced metrics. Now, with usage-based metering, we further strengthen the foundation for production real-time AI, aligning billing with how customers consume streaming and real-time AI workloads.
#Amazon SageMaker AI#AWS Marketplace#Deepgram#AWS Identity and Access Management