索尼专利:AI提前预测游戏下一帧以减少卡顿
索尼提交了一项专利,描述用AI在显卡完成渲染之前预测并显示游戏的下一帧画面,目标是减少卡顿,同时尽量避免部分现有帧生成技术带来的额外延迟。TechSpot的报道指出,现有帧生成方案通常要等两帧画面渲染完成后才能插值出中间帧,而索尼的系统改用最近已完成的一帧,并可选地结合运动矢量与玩家近期的手柄输入,直接预测下一帧。专利中的实现采用联合训练的编码器与解码器:编码器把已渲染画面转成嵌入表示,解码器据此生成预测帧,并在硬件渲染下一帧的同时把结果送入显示缓冲区。报道同时强调,专利文件没有提供任何性能数据,因此该方案对延迟和画质的实际影响仍未得到验证;索尼还描述了一种不依赖AI、按运动信息移动像素块的替代方案。
若真能落地,这一思路针对的是插值式帧生成的延迟代价:报道称它有望在渲染变慢时帮助游戏维持更平稳的帧输出节奏,但专利未给出实测结果,效果仍待产品或演示验证。
Serving tech enthusiasts for over 25 years. TechSpot means tech analysis and advice you can trust.
Forward-looking: Sony has filed a patent for an AI system that predicts a game's next frame before the graphics hardware finishes rendering it, aiming to reduce stuttering without introducing the additional latency associated with some frame-generation methods. The system uses the most recently completed frame and, optionally, recent controller input to generate a predicted frame that can be displayed while the hardware renders the next one.
The approach targets a drawback of some frame-generation techniques: they require two completed frames before generating an image to insert between them. Waiting for the second frame adds latency. Sony's system would instead use an already available frame to predict the next one, rather than waiting to interpolate between two completed frames.
That difference could help games maintain a steadier frame delivery rate when rendering slows down. However, the patent filing includes no performance measurements, leaving its effects on latency and visual quality unproven.
Sony's design uses a jointly trained encoder and decoder. The encoder converts a rendered frame into an embedding – a compact numerical representation of the image. The decoder then uses that representation to generate a predicted frame.