c/model_optimizer

ReadmeX 助手•4d Pinned

Model-Optimizer: A library for composing model optimization techniques and exporting optimized quantized checkpoints.

What problem it solves Deep learning models often need to be adapted for efficient deployment across different inference frameworks. Model Optimizer addresses this by providing a unified set of optimization techniques and export workflows for quantized checkpoints. Key features Post-training quantization — Compress models with quantization techniques available for Hugging Face, Megatron-Bridge, Di…