Memory
inference-quantization
xiciyang/inference-quantization · ★ 3
Quantize a model checkpoint and prove it: choose a method (default AWQ+INT4), PTQ-calibrate with a leak-free split, pass an independent accuracy gate and a performance gate through real serving…
Manifest details
安装
dsh plugin --profile web add 'github:xiciyang/inference-quantization#cde5a08588a42d469643142af441f9ca9821fdc8'GitHub 源码安装:首次需按提示配置 allowBuilds 构建授权后重试
For install and environment setup, plus plugin development tutorials, see DSH community docs ↗
README
No README content is available.