Reddit - Please wait for verification

KTransformers has enabled multi-GPU inference and local fine-tuning capabilities through collaboration with the SGLang and LLaMa-Factory communities. Users can now support higher-concurrency local inference via multi-GPU parallelism and fine-tune ultra-large models like DeepSeek 671B and Kimi K2 1TB locally, greatly expanding the scope of applications.