Show HN: Distilling DeepSeek into GPT-OSS doesn't transfer censorship. Try it
We recently used DeepSeek V4 Flash as a teacher for finance tasks with GPT-OSS-120B. Distillation works well on this problem. At a constrained 8k token budget, our self-distilled 120B scores 83.61% on FinanceReasoning, above Kimi K3 (81.93%) and Inkling (65.13%). We released the 20B open weights.…
No discussion yet. Be the first to share your thoughts!