「自己搭一个决策模型」:判断层开始出现 DIY 路径
“Build your own decision model”: a DIY path for the judgement layer
HN 上 473 分的文章 《Build your own decision model》给出了自己训练判断模型的完整思路[1]。它要解决的是决策层的适配问题:通用决策模型(Jev、Clef 这类)覆盖的是常见判断,而业务里真正麻烦的是私有标签体系、行业术语与阈值定义,自己训一个往往比反复调提示更稳。做法上把「带选项的概率输出 + 自有数据微调」当作标准流程,而非依赖大模型的自由文本判断。对做 Agent 与业务系统的团队,参考价值是当判断标准可以枚举时,优先考虑自训小模型,而不是继续堆提示词;限制是自训需要标注样本与评测集,样本不足时小模型会过拟合到历史分布,文章本身也未给出跨领域的量化对比。
A 473-point HN essay, “Build your own decision model”, lays out an end-to-end path to training your own judgement model[1]. It addresses fit in the decision layer: general decision models such as Jev or Clef cover common judgements, while the hard part in practice is a private label taxonomy, domain jargon and threshold definitions — where training your own is often steadier than iterating on prompts. The approach treats probability-over-options output plus fine-tuning on your own data as the standard flow rather than relying on free-text judgement from a large model. For agent and business-system teams the reference is to prefer a self-trained small model whenever the criteria can be enumerated instead of piling on prompts; the limit is that self-training needs labelled samples and an evaluation set, and with too few samples the model overfits the historical distribution.