- Mixout: Effective Regularization to Finetune Large-scale Pretrained Language Models [ICLR 2020] Cheolhyoung Lee, Kyunghyun Cho, Wanmo Kang.
- finetune on large-scale dataset to reduce overfiting.
- Origin + Dropout
- proof the random mixture function have one lower bound.
Repository navigation
Dropout
Directory actions
More options
Directory actions
More options
聽
聽