即将离开稀土掘金，请注意账号财产安全

https://huggingface.co/docs/trl/main/en/dpo_trainer