NHacker Next
  • new
  • past
  • show
  • ask
  • show
  • jobs
  • submit
Reinforcement Learning with Metacognitive Feedback Elicits Uncertainty in LLMs (arxiv.org)
thx67 2 days ago [-]
> Since monitoring task performance and adapting behavior accordingly are central to metacognition, we posit that mod- els capable of accurately judging their own performance are better positioned to improve it. We operationalize this idea via two novel mechanisms: reinforcement learning with metacognitive feedback (RLMF), a paradigm to refine completion rankings during preference optimization based on the quality of a model’s self- judgments of performance, and metacognitive data selection, which uses similar self-judgments to identify high-value training examples, outperforming naive active learning.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact
Rendered at 21:31:34 GMT+0000 (Coordinated Universal Time) with Vercel.