Apple study: LLMs also benefit from an old productivity trick

In a new study co-authored by Apple researchers, an open-source large language model (LLM) saw big performance improvements after being told to check its own work by using one simple productivity trick. Here are the details.

A bit of context

After an LLM is trained, its quality is usually refined further through a post-training step known as reinforcement learning from human feedback (RLHF).

With RLHF, every time a model gives an answer, human labelers can either give it a thumbs…