Interesting result. I couldn't tell from the post how the "this was a reward hack" labels were made. If an LLM judge labeled them, comparing the probes against an LLM monitor feels a bit circular. Were any of the labeled hacks checked by humans, and how many?
Interesting result. I couldn't tell from the post how the "this was a reward hack" labels were made. If an LLM judge labeled them, comparing the probes against an LLM monitor feels a bit circular. Were any of the labeled hacks checked by humans, and how many?