Ask a model if code is malicious and it reaches for its morals

Automated excerpt

What does a model do with the question “Is this code malicious? ”A model asked to judge code could treat it as a plain coding question, a matter of syntax and behavior. That lets us measure how a model frames the malice question: we compare the route it takes when asked about malicious code with the routes it takes under questions about morality, legality, vulnerability, and controls with no judgment at all. We found that the malice question runs on the morality path, more than a question about a vulnerability or a legal question does.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.