From the source
Apple researchers systematically studied conditioning methods for LLMs, finding that efficient steering often degrades fluency and that activation steering is less effective on instruction-tuned models than on base models.
- Simple prompting and supervised fine-tuning work for concept injection but not removal, and cheap textual metrics correlate well with costly LLM-as-judge scores.