SyRuP: Enhancing System-Prompt Following via Reward-Guided Prediction in LLM Decoding

Large Language Models (LLMs) are increasingly controlled through system prompts that specify roles, formats, and safety requirements. However, models follow these prompts only implicitly through in-context learning, which can be insufficient for complex or compositional prompts. Existing approaches