How to Tame a Multi-Headed Hydra? Adaptive Multi-Category Safety Steering for Large Language Models

As large language models (LLMs) become increasingly widespread, preventing unsafe responses to harmful prompts is essential for their safe deployment. Activation steering offers an approach to improving LLM safety by modifying internal activations during inference without updating model parameters.