Beyond Hidden-Layer Manipulation: Semantically-Aware Logit Interventions for Debiasing LLMs

cs.LG arXiv:2510.23650
View PDF arXiv JSON

Abstract

We proposed Static and Dynamic -- two zero-shot logits-layer debiasing methods. Dynamic reduces bias by up to 70% with minimal fluency loss. Logits intervention outperforms hidden-layer approaches. We show semantic-aware logits intervention is stable and effective for debiasing aligned LLMs.

PDF Viewer