From the source
Hugging Face adds bias metrics and measurements to its Evaluate library, allowing users to evaluate language model bias in areas like toxicity, polarity, and hurtfulness using causal language models such as GPT-2 and BLOOM.
Evaluating Language Model Bias with 🤗 Evaluate
Story of the weekCapability change
From the source
we have been working on adding bias metrics and measurements to the 🤗 Evaluate library. In this blog post, we will present a few examples of the new additions and how to use them. We will focus on the evaluation of causal language models (CLMs) like GPT-2 and BLOOM
huggingface.co
