Understand the risk.
Investigate vulnerabilities that remain hidden behind safe-looking answers. Develop representation-level evaluations for open-weight models.
Evaluation & diagnosisAn emerging AI safety research community
A model’s answers tell only part of the story. We study what happens beneath the surface—and how that understanding can make AI safer.
01 / Research directions
We connect evaluation, alignment, and intervention through the internal representations of AI models.
Investigate vulnerabilities that remain hidden behind safe-looking answers. Develop representation-level evaluations for open-weight models.
Evaluation & diagnosisExplore how feedback from internal representations can improve alignment and make safety more robust under changing conditions.
Representation-based alignmentBuild selective monitoring and steering methods that respond to emerging risks while preserving useful capabilities and task progress.
Monitoring & controlOne model. Three research lenses.
Evaluation asks where apparently safe behavior breaks down.
02 / Selected work
Research by our founder and collaborators that informs this initiative’s agenda. These works predate the organization.
A Representation-Level Perspective
Studying the gap between passing behavioral audits and resisting internal interventions.
GANPO explores latent-space feedback for more robust preference learning.
Utility-Preserving LLM Safety Alignment
Adjusting safety interventions using a model’s hidden states.
Come say hello.
Tell us what you’re working on, what you’d like to learn, or how you’d like to get involved.
Researchers · Students · Organizers · Research partners