Hello! I’m Saffron. I’m a technologist, researcher and writer.
I’m a research scientist on the Societal Impacts team at Anthropic. I also co-founded (and am now advisor to) the Collective Intelligence Project (CIP), a research and policy organization looking to improve and leverage humanity’s collective intelligence to better govern and thus benefit from transformative technologies such as AI. We've primarily worked on enabling more democratic input into AI, and more democracy-enabling uses of AI.
I'm driven by improving the interface between AI and people. I previously was a research engineer at DeepMind, investigating and engineering large language models, human-AI interaction, value alignment, conceptual reasoning, and multi-agent RL.
More stuff about me: I have a degree in Applied Mathematics-Computer Science, with minors in Government and German, from Harvard. I'm from New Zealand. And sometimes I do photography.
Selected Papers / Book Chapters
- Collective Constitutional AI - S Huang*, D Siddarth*, L Lovitt*, ..., D Ganguli* (*joint co-authors) (2024). Featured in the New York Times. Blog post.
- Collective Intelligence over Artificial Intelligence - S Huang, D Siddarth. AI Morality. Oxford University Press (forthcoming 2024).
- Beyond Static AI Evaluations: Advancing Human Interaction Evaluations for LLM Harms and Risks - L Ibrahim, S Huang, ... (Submitted to AIES 2024).
- Using the Veil of Ignorance to align AI systems with principles of justice - L Weidinger, K McKee, ... (PNAS 2023)
- Generative AI and the Digital Commons - S Huang, D Siddarth (2022)
- Red Teaming Language Models with Language Models - E Perez, S Huang, ... (EMNLP 2022)
- Scaling Language Models: Methods, Analysis & Insights from Training Gopher - JW Rae, S Borgeaud, ... (2021)
- Improving language models by retrieving from trillions of tokens - S Borgeaud, A Mensch, ... (ICML 2022)
- Bi-Level Multi-Agent Reinforcement Learning for Intervening in Intertemporal Social Dilemmas - S Huang (2020)
Selected Pieces
Talks / Podcasts
Misc
- Under the Rose - a sporadically maintained blog on the mechanisms and politics of digital information flows.
- Kernel Magazine (co-founder, creative director, writer)