Hello! I’m Saffron. I’m a technologist, researcher and writer.
I’m a research scientist on the Societal Impacts team at Anthropic. I also co-founded (and am now advisor to) the Collective Intelligence Project (CIP), a research and policy organization looking to improve and leverage humanity’s collective intelligence to better govern and thus benefit from transformative technologies such as AI. We've primarily worked on enabling more democratic input into AI, and more democracy-enabling uses of AI.
I'm driven by improving the interface between AI and people. I previously was a research engineer at DeepMind, investigating and engineering large language models, human-AI interaction, value alignment, conceptual reasoning, and multi-agent RL.
More stuff about me: I have a degree in Applied Mathematics-Computer Science, with minors in Government and German, from Harvard. I'm from New Zealand. And sometimes I do photography.
Selected Papers / Book Chapters
- Collective Constitutional AI - S Huang*, D Siddarth*, L Lovitt*, ..., D Ganguli* (*joint co-authors) (2024). Featured in the New York Times. Blog post.
- Collective Intelligence over Artificial Intelligence - S Huang, D Siddarth. AI Morality. Oxford University Press (forthcoming 2024).
- Beyond Static AI Evaluations: Advancing Human Interaction Evaluations for LLM Harms and Risks - L Ibrahim, S Huang, ... (Submitted to AIES 2024).
- Using the Veil of Ignorance to align AI systems with principles of justice - L Weidinger, K McKee, ... (PNAS 2023)
- Generative AI and the Digital Commons - S Huang, D Siddarth (2022)
- Red Teaming Language Models with Language Models - E Perez, S Huang, ... (EMNLP 2022)
- Scaling Language Models: Methods, Analysis & Insights from Training Gopher - JW Rae, S Borgeaud, ... (2021)
- Improving language models by retrieving from trillions of tokens - S Borgeaud, A Mensch, ... (ICML 2022)
- Bi-Level Multi-Agent Reinforcement Learning for Intervening in Intertemporal Social Dilemmas - S Huang (2020)
Selected Pieces
- Predistribution over Redistribution: Beyond the Windfall Clause - CIP Blog (with Sam Manning).
- The Surprising Synergy Between Acupuncture and AI - WIRED.
- ChatGPT and the death of the author - The New Statesman.
- Control and Consciousness of Time - Summer of Protocols.
- A philosophy of subtraction - Reboot.
- Who will control crypto? - on consistent patterns of centralisation in past information technologies and implications for open blockchains.
- Privacy and pluralism - what is privacy, and why does it matter?
- Turing-Complete Governance - on the power and potential of EVM arbitrariness for collective decision-making.
- Letters to a Young Technologist - a collection of essays written with some dear friends. I penned What is Technology? and To Be a Technologist is to be Human.
- Harvard Creates Managers Instead of Elites in Palladium Magazine - I also did a podcast episode on this.
- Virtually Social in The Wave Arts Magazine.
Talks / Podcasts
- UN Internet Governance Forum (IGF 2023): Digital Democracy in the Age of AI (Oct 2023)
- OpenAI Forum: The Importance of Public Input in Designing AI Systems (inaugural event) - (July 2023)
- Panel at Civic Future's The Great Stagnation conference (July 2023)
- Demos: Collective Intelligence Panel (July 2023)
- The Rhys Show podcast (April 2023)
- Generative AI and Democracy at Bruce Schneier's International Workshop on Recreating Democracy (December 2022)
- Red Teaming Language Models with Language Models at EMNLP and IJCAI (2022)
- Palladium Magazine podcast (July 2020)
Media
- The Race to Democratise AI (Democracy Technologies, October 2023)
- Rewiring Democracy: can society control its tech destiny? (Culture3, August 2023)
- Aligning Technology Development with Public Input: A Conversation with Saffron Huang (C/Change, August 2023)
- Can AI And Democracy Fix Each Other? (The New York Times, April 2023)
- Alumni Profile: Saffron Huang, A.B. '20 (Harvard SEAS, April 2023)
Misc
- Under the Rose - a sporadically maintained blog on the mechanisms and politics of digital information flows.
- Kernel Magazine (co-founder, creative director, writer)