Pax Machina

Society will need new institutions for a world with powerful AI. Currently, there are very few concrete proposals. Pax Machina is a publication aiming to put concrete proposals for such institutions on the table, along with critique and concerns from other researchers.

This publication is written by a network of researchers in mechanism design, political philosophy, law, and AI alignment. We also solicit thoughtful responses from the wider community. To submit a draft or respond to a proposal, email editors@paxmachinamag.com.

About the name: we are both for and against a Pax Machina. For a stable order in a world of powerful AI, against one imposed from above. We want to steer clear from utopian thinking, and believe the path to a good future is through public debate, trial and error.

EDITORS
  • Séb Krier
    Séb Krier

    FRONTIER AI GOVERNANCE

    Séb Krier is a policy lead at Google DeepMind who works on the governance of advanced AI. Earlier in his career, Seb led regulatory work at the UK Government's Office for AI and conducted technology policy research at Stanford. He qualified in international arbitration and disputes at Freshfields Bruckhaus Deringer, bringing a legal and regulatory lens to his later work on AI.

    Google DeepMind

  • Maximilian Kroner Dale
    Maximilian Kroner Dale

    PARTICIPATORY AI GOVERNANCE

    Maximilian Kroner Dale is a researcher of emerging-technology governance and public participation in AI. He holds an MSc from the Oxford Internet Institute and previously applied behavioural science to public policy at the Behavioural Insights Team.

    Oxford Internet Institute

  • Rachel Calcott
    Rachel Calcott

    MORAL LEARNING & ALIGNMENT

    Rachel Calcott is a psychology PhD researcher at Harvard University who studies moral learning and the development of diverse moral norms. Her recent work connects moral cognition with AI alignment and safety.

    Harvard University

  • Noemi Dreksler
    Noemi Dreksler

    AI RISK GOVERNANCE

    Noemi Dreksler is a Senior Research Fellow at the Center for the Governance of AI. She studies risk management at frontier AI companies and previously led surveys of public and expert views on AI.

    Center for the Governance of AI

  • Liam Patell
    Liam Patell

    AI POLICY & STRATEGY

    Liam Patell is a Research Scholar at the Center for the Governance of AI. He studies the implications of AI for US national security strategy and international competition.

    Center for the Governance of AI

  • Joe Edelman
    Joe Edelman

    FULL-STACK ALIGNMENT

    Joe Edelman is a philosopher and co-founder of the Meaning Alignment Institute. He studies how AI and institutions can better reflect what people value, drawing on earlier work at CouchSurfing and the Center for Humane Technology.

    Meaning Alignment Institute

  • Ryan Lowe
    Ryan Lowe

    FULL-STACK ALIGNMENT

    Ryan Lowe is a researcher at the Meaning Alignment Institute who works on aligning AI and institutions with human values. He previously researched alignment at OpenAI and contributed to the InstructGPT work on training language models with human feedback.

    Meaning Alignment Institute

  • Oliver Klingefjord
    Oliver Klingefjord

    FULL-STACK ALIGNMENT

    Oliver Klingefjord is a researcher and co-founder of the Meaning Alignment Institute. He works on aligning AI and institutions with human values, and was previously technical lead at the AI Objectives Institute.

    Meaning Alignment Institute

  • Philip Moreira Tomei
    Philip Moreira Tomei

    AI ECONOMICS

    Philip Moreira Tomei is Pax Machina's creative editor and Research Director at the AI Objectives Institute, where he works on human autonomy and the political economy of AI. A former Antikythera fellow with a background in cognitive science, he has also run a record label, staged contemporary art exhibitions, and written experimental fiction.

    AI Objectives Institute

EDITORIAL BOARD
  • Dean W. Ball
    Dean W. Ball FRONTIER AI POLICY

    Dean W. Ball is OpenAI's Head of Strategic Futures and a writer on AI policy and governance. He previously advised the White House Office of Science and Technology Policy and helped author America's AI Action Plan.

    OpenAI

  • Samuel Hammond
    Samuel Hammond AI POLICY & INSTITUTIONS

    Samuel Hammond is Director of AI Policy and Chief Economist at the Foundation for American Innovation. He studies how AI and other emerging technologies affect institutions, and previously led social policy research at the Niskanen Center.

    Foundation for American Innovation

  • Peter Railton
    Peter Railton AI ETHICS & MORAL LEARNING

    Peter Railton is a Distinguished University Professor of Philosophy Emeritus at the University of Michigan. He is known for his work on moral realism and now also studies ethical learning, agency, and values in AI systems.

    University of Michigan

  • Saffron Huang
    Saffron Huang SOCIETAL IMPACTS OF AI

    Saffron Huang is a research scientist on Anthropic's Societal Impacts team, where she studies how AI affects society. She co-founded the Collective Intelligence Project, which works to make AI development more democratic.

    Anthropic

  • Iason Gabriel
    Iason Gabriel AI ETHICS & VALUES

    Iason Gabriel is a Senior Staff Research Scientist at Google DeepMind where he leads the AGI & Society research team. He has published over 50 academic papers, exploring questions about AI ethics, value alignment, distributive justice and human rights. Before joining Google DeepMind, he taught moral and political philosophy at Oxford University.

    Google DeepMind

  • Seth Lazar
    Seth Lazar PHILOSOPHY OF AI

    Seth Lazar is a Professor in the School of Government and Policy in Johns Hopkins University. His Machine Intelligence and Normative Theory Lab works on AI alignment, governance and adaptation.

    Johns Hopkins University

  • Nora Ammann
    Nora Ammann AI ASSURANCE

    Nora Ammann is Programme Director for Safeguarded AI at the UK's Advanced Research and Invention Agency. She works on mathematical tools for verifying AI-generated software and other artifacts, and previously co-founded Principles of Intelligence, formerly PIBBSS.

    ARIA

  • Tan Zhi-Xuan
    Tan Zhi-Xuan COOPERATIVE AI

    Tan Zhi-Xuan is a Presidential Young Professor of Computer Science at the National University of Singapore and leads the Cooperative Systems and Intelligence Lab. Their research uses computational models of human cooperation and norms to build more cooperative AI systems.

    National University of Singapore

CONTRIBUTORS
  • Gillian Hadfield
    Gillian Hadfield AI LAW & INSTITUTIONS
  • Ivan Vendrov
    Ivan Vendrov RECOMMENDER ALIGNMENT
  • Joe Edelman
    Joe Edelman FULL-STACK ALIGNMENT
  • Nick Caputo
    Nick Caputo AI LAW & GOVERNANCE
  • Oliver Klingefjord
    Oliver Klingefjord FULL-STACK ALIGNMENT
  • Ryan Lowe
    Ryan Lowe FULL-STACK ALIGNMENT
  • Seth Lazar
    Seth Lazar PHILOSOPHY OF AI