Coordinal Research: Accelerating the research of safely deploying AI systems.

Funding for a new nonprofit organization focusing on accelerating and automating safety work.

Travel Funding to present research at ICLR2025

Mox, a coworking & events space in SF

For AI safety, AI labs, EA charities & startups

Creating 'Making God': a Feature Documentary on risks from AGI

Production costs for the filming of our ‘Making God’ - documentary on risks from AI for a public, non-technical audience.

AI Governance Exchange (focus on China, AI safety), Seed Funding

Building bridges between Western and Chinese AI governance efforts to address global AI safety challenges.

[Urgent] Travel funding to present research at ICLR and GovAI Summit

Out of This Box: AI Safety Musical

Out of This Box: The Last Musical (Written by Humans)

[Urgent] Top-up funding to present poster at the Tokyo AI Safety Conference

My allocated travel funding is insufficient. Seeking extra funding for flights, accommodation, etc, to present poster and network

Philanthropic advising

Attention-Guided-RL for Human-Like LMs

Compute Funding

Book: A History of AI x-risk (open access)

Building on a course I've been designing, I'm writing a short book on the history of existential risk from AI for a general audience

AI Safety Atlas

Distilling AI safety research into a complete learning ecosystem: textbook, courses, guides, videos, and more.

Luthien

Developing AI Control for Immediate Real-World Use

Develop technical framework for human control mechanisms for agentic AI systems

Building a technical mechanism to assess risks, evaluate safeguards, and identify control gaps in agentic AI systems, enabling verifiable human oversight.

Evaluating LLM Safety in a Multilingual World

11th edition of AI Safety Camp

Cost-efficiently support new careers and new organisations in AI Safety.

SafePlanBench: evaluating a Guaranteed Safe AI Approach for LLM-based Agents

Seeking funding to develop and evaluate a new benchmark for systematically assesing safety of LLM-based agents

Act I: Exploring emergent behavior from multi-AI, multi-human interaction

Community exploring and predicting potential risks and opportunities arising from a future that involves many independently controlled AI systems

Unprompted Unfaithful Chain of Thought Dataset Project

Pilot for new benchmark by Epoch AI

For tracking and predicting future AI progress to AGI