12th Edition of AI Safety Camp

Ambitious AI Alignment Seminar

One Month to Study, Explain, and Try to Solve Superintelligence Alignment

Get OpenAI employees addicted to factorio

by buying gift cards for the game and handing them out at the OpenAI offices

AI:Save Our Souls

A tech-infused immersive musical. Experience the future of storytelling where artificial intelligence meets the depths of human emotion.

Transluce: Fund Scalable Democratic Oversight of AI

Isolating CBRN Knowledge in LLMs for Safety - Phase 2 (Research)

Expanding proven isolation techniques to high-risk capability domains in Mixture of Expert models

Reducing Risk in AI Safety Through Expanding Capacity.

AI Security Startup Accelerator Batch #2

Funding 5–10 AI security startups through Seldon’s second SF cohort.

Evaluating Model Attack Selection and Offensive Cyber Horizons

Measuring attack selection as an emergent capability, and extending offensive cyber time horizons to newer models and benchmarks

Paper Clip Apocalypse (War Horse Machine)

Short Documentary and Music Video

Terminal Boundary Systems and the Limits of Self-Explanation

Formalizing the "Safety Ceiling": An Agda-Verified Impossibility Theorem for AI Alignment

Addressing Agentic AI Risks Induced by System Level Misalignment

AI Safety Camp 2026 project: Bidirectional Failure modes between security and safety

Course Buyouts to Work on AI Forecasting, Evals

Formal Certification Technologies for AI Safety

Developing the software infrastructure to make AI systems safe, with formal guarantees

Runway till January: Amplify's funding ask to market EA & AI Safety 

Help us solve the talent and funding bottleneck for EA and AIS.

Offensive Cyber Kill Chain Benchmark for LLM Evaluation

Measuring whether AI can autonomously execute multi-stage cyberattacks to inform deployment decisions at frontier labs

Operating Capital for AI Safety Evaluation Infrastructure

Enabling rapid deployment of specialized engineering teams for critical AI safety evaluation projects worldwide

CaML - AGI alignment to nonhumans

Training AI to generalize compassion for all sentient beings using pretraining-style interventions as a more robust alternative to instruction tuning

Visa fee support for Australian researcher to join a fellowship with Anthropic

Travel support for career transitioner to attend AAAI 2026 (with accepted paper)