Manifund foxManifund
Home
Login
About
People
Categories
Newsletter
HomeAboutPeopleCategoriesLoginCreate
header image

AI governance

17 proposals
59 active projects
$3.59M
Grants194Impact certificates8
🥕

Jacob Steinhardt

Transluce: Fund Scalable Democratic Oversight of AI

Technical AI safetyAI governance
5
2
$40K / $2M
DavidKrueger avatar

David Krueger

Evitable: a new public-facing AI risk non-profit

Our mission is to inform and organize the public to confront societal-scale risks of AI, and put an end to the reckless race to develop superintelligent AI.

AI governanceGlobal catastrophic risks
3
1
$5.13K / $1.5M
XyraSinclair avatar

Xyra Sinclair

SOTA Public Research Database + Search Tool

Unlocking the paradigm of agents + SQL + compositional vector search

Science & technologyTechnical AI safetyBiomedicalAI governanceBiosecurityForecastingGlobal catastrophic risks
1
0
$0 / $20.7K
AmritSidhu-Brar avatar

Amrit Sidhu-Brar

Forethought

Research on how to navigate the transition to a world with superintelligent AI systems

AI governanceGlobal catastrophic risks
4
2
$315K / $3.25M
ltwagner28 avatar

Lawrence Wagner

Reducing Risk in AI Safety Through Expanding Capacity.

Technical AI safetyAI governanceEA communityGlobal catastrophic risks
3
0
$10K raised
anthonyw avatar

Anthony Ware

Shallow Review of AI Governance: Mapping the Technical–Policy Implementation Gap

Identifying operational bottlenecks and cruxes between alignment proposals and executable governance.

Technical AI safetyAI governanceGlobal catastrophic risks
1
0
$0 / $23.5K
RyanCel avatar

Ryan Celimon

Making AI Safety Understandable to Everyday Audiences

Translating AI’s biggest threats into videos anyone can understand: AGI, misalignment, and job loss explained.

Science & technologyTechnical AI safetyAI governanceGlobal catastrophic risks
1
1
$0 / $15K
🌳

Will Shin

Building an Educational Universe Through Animals and Longtermist Storytelling

A global IP project reimagining ecology and future technology and institutions through character-driven narratives.

Science & technologyAI governanceAnimal welfareBiosecurityEA communityGlobal catastrophic risks
1
0
$0 / $15K
🦀

Mirco Giacobbe

Formal Certification Technologies for AI Safety

Developing the software infrastructure to make AI systems safe, with formal guarantees

Science & technologyTechnical AI safetyAI governance
2
1
$128K raised
majorjanyau avatar

Muhammad Ahmad

Building Frontier AI Governance Capacity in Africa (Pilot Phase)

A pilot to build policy and technical capacity for governing high-risk AI systems in Africa

Technical AI safetyAI governanceBiosecurityForecastingGlobal catastrophic risks
1
0
$0 / $50K
gergo avatar

Gergő Gáspár

Runway till January: Amplify's funding ask to market EA & AI Safety 

Help us solve the talent and funding bottleneck for EA and AIS.

Technical AI safetyAI governanceEA communityGlobal catastrophic risks
9
6
$520 raised
CeSIA avatar

Centre pour la Sécurité de l'IA

From Nobel Signatures to Binding Red Lines: The 2026 Diplomatic Sprint

Leveraging 12 Nobel signatories to harmonize lab safety thresholds and secure an international agreement during the 2026 diplomatic window.

Technical AI safetyAI governance
6
0
$0 / $400K
sandguine avatar

Sandy Tanwisuth

Alignment as epistemic system governance under compression

We reframe the alignment problem as the problem of governing meaning and intent when they cannot be fully expressed.

Science & technologyTechnical AI safetyAI governance
1
0
$0 / $20K
evzen avatar

Evžen Wybitul

Retroactive: Presenting a poster at the ICML technical AI governance workshop

AI governance
1
3
$1.3K raised
Brian-McCallion avatar

Brian McCallion

Boundary-Mediated Models of LLM Hallucination and Alignment

A mechanistic, testable framework explaining LLM failure modes via boundary writes and attractor dynamics

Technical AI safetyAI governance
1
0
$0 / $75K
ChristopherKuntz avatar

Christopher Kuntz

Protocol-Level Interaction Risk Assessment and Mitigation (UIVP)

A bounded protocol audit and implementation-ready mitigation for intent ambiguity and escalation in deployed LLM systems.

Science & technologyTechnical AI safetyAI governance
1
0
$0 / $5K
JasrajBudigam avatar

Jasraj Hari Krishna Budigam

TimeAlign v2: contamination-aware evals for small models (16GB GPUs)

Reusable, low-compute benchmarking that detects data leakage, outputs “contamination cards,” and improves calibration reporting.

Science & technologyTechnical AI safetyAI governance
1
0
$0 / $46K
chriscanal avatar

Chris Canal

Operating Capital for AI Safety Evaluation Infrastructure

Enabling rapid deployment of specialized engineering teams for critical AI safety evaluation projects worldwide

Technical AI safetyAI governanceBiosecurity
3
7
$400K raised
🍇

David Rozado

Disentangling Political Bias from Epistemic Integrity in AI Systems

An Integrative Framework for Auditing Political Preferences and Truth-Seeking in AI Systems

Science & technologyTechnical AI safetyACX Grants 2025AI governanceForecastingGlobal catastrophic risks
1
1
$50K raised
orpheus avatar

Orpheus Lummis

Guaranteed Safe AI Seminars 2026

Seminars on quantitative/guaranteed AI safety (formal methods, verification, mech-interp), with recordings, debates, and the guaranteedsafe.ai community hub.

Technical AI safetyAI governanceGlobal catastrophic risks
5
3
$30K raised