Manifund foxManifund
Home
Login
About
People
Categories
Newsletter
HomeAboutPeopleCategoriesLoginCreate
header image

Technical AI safety

21 proposals
83 active projects
$5.23M
Grants236Impact certificates20
JasrajBudigam avatar

Jasraj Hari Krishna Budigam

TimeAlign v2: contamination-aware evals for small models (16GB GPUs)

Reusable, low-compute benchmarking that detects data leakage, outputs “contamination cards,” and improves calibration reporting.

Science & technologyTechnical AI safetyAI governance
1
0
$0 / $46K
Finn-Metz avatar

Finn Metz

AI Security Startup Accelerator Batch #2

Funding 5–10 AI security startups through Seldon’s second SF cohort.

Science & technologyTechnical AI safetyGlobal catastrophic risks
4
4
$355K raised
XyraSinclair avatar

Xyra Sinclair

ExoPriors, Inc. founder runway

building foundational subjective judgement infrastructure

Science & technologyTechnical AI safetyBiosecurityEA communityForecastingGlobal catastrophic risks
1
0
$0 / $2.5M
seanpetersau avatar

Sean Peters

Evaluating Model Attack Selection and Offensive Cyber Horizons

Measuring attack selection as an emergent capability, and extending offensive cyber time horizons to newer models and benchmarks

Technical AI safety
2
2
$41K / $41K
CeSIA avatar

Centre pour la Sécurité de l'IA

From Nobel Signatures to Binding Red Lines: The 2026 Diplomatic Sprint

Leveraging 12 Nobel signatories to harmonize lab safety thresholds and secure an international agreement during the 2026 diplomatic window.

Technical AI safetyAI governance
6
0
$0 / $400K
whitfillp avatar

Parker Whitfill

Course Buyouts to Work on AI Forecasting, Evals

Technical AI safetyForecasting
3
2
$38K / $76K
🦀

Mirco Giacobbe

Formal Certification Technologies for AI Safety

Developing the software infrastructure to make AI systems safe, with formal guarantees

Science & technologyTechnical AI safetyAI governance
2
1
$128K raised
gergo avatar

Gergő Gáspár

Runway till January: Amplify's funding ask to market EA & AI Safety 

Help us solve the talent and funding bottleneck for EA and AIS.

Technical AI safetyAI governanceEA communityGlobal catastrophic risks
9
6
$520 raised
🍉

L

Visa fee support for Australian researcher to join a fellowship with Anthropic

Technical AI safety
1
0
$4K raised
Miles avatar

Miles Tidmarsh

CaML - AGI alignment to nonhumans

Training AI to generalize compassion for all sentient beings using pretraining-style interventions as a more robust alternative to instruction tuning

Technical AI safetyAnimal welfare
1
1
$30K raised
chriscanal avatar

Chris Canal

Operating Capital for AI Safety Evaluation Infrastructure

Enabling rapid deployment of specialized engineering teams for critical AI safety evaluation projects worldwide

Technical AI safetyAI governanceBiosecurity
3
7
$400K raised
🍇

Jade Master

SDCPNs for AI Safety

Developing correct-by-construction world models for verification of frontier AI

Science & technologyTechnical AI safetyGlobal catastrophic risks
2
0
$39K raised
🍇

David Rozado

Disentangling Political Bias from Epistemic Integrity in AI Systems

An Integrative Framework for Auditing Political Preferences and Truth-Seeking in AI Systems

Science & technologyTechnical AI safetyACX Grants 2025AI governanceForecastingGlobal catastrophic risks
1
1
$50K raised
AdamMorris avatar

Adam Morris

Train LLMs in honest introspection

Train LLMs to accurately & honestly report on their internal decision-making processes through real-time introspection

Technical AI safetyACX Grants 2025
0
1
$15K raised
orpheus avatar

Orpheus Lummis

Guaranteed Safe AI Seminars 2026

Seminars on quantitative/guaranteed AI safety (formal methods, verification, mech-interp), with recordings, debates, and the guaranteedsafe.ai community hub.

Technical AI safetyAI governanceGlobal catastrophic risks
5
3
$30K raised
Justin avatar

Justin Olive

Inspect Evals

Funding to cover our expenses for 3 months during unexpected shortfall

Technical AI safetyAI governance
10
4
$50K raised
Leo-Hyams avatar

Leo Hyams

Fund a Fellow for the Cooperative AI Research Fellowship!

A 3-month fellowship in Cape Town, connecting a global cohort of talent to top mentors at MIT, Oxford, CMU, and Google DeepMind

Science & technologyTechnical AI safetyAI governanceGlobal catastrophic risks
8
4
$2.53K raised
NicoleMutunga avatar

Nicole Mutung'a

6 Month Stipend to Support a Transition to AI Governance Work

Funding research on how AI hype cycles can drive unsafe AI development

Science & technologyTechnical AI safetyAI governanceEA communityGlobal catastrophic risks
2
0
$0 / $7.5K
🐷

Armon Lotfi

When Safety Testing Costs More Than Model Training

Multi-agent AI security testing that reduces evaluation costs by 10-20x without sacrificing detection quality

Science & technologyTechnical AI safetyAI governance
0
0
$999 / $15K
Capter avatar

Furkan Elmas

Exploring a Single-FPS Stability Constraint in LLMs (ZTGI-Pro v3.3)

Early-stage work on a small internal-control layer that tracks instability in LLM reasoning and switches between SAFE / WARN / BREAK modes.

Science & technologyTechnical AI safety
1
2
$0 / $25K