oh btw if you haven't yet, might be worth filling out https://survey.chipsforhumanity.org/
@carol
$0 in pending offers
Caroline Ellison
2 days agooh btw if you haven't yet, might be worth filling out https://survey.chipsforhumanity.org/
Caroline Ellison
2 days agoThanks for the thoughtful responses! This makes sense to me: "I see the primary role of independent researchers then as exploring somewhat-weird bets on alignment techniques and generating enough evidence to convince frontier labs to pursue them, and thereby moving those ideas inside-the-overton-window."
Given all this, I'd like to fund you for something through Sunlight! Happy to do either this project, or if you want to write up a proposal (can be very brief/low-effort since we've already talked about it and I don't want to take too much of your time) on a continuation of the data filtering work you've been doing on the BlueDot grant I can fund that instead. I lean slightly toward being more excited about things less likely to be covered by frontier labs (so less excited about the RLVR part of the proposal) but also think you should mostly work on whichever direction you're most excited about at the moment.
Caroline Ellison
2 days agoCan you share any more about the process of selling Making God? I'm most interested in how likely it is to sell to a major streaming service, or if you can share anything about where you are in talks and who you might sell it to.
Caroline Ellison
2 days agoApproved! I'm excited for Making God, and these further project ideas are continuing in the same charitable mission.
Caroline Ellison
3 days agoI had a call with Ethan today--he seems like an accomplished researcher who is likely to produce good research, but I'm still confused whether this is the kind of thing it makes sense for Sunlight to fund.
My understanding is that Ethan's research agenda is basically relatively legible prosaic alignment research of the type that frontier AI companies are also quite motivated to get right. Given that, and the fact that they have billions more dollars than us, it seems like Sunlight's comparative advantage should be working in other areas--eg fieldbuilding, media, advocacy, and policy--or at the very least, making kind of weird bets when we do fund technical alignment research.
On the other hand, the implicit conclusion of the above reasoning might be that Ethan should work at say Anthropic, where he'd have access to much more compute as well as Anthropic IP. But I don't generally go around advising people to work at Anthropic--if anything, I think on the margin more people should quit Anthropic. So maybe it's actually worthwhile for funders like Sunlight to fund researchers like Ethan because it keeps them independent.
I was talking to @Austin about all of this and he was like "let's have this argument in public" so--thoughts?
(And Ethan--thanks for taking the time to call! I appreciate you bearing with us.)
Caroline Ellison
4 days agoI’m recommending a $10k grant through Sunlight. Liu and Justas seem like promising and dedicated undergrads, the proposal seems well thought through, and they’ve found an experienced mentor.
I see the biggest benefit of the grant being to help upskill Liu and Justas and encourage them to continue in AI safety research, with the secondary benefit being that it might produce some useful research. Overall, it seems like quite a good deal at $10k.
Caroline Ellison
5 days agoI spoke with Muhammad, the lead of Pause AI Toronto, about this grant.
I’m not sure how important advocacy in Canada or other middle powers is, but it seems worth devoting at least some resources to, and PauseAI Canada is quite under-resourced right now. (ControlAI has been working with Canadian legislators, but I’m not aware of other organizations doing more widespread advocacy/movement-building in Canada.)
Muhammad seems to be engaging with a lot of people and ideas in AI safety and thinking critically about the most effective ways PauseAI Canada can improve the world. I see a lot of the value of this grant coming not just from persuading the average Canadian or leading to Canadian influence on an international treaty, but from more generally empowering the PauseAI Canada volunteers.
Caroline Ellison
6 days agoRubi Hudson seems like a strong researcher with endorsements from many. He has two single-author top-conference papers, and Max Harms called his work “perhaps the most clear advance” in corrigibility in the past year, along with other endorsements you can see in the comments on this project and his previous one. Overall, the team seems strong and well-posed to execute.
I like that they have a clear agenda and explain how their research directions fit into their plan for AI alignment. I don’t know how likely the agenda is, and it’s probably a long shot.
$10k is far short of their goal funding, but it gives them a little more time to find major funders in addition to directly funding a bit more research time.
The biggest argument against the grant that I see is that the opportunity cost of the researchers is valuable, and they’d be doing more valuable work at a different organization focusing on a different research agenda. I don’t have an object-level take on that, but I have a meta-level take that diversity of organizations and agendas is good, and it’s good to encourage talented people to at least try founding ambitious projects rather than working at existing organizations.
Caroline Ellison
6 days agoNiklas has an impressive number of followers and views for something he’s been doing as a part-time project: over 130k followers in total, and a viral video with 2 million views.
I don’t speak German or watch short-form videos, but I watched some of his videos (with AI-translated captions) and they seemed pretty good. I appreciate that he does things like posting all the sources behind his videos on his website. One downside is that his content isn’t that focused—a lot of his videos are about mundane harms of AI. Maybe this is a good way to introduce people to existential risk, but I tend to think it might turn off or memetically inoculate people who (rightly) think AI offers a lot of mundane utility that outweighs its mundane harms.
He’s still well below his minimum funding even with a grant of $10k, but I hope he’ll get funding from other sources (I know he is in discussions with a few at the moment). Funding him for a year seems like a good experiment, since it will give him time to see how much going full-time makes a difference and whether he can become self-sustaining through revenue.
Caroline Ellison
9 days agoThis looks like a reasonable project, and you have an impressive record for someone so young! Right now the proposal is being flagged for being AI-generated--if you rewrite it in your own words, you might have a better chance of being seen by donors and getting funded.
Caroline Ellison
10 days agoThe grantee returned most of the grant as it was unused, so I've refunded it proportionally to donors' Manifund accounts.
Caroline Ellison
10 days agoApproved! Congratulations on your progress so far and good luck.
Caroline Ellison
13 days agoThis seems like a clear and well-scoped proposal! FYI funders are less likely to see your project if it's flagged as AI-written--if you're able to rewrite the proposal in your own words, that may help with visibility. (The AI percentage is automatically recalculated on proposal edits.)
Caroline Ellison
20 days agoUnfortunately Fatma updated that her visa application to travel to Australia was denied, so I've returned the funding to @gnutella
Caroline Ellison
26 days agoApproved! I'm glad you'll get a chance to present your project in person and benefit from the network at the conference.
Caroline Ellison
about 1 month agoApproved! The creators seem to have a good track record of creative projects and a plausible sense of what might appeal to audiences.
Caroline Ellison
about 1 month agoApproved! This seems like an important question, and happy to trust in Gavin's judgment of grantees.
Caroline Ellison
about 1 month agoApproved! Always happy to support Keri's grantmaking, and this seems like a cheap test that could produce interesting results
Caroline Ellison
about 1 month ago@sheikheddy I closed the project, so the funds are now returned to the donors!
Caroline Ellison
about 1 month agoApproved! This seems like something that may increase BASE's effectiveness.
Caroline Ellison
about 1 month ago@atilgandev Thanks for addressing the issue! Noting that it has now been resolved.
Caroline Ellison
about 1 month agoHi Serhat — we’ve found that several accounts voting on your AURA project appear to be controlled by you or created on your behalf, so we’ve banned those accounts. Manifund relies on comments reflecting independent views from real people, and using additional accounts to boost a project or downvote other projects isn’t allowed. Your project can stay up for now, but any further sockpuppet activity will result in your account and project being removed.
Caroline Ellison
about 2 months agoApproved! Happy to extend a lot of trust to our regrantors' judgment as always, and this project sounds like a cheap way to potentially produce useful insights.
Caroline Ellison
about 2 months agoApproved! AISA seems to have a good track record, and understanding of AI by policymakers in Asia is a very important cause.
Caroline Ellison
about 2 months agoApproved! This is an important area, and from the website so far I think this has the potential to be a clear explainer and useful resource.
Caroline Ellison
about 2 months agoApproved! This falls within Manifund's charitable mission by contributing to public scientific research.
Caroline Ellison
2 months agoApproved! Advocacy work to avert AI risks aligns with Manifund's charitable mission.
Caroline Ellison
3 months agoApproved! Getting adoption for something like this seems like a clear win, and we're excited about the team.
Caroline Ellison
3 months agoCanceled the pending offers here! The grantee wrote: "I've completed the work this grant would have funded, but secured a better funding route for it, so I won't be accepting this grant. Please regrant these funds, or if necessary return them to the funder. Kindly treat this grant as withdrawn and closed on my end"
Caroline Ellison
3 months ago@amiralia Yep I see the ACH info, thanks! We'll send the payment today and then you should receive it within a few days.
Caroline Ellison
3 months ago@amiralia yes! you or they can fill out this form: https://airtable.com/appOfJtzt8yUTBFcD/shrI3XFPivduhbnGa it asks for ACH details (bank account name, address, routing number, account number) as well as Manifund username and project link.
If that doesn't work feel free to just email the bank account info (hi@manifund.org) and we can handle it.
Caroline Ellison
3 months agoApproved! These sound like interesting research projects, and funding mentee projects is a good way to fieldbuild as well as directly producing research.
Caroline Ellison
3 months agoApproved! Excited to see work on democracy and civil society in the age of AI.
Caroline Ellison
3 months agoApproved! This seems like a great use of funds, comes highly endorsed, and fits squarely within Manifund's mission. Good luck!
Caroline Ellison
3 months ago@amiralia Hi! Sorry for the delayed response--we just rolled out a feature that allows grant agreements to be signed externally by organizations. I've reset your agreement so you can redo it as an organization: on https://manifund.org/projects/safeguarding-dna-synthesis-from-biological-risks-posed-by-advanced-ai/agreement, enter Georgia Tech Research Corporation's details and the email of GT's authorized signatory, and they'll receive a link to review and execute the agreement (they'll get a copy for their records). Once that's signed, you can withdraw the funds to GTRC at https://manifund.org/withdraw.
Let me know if you need the agreement as a PDF instead, or if you run into any issues!
Caroline Ellison
3 months agoApproved! Metagame provides upskilling as a space for people to learn and allows people speakers to broadcast ideas and people to make connections they wouldn't have otherwise. Donations allow them to provide financial aid.
Caroline Ellison
3 months agoApproved! This sounds great; excited for more geographically diverse fieldbuilding and especially in Hong Kong.
Caroline Ellison
4 months ago@StevePetersen that's okay! We don't really have a system for this: I think your report was sufficient, it was just overlooked on our end.
Caroline Ellison
4 months agoAs Steve was able to fund this project separately and stated that he wouldn't spend money from this application, I've returned the funds to the donors!
Caroline Ellison
4 months agoUpdate: since Andrew was unable to accept the funds, I returned the donation to the ACX grants account.
Caroline Ellison
4 months agoApproved! This seems like a good way to try to engage AI safety talent in India.
Caroline Ellison
4 months ago@chi-nguyen It looks like this report is missing the text; I'm curious what the latest on this project is!
Caroline Ellison
4 months ago@Petr_Salaba I'm curious if you have any more updates on this project! Thanks!
Caroline Ellison
4 months agoApproved--it sounds like BAISH has successfully gotten many people working in AI safety!
Caroline Ellison
4 months agoApproved! I think SPARC is a good program and influencing the trajectory of talented high schoolers can be valuable.
Caroline Ellison
4 months agoApproved! This sounds like a plausible policy that's worth understanding better.
Caroline Ellison
4 months agoApproved! This sounds like an interesting experiment, and I'm excited to be working with grantmaking.ai.
Caroline Ellison
4 months agoApproved this grant! I'm excited about research into verification tech for if/when it's needed, and excited to be working with grantmaking.ai on this funding round.
| For | Date | Type | Amount |
|---|---|---|---|
| Manifund Bank | 2 days ago | deposit | +2000 |
| Manifund Bank | 2 days ago | deposit | +2000 |
| Manifund Bank | 3 days ago | deposit | +2000 |
| Manifund Bank | 4 days ago | deposit | +2000 |
| <729f62bd-a8cd-44fb-97c8-d04b90daa33b> | 11 days ago | profile donation | 10 |
| Manifund Bank | 11 days ago | deposit | +20 |
| <fd98bb90-533a-45ee-a8ee-abd7366ad001> | 13 days ago | tip | 1 |
| Manifund Bank | 4 months ago | deposit | +10 |