Hi all,

Thank you again so much for your support! After completing the exploratory phase which was funded by this grant we completed two experimental studies based on the results.

We evaluated two prompts on 4 different LLMs and found that GPT-4.5 (with one prompt that we had validated through the exploratory phase) was judged to be human significantly more often than real humans (73% of the time). We believe this to be the first evidence that any system passes a standard (3-party) 5-minute Turing test.

You can read the rest of the results in our preprint:

Jones, C. R., & Bergen, B. K. (2025). Large Language Models Pass the Turing Test. arXiv preprint arXiv:2503.23674. (https://arxiv.org/abs/2503.23674)

The site is still live and will continue to run until we spend the rest of the money from this grant/project.

This project would most likely have languished without your support, so thanks very much for keeping it going and helping us to get to this stage! I will probably close the project soon after the funding runs out. Please let me know if you have any questions or ideas for further experiments to run.

Cameron

The site is finally back up at turingtest.live.

The new site uses a 3-party format where you chat with both a human and an LLM at the same time, and your task is to decide which is which. This setup is closer to Turing's original idea, and we think it will be much harder for the models to pass.

We've also added a range of models, including GPT-4o, Claude, and LLaMA, along with new prompting techniques that allow the models to interact in different ways.

The site will be live every day from 12–1 PM and 8–9 PM GMT (8 AM and 3 PM ET, 5 AM and 12 PM PT). We've done this in the hope of increasing the density of users online at the same time.

Thanks so much to everyone for your help, patience, and support while getting this back going. Please let me know if you have any comments or thoughts on the site as I'll be continuing to make updates. And please feel free to share the site as it works best when we get enough traffic for many people to be live at the same time.

We’re planning to relaunch the site soon and we’re running a pilot test on Friday at 8pm GMT (3pm ET, 12pm PT).

You can access the new site here: 3p.turingtest.live. The pilot will be accessible here on Friday.

Any feedback you can provide about how the site and your interactions work would be greatly appreciated!

If you have any questions or comments, please let me know at cameron@ucsd.edu.

Hi all,

Thank you for your patience and apologies for the lack of updates. I have had to focus on other things over the last months including finishing my PhD and starting a postdoc. However, I am now able to put my full focus on this for the next couple of months. I'm hoping to have the updated experimental design finished by the end of the month and to start collecting data in October.

Thanks again and please let me know if you have any questions!
Cameron

This is a cool project that might help improve the conversation around these issues.

Some people might be worried about hype, but there's already so much hype, the harms are likely marginal.

You may want to consider linking people to an AI Safety resource if you think your site may get a lot of traffic, then again, you might not if you think that'd make people more suspicious of the results.

Another option to consider would be an ad-supported model. I'm not suggesting Google Ad words, but you might be able to find an AI company to sponsor you.

I’m glad to see this reach the threshold.

@camrobjones where will be best to monitor progress and see results?

This sounds really cool and the only AI related ACX Grants cert project I could evaluate to have some legible chance at an impact, potentially a viral one. It already had some success apparently and just needs more funding. The Turing Test is a pretty fundamental concept in AI lore and we should have at least one running.

The Turing Test is definitely the most publicly well-known test of AI abilities, it has always seemed strange to me that the Loebner Prize stopped being awarded in 2020 right before AI started to reach a level where it could potentially get close to passing. I think something like this should definitely exist, I remember playing with it a bit when it was initially released and it was pretty cool.

This is neat! I'm not hugely expecting it to move the needle of popular understanding of AI deceptiveness very much, but the possibility of its doing so strikes me as sufficiently non-negligible that it nonetheless seems worth tossing some money at just in case.

Oh, what a cool project!
A few questions:
1. Who does a job of a human witness in this test? How do you make sure that there is a human online when someone wants to play the "interrogation game"?
2. Have you applied for OpenAI or Claude credits?
3. How about asking users to input their chatgpt API key to play?

In any case, I'm happy to offer money to get this project over a minimum funding bar

Can we expect an update here after a month or two? If it goes well, I will likely be glad to provide more funding

I really like that Cam has already built & shipped this project, and it appears to have gotten viral traction and had to be shut down due to costs; rare qualities for a grant proposal! The project takes a very simple premise and executes well on it; playing with the demo makes me want to poke at the boundaries of AI, and made me a bit sad that it was just an AI demo (no chance to test my discernment skills); I feel like I would have shared this with my friends, had this been live.

Research on AI deception capabilities will be increasingly important, but also like that Cam created a fun game that interactively helps players think a bit about how for the state of the art has come, esp with the proposal to let user generate prompts too!