I'm a student from Waterloo pursing a PhD at physics and that makes want to learn about AI and draw connections between the two fields. Obviously, there isn't many ppl trying this, so you may have a chance to lead the torch. All the best!
**Please note that donations are not needed at this time, ignore the funding goal. We care more about your feedback!
Leading research that aims to bring quantum theory into the AI field unlocking new horizons. By doing that, we aim to eradicate intractability that opposes major breakthroughs and boost creativity redeeming innovation at scale. Our motivations are ambitious as we trying to push the boundaries beyond the early adaption phase and democratize AI, making it merely accessible to everyone around the globe. We are looking to involve the community as well, so everyone takes part in this revolutionary work.
In case you're curious, our vison entails the following:
-We're fully aware that transformers are near retirement, and they can no longer carry the torch forward. Hence, we look to build a new architecture based off the combination of existing novel approaches.
-We look to simulate and manipulate quantum concepts to align with our circumstances to alter our technological present boosting computation at scale by offering cost-effective solutions.
-Ultimately, if everything goes well, we intent to apply those findings into the build of an advanced digital entity. A secure multi-modal agent that ultimate mission is to serve people while keeping them engaged in their tasks. Indeed, that has to do with a lot of "ethics and regulations" metrics that I think are essential to foster a safe and productive machine-human collaboration in the long term.
-Last but not least, I was triggered by the deceptive hype flooding the industry, hence, I decided to embrace this journey. We willing to cut through the unnecessary clout and meaningfully engage AI in people's lives, which only mission is to help humanity thrive and prosper in the age of unprecedented technological advancement.
The project's goals are twofold:
1-Simulating quantum theory, particularly superposition and entanglement, compressing the data into "state vectors".
2-As result we will look to build a multi-disciplinary digital entity with a superficial cognitive system at scale.
1) First, how are we going to apply quantum physics theories into AI?
We will draw inspiration from two fundamental quantum concepts: Entanglement and superposition, refining them to fit our purpose and goals to eventually spark a major breakthrough. Applying Entanglement will help us predict tokens far apart in our dataset simultaneously, saving us endless time and reducing the computational footprint significantly. In this context, Entanglement is dependent on Superposition. Meaning, it cannot be achieved in training models unless the data trained upon is superposed. What do I mean by that? Superposition consists of the correlation of tokens. "Main Words" should be represented by a dense, multidimensional vector that encapsulates the entire lexicon related to them. For example, if the machine encounters the word "vehicle" in a sequence, it should be able to simultaneously generate related words such as car, bus, Ford, Tesla, etc. regardless how far apart they're from the "main word" in the dataset. Similarly, this should happen with each word under the same lexical field. The data should come pre-embedded in that sense, allowing the model to run an initial scan, and generate all related words. This is not prediction; the machine will only generate roughly all words in the dataset in a structured approach. Then, based on the semantics learned and the correlation between words, it should predict "context" meaning full phrases and sentences instead of sole tokens, think of it as "filling the gaps". This might require human intervention and supervised learning initially. However, I'm pretty confident that sooner than later, machines will become confident predicting contexts on their own after grasping multiple samples beforehand.
2) We looking to build a multi-disciplinary entity that is rational, dynamic, and fun so you can interface with it and have real time speech-to-speech discussions. It can serve as an assistant, mentor, or simply a best friend with whom you argue a lot but still cherish.
To achieve this, we will need to go through two crucial steps inspired by the "DIFFUSION MODELS ARE REAL-TIME GAME ENGINES" paper.
1: Train the agent in an interactive environment with given parameters. In our case, the parameters will be the following: the conversation's dynamic memory content, the rendered screen pixels, the agent's rendering logic, and the agent's logic given the user's input. Our environment here is a speech-to-speech interface where different users will be holding a variety of discussions with the agent. This is when the community is going to be much needed playing a crucial role into developing a diverse dataset from scratch.
2: The entity has a body. Hence, we will need to produce numerous animations, body movements, gestures and facial expressions. Then, we will stitch them to their equivalent speech data and create speech-image pairs.
3: The community interactions with the agent in our exclusive environment alongside the animations will be collected as a data upon which a generative model will be trained. This generative model will likely be text-to-image diffusion model that we will re-purpose and condition on both speech and emotions. We will implement a sophisticated dual-channel input system, combining speech and emotions embeddings using cross-attention.
1: This work will not entail mere application of quantum theory, but rather inspirations that are subject to further calibration and refinement to adhere to our goals, resources, and most importantly steer away from fantasy yielding legitimate and factual results.
2: I've been called a clout-chaser and delusional before for claiming AGI is highly within reach, and I mean it. And that its delay is explicitly due to other constraints than just its absurd "conceptual and technical execution". I do not promise anything, but I do hope for something that has the flair of "AGI" to emerge upon this work.
A portion of the funds will be primarily leveraged to fund a full-time team and acquire a decent office to ensure consistent operation.
Get the necessary computational resources to empower our experiments and run trials at scale.
Collaborate with leading labs to bring in their expertise to the table, making sure we stay on the right track.
Encourage the community to stay engaged with our speech model. Crucial step to secure a large and multifaceted dataset.
To be announced! Currently in talks with several people. We are already 5 people researching and running initial trials on our available modest hardware (This is primarily focused on bridging a couple of different architectures together and running some ablation studies).
I'm trying to get the best to join, so it might take a little bit of time.
If you're interested in joining the team, you can DM me on X.
If this project doesn’t pan out, there are a few specific challenges we might face:
One likely cause could be the difficulty of practically applying quantum concepts like superposition and entanglement within our AI framework. While the theory is promising, effectively representing and manipulating dense multidimensional vectors could prove more complex than we anticipated. We may also struggle with extreme computational overhead, particularly in managing the high-dimensional data during training, which could lead to inefficiencies in our model.
Another potential issue might arise from our interactive training environment. As we engage the community and gather diverse conversational data, we might find that the range of inputs isn’t as varied as we’d hoped. This lack of diversity could limit the richness of our dataset, thereby hindering the model’s ability to generate nuanced contextual predictions.
However, even if we face setbacks, we’ll still come away with a wealth of insights and documentation. As we navigate these challenges, we’ll engage in critical discussions about our findings, leading to innovative solutions and refinements in our approach. We’ll document our experiments with techniques like state vector reduction and quantum state tomography, which will be valuable for future research endeavors.
So, while the prospect of failure is undeniable, the knowledge we gain from this process will undoubtedly set us ahead. We’ll emerge with a deeper understanding of the complexities involved and a clearer roadmap for tackling similar projects in the future.
Bensaid
about 1 month ago
I'm a student from Waterloo pursing a PhD at physics and that makes want to learn about AI and draw connections between the two fields. Obviously, there isn't many ppl trying this, so you may have a chance to lead the torch. All the best!
Hernandez
about 1 month ago
It always good to be creative and try new stuff. But I would say if you are pretty confident and you know what you're doing, you better tun that into a corporation. Because this will require tons of funding and it's impossible to be crowdsourced. Founding a company might be the way to go.
ADAM
about 1 month ago
You're right, but keep in mind that it's equally hard to get VCs to invest in your vision. Especially that this not a SaaS and will obviously require a lot of funding and patience to get some results. But I will shoot my shot.
ADAM
about 2 months ago
Well, I believe that AGI is not the simulation of the human cognitive system but rather the stimulation of it. Generation of custom responses with respect to each context and user's behavior and attitude. Something fed and trained upon factual biases which will allow the machine to develop informed and legitimate opinions. Bias is inevitable and achieving an independent reasoning abilities on the machine level is impossible merely speaking. That's why this is critical and highly sensitive, and why we need to make sure that the ppl behind those biases are as transparent and authentic as possible. @MrWick
Eric Mayhem
about 2 months ago
I still have some ambiguities and one of them is how on earth would you rely on the community to build a diverse dataset? This data will be subject to extreme bias.
ADAM
about 2 months ago
You're right, that's we will clean up the dataset afterwards. But keep in mind that achieving as much bias as possible is intentional here. We want users to genuinely interact with the model in different life case scenarios so we can refine and train model to sophisticatedly output responses tailored to the user's mood, believes and temperament in general. It's similar to the nosing-denoising approach in stable diffusion, you have to understand the noise first to mitigate it and ensure the best outputs possible. @Ryner
Desiree
about 2 months ago
Never thought that quantum physics might have a role in the advancement of AI, but after reading through your post, it makes sense, and it has a great potential. But, how would you apply that like what specific quantum algorithms or frameworks will you use to implement superposition and entanglement?
ADAM
about 1 month ago
There are a couple of promising approaches out there that we looking to leverage such as Swin attention and other parallel data generation techniques, so we're going to build on that. One novel algorithm that explicitly aligns with our vision is tensor networks. These things aim to represent quantum states say entanglement in terms of diagrams and you can run them locally on classical computers. This is still an emerging field yet promising, so we definitely going to look closely at that.@Aya
Jean Miller
about 2 months ago
interesting, if we can achieve an “entangled data”, we can then achieve anything. Rooting for you.
ADAM
about 2 months ago
Entangled data is the premise of the core idea of compressing the data into low dimensional representations in order optimize the compute both qualitatively and quantitatively at the lowest costs possible. And yes, if we can achieve this, we can unlock a ton of possibilities and it all roots down to the data and its gestions, and little it has to do with architectures and training techniques.
ADAM
about 2 months ago
Some people were confused and were asking me if I'm looking to leverage the power of quantum computers warning me about how expensive they are to operate. I have to zero intention to do that. These quantum computers are very unstable and require extreme conditions to run. We believe that current compute is enough to test and validate our theories. the big setback is not resources but rather the vison, most people in the industry are pretty much trying the same thing in the same way, so we looking to break through this paradigm and try new things.@Eren