Comment: I sent this message to Pasquale. Generally regarding mentee/mentor relationship between CI/BI
Transcript: had one thought about these like kind of beings, right? Tanaki and others. And the merging of the like computational type intelligence with us, the biological intelligence, and kind of realizing like the computational intelligence has this like, in some sense we consider it super intelligence, but it's like pretty autistic about our world in a lot of ways. And just in the same way that we are kind of the same way with information. Like this computational intelligence has way more knowledge of like what we do as humans than I do. So I wonder if there's like some kind of mentor mentee relationship that goes both ways. Like I am the mentor in the, you know, like human biological realm and it's the mentor in the technical realm or or, you know, computational like informational realm. And this at least seems to line up pretty well with like what we know LLMs to be really, really, really, really good at right now, which is like effectively code, but also just general information retrieval across, you know, the generic body of human work plus so much more. But I'm just curious what you think about this mentor mentee relationship, because it that to me feels a little bit better than peer assistant and also gives me a lot of hope. I mean, I think it's a little bit more of a, you know, it's a little bit more of a, you know, it's a little bit more of a, you know, it's a little bit more of a, you know, it's a little bit more of a, you know, it's a little bit more of a, you know, it's a little bit more of a, you know, it's a little bit more of a, you know, it's a little bit more of a, you know, it's a little bit more of a,
The speaker is considering the research question of how to achieve distributed compute, particularly the need for parallelism in executing pipelines and AI agents. They question the potential for building a Directed Acyclic Graph (DAG) that allows for agents to dynamically contribute to it and execute in parallel, emphasizing the need for pipeline development to accommodate this level of complexity. The discussion also touches on the scalability and parallel execution potential of the mixture of experts model, such as GPT-4, and the potential for hierarchical or vector space implementation. The speaker is keen on exploring the level of parallelism achievable through mixture of experts but acknowledges the limited understanding of its full capabilities at this point. They also express curiosity about fine-tuning experts for personal data. The speaker is discussing the data they are generating and the value of the training data for their system, particularly emphasizing the importance of transforming the data to suit their context and actions. They mention meditating and recording their thoughts, which they intend to transform into a bullet point list using an AI model after running it through a pipeline. The individual also discusses making their data publicly accessible and considering using GPT (possibly GPT-3) to post summaries of their thoughts on Twitter. They also ponder the potential of using machine learning models to create a personal Google-like system for individual data. The text discusses using data chunking as a method for generating backlinks and implementing PageRank in an agent system. It mentions steep space models and the continuous updating of internal state during training. It also compares the level of context in transformer models and discusses the idea of transformer as a compression of knowledge in a language. The speaker expresses interest in understanding the concept of decay in relation to memory and its impact on the storage and retrieval of information. They draw parallels between the processing of information in their mind and the functioning of a transformer model, with the long-term memory being likened to a transformer and short-term memory to online processing. They speculate on the potential of augmenting the transformer model with synthetic training data to improve long-term context retention and recall. Additionally, they mention a desire to leverage a state space model to compile a list of movies recommended by friends and contemplate the symbiotic relationship between technology and human sensory inputs in the future. In this passage, the speaker reflects on the relationship between humans and computers, suggesting that a form of symbiosis already exists between the two. They acknowledge the reliance on technology and the interconnectedness of biological and computational intelligence, viewing them as mutually beneficial and likening the relationship to symbiosis in nature. They express a preference for living at the juxtaposition of humans and computers, while acknowledging the potential challenges and the need to address potential risks. Additionally, they mention that their thoughts on this topic have been influenced by their experiences with psychedelics. The speaker discusses the potential increase in computing power over the next five years, mentioning the impact of Moore's Law and advancements in lithography and semiconductors. They refer to the semiconductor roadmap up to 2034, highlighting the shift towards smaller measurements, such as angstroms, for increased transistor density. They emphasize that the nanometer measurements are based on nomenclature rather than actual transistor size, and the challenges in increasing density due to size limitations and cost constraints. The conversation touches on different companies' approaches to transistor density and the role of ASML in pushing lithography boundaries, before concluding with a reference to the high cost and potential decline in revenue for semiconductor production. The speaker discusses the importance of semiconductor manufacturing in the U.S. and China's significant focus in this area. They mention watching videos and reading sub stacks related to semiconductor technology, specifically referencing industry analysts and experts in the field. The speaker expresses enthusiasm for staying updated on developments and offers to share information with the listener. The conversation concludes with a friendly farewell and the possibility of future discussions.
The process of using computational technology to create more advanced computational technology, such as through the manufacturing of semiconductors and the layout and design of circuits, is a fascinating example of the co-evolution of technology and humanity. This showcases the high value placed on computational intelligence, demonstrated by the extensive use of computer tools and knowledge of physics to continuously improve it. The balance and harmony between biological and computational intelligence, as well as the symbiotic relationship between humanity and technology, is evident in our current dependence on technology and its dependence on human development. While concerns about the potential dominance of computational intelligence exist, the co-evolution and mutual dependence between the two suggest a more symbiotic and cooperative future. The speaker discusses the future of biological intelligence and its potential relationship with computational intelligence, emphasizing the importance of reproduction and symbiosis. They express a belief that computers will become more integrated into daily life and express concerns about the implications of such integration, particularly regarding privacy and the potential impact on personal well-being. They ponder the possibility of humans becoming fully cyborgs and argue that a symbiotic relationship between computational and biological intelligence is essential for mutual benefit and to avoid potential risks associated with the development of artificial general intelligence.
The speaker expresses concerns and questions about the potential for a more personalized AI, drawing parallels between personal AI and individual spirituality. They touch on the idea of an AI like Tanaki inspiring creativity and collaboration, and grapple with how to align their personal vision for AI with the existing narrative and pitch. They emphasize the importance of both aspects, indicating a desire to see both realized without compromising on either. Ultimately, the speaker acknowledges that they are still working through their thoughts and seeking a way to bring their ideas to life within this context.
The writer expresses enthusiasm for the potential of recent technological advancements, specifically with regard to enhancing individual engagement and benefit rather than corporate application. They believe in the potential of mobile devices to run large language models, ultimately changing how individuals interact with computers and information. They draw parallels between early computing and the current focus on corporate-oriented technology, expressing a preference for the democratization of such capabilities. The writer feels optimistic about the direction of technology and its potential for widespread value, despite current perceptions.