cj

"Quantizing Lava and Uploading Models: A Productive Call with Jordan"

Feb 1, 2024 - 2:08pmSummary: I had an excellent call with Jordan, which I'll discuss in more detail later. Unexpectedly, I succeeded in quantizing lava, and the initial results look promising despite the script being rough. It seems feasible that I might run something akin to GPT-4 style vision captioning locally. I'm excited to upload these quantized models to see the outcomes and I plan to head to Jordan's house to upload more models soon.

Transcript: Man, wow, I had a great call with Jordan and I'll speak on that more later after I get more things done. But I did not expect to be quantizing lava and having it work. And my script is really hacky, but at least the first version of the quantization, as far as I can tell, gave me pretty good results. And it might be possible to run more or less like GPT-4 vision style captioning locally, which would be pretty wild. Like that would be actually crazy. So that is super, super interesting. Wow, just really want a fast internet connection now. But yeah, I'm looking forward to uploading these quantized models and sharing them and seeing what happens. But yeah, I've got to get the first one out first and then I'll go to Jordan's house and upload the rest of the models. Yeah, it'll be interesting.

Similar Entrees

"Conquering Quantization: Scripting Success and Sharing 100 GB of Data"

88.35% similar

I invested the day delving into quantization, writing a script, and successfully running it. Afterwards, I visited Jordan's house to upload a massive 100 gigabytes of files. I'm hopeful that people will find these files useful and that there will be at least a few downloads. My aim is to further test the script on more images and present the outcomes.

"Adapting to Slow Upload Speeds: Navigating Old-School Workarounds"

87.42% similar

I recently discovered that because my upload speed is only two megabytes per second, I had to go over to Jordan's house with two flash drives to upload our quantized model. I find it amusing that I had to resort to such an old-school method. It's not clear how frequently this will happen, but if it becomes a common occurrence, I'll need to find a better solution than using Jordan's internet.

"Exploring API Project: Testing Language Models"

84.68% similar

The speaker is focused on their API project and mentioned the stable diffusion model. They have also worked on running and testing various local language models, including Whisper and Orca 7 billion. They are curious to wire the models as a pipeline step and compare the output with GPT. The speaker is unsure of the success of their API project and the effectiveness of the language models, but they express eagerness to explore and experiment further.

"Advancing the Burrito Project: Integrating Image Pipeline and Fostering User Engagement"

84.67% similar

Today marked a significant advancement in the burrito project, where the image pipeline, established the previous day, became fully functional and integrated into a webpage, complete with an effective querying system. The visual aspect of the project, particularly the image embeddings, was both intriguing and aesthetically pleasing, although its effectiveness is still under review. The project is now at a stage where the creator is keen to move beyond personal experiments to sharing the results with others, with the immediate goal being to encourage a small group of individuals to test the developments. The focus for the week has shifted to actual user engagement through getting people to sign up and provide feedback, driven by the enthusiasm of witnessing the project's imagery features come to life.

"Collapsing Space: Exploring Remote Collaboration and Enhanced Vision Pro Experiences"

84.66% similar

The user provided context discusses a phone call with someone named Pascal, during which they had a FaceTime call in Vision Pro. They discussed screen sharing, catching up, and some work-related matters. The conversation explored the idea of being comfortable in a remote environment and collapsing space in an interesting way, possibly through VR or AR. The user expressed thoughts on priorities related to Vision Pro and live transformations, highlighting the importance of adding reactivity and real-time updates to the Vision Pro scenario. They also discussed local considerations and the potential for running Lava 1.6 locally. The user expressed curiosity and a desire to continue pushing forward with these ideas.

Friends Similar Entrees

"Reflections on Making Audio Burrito Posts"

gorum.burrito

80.08% similar

The speaker is reflecting on their experience with making audio burrito posts, noting that it often requires multiple attempts to get into the correct mindset—similar to drafting written posts. They're grappling with the challenge of monologuing without a clear understanding of the audience, as they are aware that at least John and CJ will hear it, but uncertainty about the wider audience affects their ability to communicate effectively. This creates a 'contextual membrane shakiness' as the speaker finds the lack of audience boundaries difficult to navigate, which they recognize may vary among different people. The speaker concludes by deciding to end the current note and start a new one.

"Unlocking Connection: Pascal's Journey with Tanaki"

psql.burrito

79.92% similar

Pascal, from Brooklyn, is excited to engage with a new social network and a burrito he just tried. He's currently experiencing winter weather and has consumed a weed gummy before diving into work on the Tanaki app with multiplayer live video features. He plans to get a massage to unwind physically and mentally. Pascal hopes for a feature that enables connection with his audience to avoid feeling isolated and looks forward to interacting with others on the platform.

"Personalizing Your 'Burrito': A Writer's Reflection"

gorum.burrito

79.90% similar

The author contemplates the process of converting an audio note into a transcript, then summarizing it on their "burrito" page. They express a desire to adjust the summarization voice to better represent themselves on the page. Recognizing that this feature may not have widespread appeal, the author nonetheless sees value in providing users with controls to personalize their "burrito." The concept of allowing users to fine-tune their experience is seen as an intriguing possibility.

"Venting Frustration: The Frustrating Fundraising Video Call"

psql.burrito

78.54% similar

The speaker conveys their frustration with a difficult fundraising experience, describing a particularly unsatisfactory video call with a fund representative. The caller was in a bad mood, hadn't reviewed the provided materials, and hesitated to engage with the product's features. This led to a tense exchange where the speaker challenged the representative's commitment to valuing founders versus purely focusing on financial metrics. Feeling disillusioned, the speaker is left with a distaste for these disengaged "NPCs" and remains focused on their vision of fostering creative and engaging spaces.

"Bite by Bite: Exploring London's Food Scene"

kevin.burrito

77.49% similar

Welcome to my burrito place! I'm testing out CJ's new gadget and hoping it captures my thoughts accurately despite my struggle with stream-of-consciousness voice notes. My goal is to document my food discoveries in London and eventually identify and share my favorite spots. Enjoy your visit and the food recommendations that will follow!