cj

The individual expresses amazement at their ability to accomplish a lot of work, noting that the primary limitation is their brain rather than the technology at their disposal. Despite the aid of AI, which allows them to perform their usual tasks, they feel mentally constrained. They often desire to write but find it challenging to do so with their left hand, considering it as a potential method to make progress.

The user discusses their experience with Handy, a custom-built external keyboard and program, which helps them use the computer despite a broken finger on their right hand. While Handy has been useful, particularly with typing and voice commands in VS Code, the user faces challenges from not being able to write with their right hand and experiencing bodily discomfort from overuse of their left hand. These physical issues are not addressed by the program.

Future improvements for the system include adding a foot pedal as a USB input device to reduce reliance on the right hand, which is currently unergonomic. The user finds it challenging to perform logical thinking and code-related tasks without using the right hand, possibly due to underutilization of a part of the brain. Other possibilities involve making the system more agential, such as allowing commands to be sent, observed, and modified in real-time. Visual interactions, like popping up and closing windows based on gaze detection, are also intriguing, especially if using Moondream for gaze tracking. The user is eager to test these enhancements with both hands.

The author, dealing with a right-hand injury, is exploring alternative input methods for computer use, particularly for programming. They are considering a custom-built device with mechanical keyboard switches and 3D printed keycaps, possibly featuring 1-3 buttons. One button could be used for audio recording, which could then be processed by speech-to-text software. The author is also contemplating the use of Whisper, a speech recognition model, for real-time command input and text entry, potentially implemented using Python and MLX for local, real-time processing. The challenge lies in distinguishing between commands and regular text input, which could be addressed with keyword detection and additional natural language processing. The goal is to create an input system that is more accessible for single-handed use and could benefit others with similar needs. The text reflects on the evolving use of hands in computer interactions, noting how one hand's task has become simpler (like minimal typing) while the other hand's role in manipulating the computer has become more significant, suggesting this could be an interesting topic for a video. The speaker then transitions to discussing the need to track projects, specifically mentioning the zine project.

Injured and limited to using his non-dominant hand, the author contemplates developing a single-hand input device for programming and other computer tasks. The idea involves a 3D-printed keycap with mechanical keyboard switches, featuring one to three buttons for functions like starting and stopping audio recording, and potentially using speech-to-text for input and commands. He considers the challenges of real-time speech recognition, keyword detection, and integrating the system with a local large language model for effective function calling and text input. The author reflects on the potential utility of this device for others with similar limitations and the feasibility of implementing it using Python and machine learning libraries. The speaker contemplates the idea of using both hands differently on a computer, where one hand performs simplified tasks, and the other is used for more complex manipulations. This concept is seen as an interesting topic for a video. They also mention the need to track their projects, specifically the zine project, which they plan to discuss further.

"Reflections on Making Audio Burrito Posts"

The speaker is reflecting on their experience with making audio burrito posts, noting that it often requires multiple attempts to get into the correct mindset—similar to drafting written posts. They're grappling with the challenge of monologuing without a clear understanding of the audience, as they are aware that at least John and CJ will hear it, but uncertainty about the wider audience affects their ability to communicate effectively. This creates a 'contextual membrane shakiness' as the speaker finds the lack of audience boundaries difficult to navigate, which they recognize may vary among different people. The speaker concludes by deciding to end the current note and start a new one.

Unleashing Artistic Innovation