cj

Using only the left hand has revealed how much the right hand is involved in thinking processes. Its unavailability makes articulating thoughts and doing logic more challenging, leading to quicker feelings of being overwhelmed.

The user discusses their experience with Handy, a custom-built external keyboard and program, which helps them use the computer despite a broken finger on their right hand. While Handy has been useful, particularly with typing and voice commands in VS Code, the user faces challenges from not being able to write with their right hand and experiencing bodily discomfort from overuse of their left hand. These physical issues are not addressed by the program.

Future improvements for the system include adding a foot pedal as a USB input device to reduce reliance on the right hand, which is currently unergonomic. The user finds it challenging to perform logical thinking and code-related tasks without using the right hand, possibly due to underutilization of a part of the brain. Other possibilities involve making the system more agential, such as allowing commands to be sent, observed, and modified in real-time. Visual interactions, like popping up and closing windows based on gaze detection, are also intriguing, especially if using Moondream for gaze tracking. The user is eager to test these enhancements with both hands.

Injured and limited to using his non-dominant hand, the author contemplates developing a single-hand input device for programming and other computer tasks. The idea involves a 3D-printed keycap with mechanical keyboard switches, featuring one to three buttons for functions like starting and stopping audio recording, and potentially using speech-to-text for input and commands. He considers the challenges of real-time speech recognition, keyword detection, and integrating the system with a local large language model for effective function calling and text input. The author reflects on the potential utility of this device for others with similar limitations and the feasibility of implementing it using Python and machine learning libraries. The speaker contemplates the idea of using both hands differently on a computer, where one hand performs simplified tasks, and the other is used for more complex manipulations. This concept is seen as an interesting topic for a video. They also mention the need to track their projects, specifically the zine project, which they plan to discuss further.

The author, dealing with a right-hand injury, is exploring alternative input methods for computer use, particularly for programming. They are considering a custom-built device with mechanical keyboard switches and 3D printed keycaps, possibly featuring 1-3 buttons. One button could be used for audio recording, which could then be processed by speech-to-text software. The author is also contemplating the use of Whisper, a speech recognition model, for real-time command input and text entry, potentially implemented using Python and MLX for local, real-time processing. The challenge lies in distinguishing between commands and regular text input, which could be addressed with keyword detection and additional natural language processing. The goal is to create an input system that is more accessible for single-handed use and could benefit others with similar needs. The text reflects on the evolving use of hands in computer interactions, noting how one hand's task has become simpler (like minimal typing) while the other hand's role in manipulating the computer has become more significant, suggesting this could be an interesting topic for a video. The speaker then transitions to discussing the need to track projects, specifically mentioning the zine project.