@mauve Keep talking like that and you may get me to switch to linux as a desktop OS someday.
@TheQuinbox You'll be the first to know if I can figure out an audio-only setup that doesn't suck too much 💪
@mauve @TheQuinbox I have some ideas for that
@technobaboo @TheQuinbox Do tell!
@mauve @TheQuinbox these are all rough ideas I need to test but...
for pointer input you'd have the app layout intact and hover your mouse near text and as you get closer you hear spatial audio, and when you stay hovered it speaks it aloud using the same distance and time based heuristic I call exposure (the closer to the center your pointer is the less time you need to trigger it), then you can click or similar! edges and boundaries would have sonic cues that let you sorta feel the layout using sound so as you get closer to an edge the brightness of the sound increases, and after you go over the edge it decreases
@technobaboo hmm, how would you engage with the text content in this system? I find that to be way more critical than whatever spatial layout a developer wanted for their app.
@technobaboo This presumes hand tracking I assume? I feel like one could do an experiment with webcam gaze tracking and 2D windows to validate before investing into 6dof and 3D layouts.