Still gotta set aside some time to make a desktop environment that ditches graphics and only surfaces the accessibility tree 🤤

@mauve Keep talking like that and you may get me to switch to linux as a desktop OS someday.

@TheQuinbox You'll be the first to know if I can figure out an audio-only setup that doesn't suck too much 💪

@mauve @TheQuinbox these are all rough ideas I need to test but...

for pointer input you'd have the app layout intact and hover your mouse near text and as you get closer you hear spatial audio, and when you stay hovered it speaks it aloud using the same distance and time based heuristic I call exposure (the closer to the center your pointer is the less time you need to trigger it), then you can click or similar! edges and boundaries would have sonic cues that let you sorta feel the layout using sound so as you get closer to an edge the brightness of the sound increases, and after you go over the edge it decreases

Follow

@technobaboo hmm, how would you engage with the text content in this system? I find that to be way more critical than whatever spatial layout a developer wanted for their app.

· · Web · 1 · 0 · 0

@mauve you use spatial audio for spatial layout then when you've hovereed over text based on distance and time you get it spoken aloud

I figure that having the spatial layout will allow for much faster and easier interaction than using focus based systems with tabbing... but maybe I just struggle with things that don't have an element of space in them (I just know that when my eyes aren't doing well I heavily gravitate towards proprioception)

@technobaboo This presumes hand tracking I assume? I feel like one could do an experiment with webcam gaze tracking and 2D windows to validate before investing into 6dof and 3D layouts.

Sign in to participate in the conversation
Mauvestodon

Escape ship from centralized social media run by Mauve.