for pointer input you'd have the app layout intact and hover your mouse near text and as you get closer you hear spatial audio, and when you stay hovered it speaks it aloud using the same distance and time based heuristic I call exposure (the closer to the center your pointer is the less time you need to trigger it), then you can click or similar! edges and boundaries would have sonic cues that let you sorta feel the layout using sound so as you get closer to an edge the brightness of the sound increases, and after you go over the edge it decreases
@mauve @TheQuinbox these are all rough ideas I need to test but...
for pointer input you'd have the app layout intact and hover your mouse near text and as you get closer you hear spatial audio, and when you stay hovered it speaks it aloud using the same distance and time based heuristic I call exposure (the closer to the center your pointer is the less time you need to trigger it), then you can click or similar! edges and boundaries would have sonic cues that let you sorta feel the layout using sound so as you get closer to an edge the brightness of the sound increases, and after you go over the edge it decreases