Access Methods
Echo allows for multiple access methods.
Swipe Gestures
You can swipe up, down, left or right. You must do the swipe across the main part of the screen for it to register.
Swipes trigger the following actions:
Up - Go back/up in the list
Down - Go forward/down in the list
Right - Select the current item
Left - Remove the previous character
Tap - Select the current item
You can enable and disable the swipes in the settings
On Screen Arrows
You can use the on screen arrows to control Echo. You can drag the arrows about the screen to put them somewhere you find convenient.
Arrows trigger the following actions:
Up - Go back/up in the list
Down - Go forward/down in the list
Right - Select the current item
Left - Remove the previous character
You can enable and disable the arrows in the settings
External Switches
Echo allows you to use external switches to control the app. To add a new switch go to your access settings and then click add a new switch. You can then click 'detect switch' which will then listen for you to press your switch. This registers the switch and then you can assign it an action.
Possible actions are:
None - This can be used if you want to register a switch but not have the switch trigger an action
Go to the next item
Go to the previous item
Select the currently selected item
Delete the last inputted letter
Clear all the inputted text
Start scanning from the current item, scanning must be enabled
Quickly scan through the items - This is only available when holding the switch
Speech Case
If you are using a 'speech case' from TD you need to make sure that the toggle on the side of the case is in 'touch' mode. Once you have done that you can then setup the switches inside of Echo the same way you would any other switch.
Game Controller
Echo also supports the use of Game Controllers to control the app. Read Apples official guide on how to connect your game controller to your device. Once you have connected your controller to your device it will appear in the access methods section of the Echo settings. You can then map each button on the controller to do any action you want inside of Echo.
A game controller has all the same actions as external switches.
Facial Gestures
Echo includes advanced facial gesture recognition that allows users with limited mobility to control the app using facial movements instead of touch input. This accessibility feature uses your device's front-facing camera and Apple's ARKit technology to detect specific facial gestures.
Device Requirements
Facial gesture recognition requires a compatible device with face tracking capability:
iPhone X or later (including Pro models with TrueDepth camera)
iPhone XR, 11, 12 mini, 13 mini, 14, 15 (using Neural Engine-based tracking)
iPad Pro with TrueDepth camera
iPad Air (4th generation and later)
iPad (9th generation and later)
Getting Started
Enable Facial Gestures: Go to Settings → Access Options → Enable "Facial Gestures"
Grant Camera Permission: Echo will request camera access for gesture detection
Configure Gestures: Tap "Facial Gesture Switches" to set up your gestures
Test Your Setup: Use the "Test Gesture" feature to verify detection
Available Gestures
Echo supports a wide range of facial gestures organized by anatomical regions:
Eye Gestures
Left Eye Blink
Right Eye Blink
Either Eye Blink
Left Eye Open (sustained)
Right Eye Open (sustained)
Either Eye Open (sustained)
Eyebrow Gestures
Brow Down Left
Brow Down Right
Brow Inner Up (surprise expression)
Brow Outer Up Left
Brow Outer Up Right
Mouth and Jaw Gestures
Jaw Open
Jaw Forward
Jaw Left/Right
Mouth Close
Mouth Smile Left/Right
Mouth Frown Left/Right
Mouth Pucker
Mouth Funnel
Various other mouth movements
Cheek and Nose Gestures
Cheek Puff
Cheek Squint Left/Right
Nose Sneer Left/Right
Head Movement Gestures
Head Nod Up/Down
Head Shake Left/Right
Head Tilt Left/Right
Gaze Direction
Look Up/Down/Left/Right
Gesture Configuration
Each facial gesture can be configured with:
Threshold: How pronounced the gesture needs to be to trigger (0-100%)
Hold Duration: How long to hold the gesture for "hold" actions
Tap Action: What happens with a quick gesture
Hold Action: What happens when holding the gesture
Auto-Detection Feature
Echo includes an intelligent auto-detection system:
Start Auto-Detection: Choose "Auto-Select Gesture" when adding a new gesture
Follow Instructions: Position your face in the camera view
Perform Gesture: Make your desired gesture when prompted
Automatic Selection: Echo will identify and configure the best-matching gesture
Gesture Actions
Facial gestures can trigger the same actions as other access methods:
Go to the next item
Go to the previous item
Select the currently selected item
Delete the last inputted letter
Clear all the inputted text
Start scanning from the current item
Quick scan through items (hold actions)
Privacy and Security
On-Device Processing: All facial gesture recognition happens locally on your device
No Data Storage: Facial data is processed in real-time and immediately discarded
No Data Sharing: No facial information is transmitted to servers or shared with third parties
User Control: You can disable facial gestures at any time in settings
Tips for Best Results
Good Lighting: Ensure adequate lighting on your face
Stable Position: Keep your device stable and at a comfortable viewing angle
Clear Gestures: Make distinct, deliberate movements
Adjust Thresholds: Fine-tune sensitivity settings for your needs
Practice: Use the test feature to familiarize yourself with gesture detection
Troubleshooting
Gestures Not Detected: Check camera permissions and lighting conditions
False Triggers: Increase gesture thresholds in settings
Inconsistent Detection: Ensure stable device positioning and clear facial view
Performance Issues: Close other apps that might be using the camera
Last updated