Assistive software & 3D technology
VisuAct
VisuAct is an Android app for people with ALS or severe motor limitations who find communicating through speech, writing or conventional hand input difficult. Its gesture-recognition-based human–computer interaction (HCI) uses individually suitable gaze, facial, head or touch input. Users select phrases or write personal text and have it read aloud, allowing them to express needs and communicate with people around them.
Demonstration, delivery and customisation on request
Demonstration, delivery and personal setup on request. We agree suitable inputs, supported devices and the required features together. Distribution through Google Play is also planned.
Product at a glance
- Platform & requirements
- Android 7.0 (API 24) or later, with a suitable camera. Individual input requires setup and evaluation; offline speech needs an appropriate installed voice.
- Version & development stage
- 1.0 · Delivery and supported device configuration by agreement.
- Access & licensing
- We agree delivery, personal setup and adaptations directly with you. The offer specifies the features, usage rights and any support. Additional distribution through Google Play is planned.
Technologies used
Where you can use it
Express everyday needs
At home or in a care setting, communicate what is needed: make a request, answer a question or express a decision. Prepared phrases shorten the route to a message; the keyboard allows personal wording.
Talk with family members and caregivers
When speech or conventional hand input is insufficient, a phrase selected in the app can be made audible through speech output. Personal text enables conversations about what the person actually wants to say.
Use remaining movements intentionally
Gaze, head or facial movements, or controlled finger movement, can provide different access routes. Personal setup establishes which route suits the individual and situation, and can be revisited as abilities change.
What using it looks like
- Position a suitable Android device and set up a personal profile.
- Calibrate available inputs, choose an interaction strategy and try selection in a setup context.
- Select content on the board or keyboard and speak it; pause or adjust settings when needed.
Features in detail
Choose phrases and speak personal text
The communication board organises prepared phrases into categories. The on-screen keyboard supports personal text and local word suggestions. Selected phrases and text can be read through Android speech output; a drawing area provides another means of expression. A suitable offline voice must be installed on the device.
Camera and gesture recognition as input
Computer vision and AI-based MediaPipe models detect facial and eye features through the front camera. The app derives suitable gaze directions and movement gestures for navigation and selection. Head and touchpad input provide additional options. Personal setup connects the physical input, action and communication content.
Configure interaction for the individual
Calibration and local profiles retain suitable inputs and settings. Users move a focus between fields or operate a pointer; selection is a separate step. Core communication and normal input processing work locally without requiring an internet connection.
Setup and supported trials
The device, camera position and input method are assessed for the person. Pause, start/stop and setup access support caregivers. The current functionality operates VisuAct’s own communication interfaces; system-wide PC control and treatment of a condition are outside this offering.
VisuAct
Questions about this product?
Contact us about features, devices, integration or use. Select the product and briefly describe your question.
For technical questions, include the product version, device or browser and a brief description of the issue. Please do not send passwords, payment details or health data.