Key Speak

Key Speak and Assistive Technology

A keyboard recognition application for Assistive Technology

President Obama recently shared part of the Avila's story in a White House "Salute to the Troops" introduction.

The Solution

Key Speak Utility

Using our PS/2 Host Emulator to capture scan codes from a PS/2 keyboard, we wrote an application to use Windows Text to Speech feature independent from the accessibility settings. We dubbed the application Key Speak (free download here).

The first press of any key triggers the name of the key. A second press of the same key sends the USB key code to the OS with a confirming ping. If, instead of a second press on the same key, the next press is a different key, the name of the new key is spoken.

Modifier Keys

Shift, Alt, and Ctrl also require two presses and are held down (like Sticky Keys) until another key is pressed twice. A different confirming tone is used to indicate the state of the modifier. They work cumulatively such that a “Ctrl+Alt+Shift+X” macro is possible.

Upper Case and Shifted Keys

An alternate vocabulary is referenced for Shift modified keys on the keyboard. With the Shift modifier on, pressing the “A” key results in “Cap A” being spoken, and pressing the “4” key results in “Dollar Sign” being spoken. Thus the user gets a more accurate vocalization of the key being sent.

Caps Lock, Num Lock, and Scroll Lock

Key Speak does not support the Caps Lock, Num Lock, or Scroll Lock states. However, it does recognize the key presses. For our test case, we programmed the commonly used macros Ctrl+C, Ctrl+V, and Alt+F4 on these keys respectively.

Easy Customization

Key Speak works right out of the box, but it also uses a simple text file for configuration which is human readable and easily edited in Wordpad or any text editor. Macros may be created for any key on the keyboard. The vocabulary for the Text to Speech feature may also be edited. Thus our macro keys may be identified as “Copy” and “Paste” or as “Control C” and “Control V” at the user’s preference.


How it Works

The Host Emulator essentially turns the PS/2 keyboard into an X-keys device. PS/2 scan codes sent from the keyboard are captured before they get to the operating system and converted to our X-keys USB HID messages.

Key Speak receives our HID message and triggers Windows Text to Speech on the first press of any key. Two sequential presses of any key will send a USB keyboard message to the operating system.

Limitations and More Solutions

The method used for sending USB Keyboard to the operating system does not support boot level keyboard messages. Thus the “Ctrl+Alt+Delete” combination will go to the OS, but not at the level required to trigger a Windows reset. The same is true for the Windows key. We solved this for the client by adding an X-keys Stick programmed at the hardware level to send “Ctrl+Alt+Delete”. One of our X-keys USB Switch Interface devices could also have been employed.