オリジナル文書: http://www.amtelcom.com/Mosaic/userguide.html

Gesture Mosaic User Guide


Gesture Mosaic User Guide

Copyright c Mosaic Input Technologies, Inc., April 1995
Printed in U.S.A. All rights reserved.
Based on software version 2.01f. Substantially correct for other versions.

Introducing Gesture Mosaic

Gesture Mosaic is a fast, accurate way to enter letters and numbers on a Personal Digital Assistant such as the Apple Newton. Characters are written by making a short gesture on the Mosaic, a template based on the figure eight.

A gesture is a stroke drawn with the pen in a curved or straight line. Gestures are made either by connecting two adjacent segments (starting in one segment and ending in another), or by drawing a line within a single segment (starting in one segment and ending in that same segment). The gesture for each character is derived from the shape of that character as it is familiarly known. Specifically it is derived from a block form of the capital letter. Thus when making a gesture, the user is essentially drawing a small portion (an outstanding feature) of the character as it would appear in the mosaic. This makes Gesture Mosaic a easy system to learn and remember.

Another important aspect of the Gesture Mosaic is that it contains recognition routines which can often interpret imperfect gestures. Because the gestures are so short, and the recognition algorithms allow for significant variance, text can be entered into a PDA at a considerable rate. A speed of 30-40 words per minute is not uncommon. Many people who see Gesture Mosaic for the first time, conceptualize it as a shorthand method. Another way to think of it is as a hybrid keyboard/recognition system ("the keyboard of the future") specifically designed for pen input.

Installing Gesture Mosaic

Congratulations! You are just minutes away from entering the new and exciting world of Gesture Mosaic. Once the next few steps are completed, you will be ready to begin.

Installation Requirements

The program requires a Newton Connection Kit for a Macintosh computer, or an IBM compatible computer running Microsoft Windows. The memory for Gesture Mosaic and Rapid Fire are as follows:

Gesture Mosaic

GM.pkg, 64 KByte

Rapid Fire

RapidFire.pkg, 75 KByte

Keep these memory requirements in mind when selecting the files to install.

Installing Step-by-Step

These instructions cover installation from a Macintosh and a Windows based system.

  1. Locate the cables in your Newton Connection Kit. Connect them to both your computer and your Newton.
  2. Turn on your computer and open the Newton Connection software on the computer.
  3. Insert the Gesture Mosaic disk into the computer. (ignore this step if you have downloaded the software)
  4. Choose Install Package from the menu or click on the Install icon. Select the appropriate file(s) from the drive that contains the Gesture Mosaic software.
  5. On the Newton, tap on the Extras Drawer icon, then press on the Connection icon. Then choose the appropriate connection.
  6. The computer screen will show the progress of the program loading. When the program is loaded you are ready to begin.

Overview of Gesture Mosaic

Starting The Gesture Mosaic

The Gesture Mosaic is started the same as most other programs on the Newton. Turn your Newton on and tap on the extras icon at the bottom of the screen. A display of icons will appear listing all the accessible software. The Gesture Mosaic icon; is a small mosaic (digital '8') labeled GM. Start it by tapping its icon with the pen.

Parts of the Gesture Mosaic

Mosaic Template
The digital 8-shaped area where letters and numbers are entered.
Number Lock Button
Button To toggle between letter and number input.
Cursor Movement box
Creates a Space, Delete (or backspace), and Carriage Return. Also acts as Shift and Caps Lock for capital letters. These are produced by drawing various lines starting in the box.
Instant PunctuationBox
Produces the period, comma, apostrophe, hyphen and end of sentence period.
Punctuation Keypad Button
Opens up soft keyboard for symbol input.

Screen Management

Notice that the Gesture Mosaic screen takes up less than 1.5 square inches, leaving plenty of room to view your writing. The screen is designed to float above all other screens so it should always be accessible. The screen can be moved (dragged) by:

  • Pressing the pen on the Drag Bar
  • Then moving the pen, dragging the screen to its desired position.

    You can also shrink (or minimize) the Gesture Mosaic. The Shrink button is located in the upper left hand corner of the Gesture Mosaic screen. When you tap on this, the Gesture Mosaic shrinks down to a small box with an M in the middle.

    The minimized Mosaic can be moved by pressing the pen on the gray border, moving the pen to the preferred location, and releasing the pen. To return to regular size, you just tap the pen on the M in the middle of the minimized Mosaic.

    Learning Gesture Mosaic

    The Mosaic is a intuitive entry device, based on simple graphical fundamentals. Many people will learn the Gesture Mosaic just by glancing at the illustrations in this chapter and then going right to the quick reference card or simply by playing the tutorial game, Rapid Fire.

    Once you are familiar with the Gesture Mosaic (able to remember the gestures for all the letters), move ahead to the chapter entitled Efficient Entry. To begin using the Gesture Mosaic, work through the alphabet a few times. You will begin to learn the proper gestures. Then, over time, you will be able to immediately associate a letter with its corresponding gesture. Another great way to learn the Gesture Mosaic basics is to play the tutorial game, Rapid Fire.

    Writing Letters

    Letters are created on the Mosaic template, the large figure that resembles an 8. To write a letter, you make what is called a Gesture, which is a short line drawn on the Mosaic template. The gesture will be drawn to connect two segments, or drawn within a single segment.

    Tap on the screen to position the cursor. Then try out the following gestures.

    Note how the gestures are drawn: some with a curve, some as a straight line. For maximum accuracy, draw a curved gesture when the help diagram shows a curve, and a straight line when the help diagram shows a straight line.

    The gesture is derived from the letter it creates. This makes it easier to remember the gesture for each letter. The following shows how the gestures correspond to three letters: N, B, and E. Notice how the gestures are a small segment of the letter they correspond to.

    In the next illustration, the gesture is superimposed on the mosaic template. It is important to notice which segment the gesture begins in. It is also important which segment the gesture ends in. The following illustration shows the gestures being drawn in with the arrow showing the end point of the line. Notice the B is drawn with a curved line, and the E (or any other horizontal gesture) is drawn within a single segment.

    Notice the thin lines that connect the various segments on the mosaic. These are called Gesture Guides and indicate the path of every Gesture. You can draw a gesture simply by tracing the gesture guide in the proper direction. The previous illustrations show the gestures drawn perfectly. However, gestures can be drawn less than perfectly and still register the correct letter. At some point accuracy will be affected, so try to stay close to the perfect gesture.

    View the quick reference card

    Shortcut for Creating a Space

    You can insert a space without leaving the mosaic. Draw an upward line connecting the center vertical segments. Start in the lower vertical segment and end in the upper vertical segment.

    Writing Numbers

    Number are entered in the same manner that letters are entered. The only difference is that the Number Lock button must be pressed first for numeric entry. The Number Lock button is highlighted when on.

    You should practice going through the numbers 0-9 until you are familiar with the corresponding Gestures.

    If necessary, tap on the screen to position the cursor. Tap on the Number Lock button. Then try out the following gestures.

    View the quick reference card

    The shortcut for creating a space also works when the Number Lock is on:

    Instant Punctuation Box

    The purpose of the Instant Punctuation box is to provide a fast way to create common punctuation marks. Numerous punctuation marks are accessed by drawing a line or tapping on the box. Start the line in the middle of the box and draw it in the appropriate direction. Continue the line until it extends beyond the border of the box.

    End of Sentence Period - Produces a period, two spaces, and a shift to capitalize the next letter. The second letter is automatically back to lower case.

    Punctuation Keypad

    Other punctuation marks and useful symbols are entered by an on screen keypad. The keypad appears when the Punctuation Keypad button (pictured below) is tapped.

    A symbol is entered by tapping in the square the symbol appears in. Cancel without entering a symbol by tapping the empty box in the lower right. The keypad is closed automatically after a symbol is chosen. The Punctuation Keypad is organized to put related symbols together. The following diagram shows how symbols are grouped, making them easier to find.

    Cursor Movement Box

    Space, Delete, Return, Shift, Caps Lock

    The movements of the cursor are controlled from this button. These functions are accomplished by drawing a line on the button. Start in the middle of the box. Draw in the appropriate direction and end outside the box.

    You can also place the cursor anywhere in existing text by tapping the position where you want it to appear.

    Shift

    The shift function capitalizes only one letter. After you draw the upward line, the Cursor Movement box will be highlighted.

    The next letter will be capitalized and the Cursor Movement box will return to normal appearance. The next letter you create will appear in the lower case.

    Caps Lock: Constant Capitals

    The Caps Lock draws capital letters continually. It is like the Caps Lock key on a computer keyboard. Set the Caps Lock by drawing two consecutive lines upward from the center of the Cursor Movement box. The Cursor Movement box is highlighted. A white circle in the upper left corner of the Cursor Movement box indicates the Caps Lock is set.

    To disengage the Caps Lock, draw another line upward from the center of the Cursor Movement box.

    Entry will return to lower case.

    Information Button

    The Information button displays help for writing letters and numbers. It also closes Gesture Mosaic and displays information about Gesture Mosaic's developer, MIT (Mosaic Input Technologies).

    Tap the information button. The Information menu is displayed.

    Help Writing Letters

    For help writing letters, go to the Information menu and select ABC's Help.

    The Help Alphabet is displayed.

    The Help Alphabet shows you how to draw the gesture for each letter. Tap a letter and observe the gesture that is displayed on the mosaic. Trace the gesture as indicated by the arrow on the mosaic. When the Help Alphabet is displayed, it blocks access to the standard Space and Delete functions. Instead for:

    To cancel the Help Alphabet, tap the dash in the lower right corner.

    Help Writing Numbers

    For help writing numbers, at the Information menu, tap123's Help.

    The Help Integers are displayed.

    The Help Integers show you how to draw the gesture for each number. Tap a number and observe the gesture that is displayed on the mosaic. Trace the gesture as indicated by the arrow on the mosaic. When the Help Integers are displayed, it blocks access to the standard Space and Delete functions. Instead for:

    To cancel the Help Integers, tap one of the dashes in the lower right corner.

    Quitting Gesture Mosaic

    Often you can leave Gesture Mosaic minimized when you are not using it. But you can also close the program.

    Tap the information button.

    The Information menu is displayed.

    To close Gesture Mosaic, tap Close GM. Gesture Mosaic is cleared from the screen.

    Efficient Entry

    This section includes hints and tips for learning and using Gesture Mosaic quickly and efficiently.

  • Be sure to begin each writing session by positioning the cursor;. Do this by tapping in the spot on screen where you want the cursor to appear.

  • Start out by going through the complete alphabet. Follow the diagrams in the User Guide, Quick Reference, or Help menu. Draw only the gesture portion of the letter. Do not exaggerate the gesture. For best results, draw curves as curves and straight lines as straight lines.

    At first, picture and say the letters individually in your mind as you draw gestures. This will help you think of the shape of the letter and relate it to the corresponding gesture. Soon you will no longer need to think of the shape of the letter. The letter will call up the gesture automatically in your mind. When you become proficient, move on to words and sentences. Soon you will begin to think at the word level in groups of gestures, rather than letter by letter.

  • While we recommend that you aim for precision when making gestures, Gesture Mosaic actually offers a lot of leeway in gesture recognition. It will often interpret imperfect gestures correctly. This can be a help when you are writing quickly and the gestures get a little sloppy. As you gain experience, you will learn the shortest and fastest gestures that are recognizable. This capability has allowed power users to reach entry rates of 40 words per minute.

    For example, an A is written by drawing an upward line connecting the two leftmost vertical segments of the mosaic. But the following illustration shows variations that will also produce an A:

  • Shortcut for Creating a Space - You can insert a space without leaving the mosaic. Draw an upward line connecting the center vertical segments. Start in the lower segment and end in the upper segment.

  • Letters and Numbers have Distinct Sounds - Gesture Mosaic makes a different sound when it generates a letter than when it generates a number. Noticing this can alert you to when you are not in the mode you want to be. This can happen when you inadvertently leave the Number Lock button on, for example.

    Generating a letter is accompanied by a higher-pitched clicking sound. Generating a number is accompanied by a lower-pitched sound similar to typing on an electric typewriter.

  • Align the pen with the screen - Aligning the pen calibrates the tip of the pen with the spot it creates on screen. Do this when you first start using your Newton, or any time the pen seems out of alignment with the screen. From the Newton Extras Drawer, select Preferences. Then select Pen Alignment.

    Rapid Fire

    The Gesture Mosaic Game

    Somebody is trying to put words into your head! The only way you can stop them is by typing in the word before it penetrates your defenses using the Gesture Mosaic. In this exciting, arcade-style game, words of varying lengths fall from above and attempt to bomb their way past your shield. As the game progresses, the words fall faster. Additional words appear as soon as one hits your shield. When three words have penetrated your shield, the game is over.

    Rapid Fire is started the same as most other programs on the Newton. Turn your Newton on. Locate the Extras Drawer icon. When you press on the Extras Drawer icon, you will get a display of icons listing all the accessible software. The Rapid Fire icon is a small mosaic labeled Rapid Fire. Start it by tapping its icon with the pen.

    Rapid Fire is displayed.

    The text field can be edited by pressing the delete button or by pressing the Clear button. When you correctly enter a word, the text field is automatically cleared. This allows you to continue and enter the next word without interruption. If a word that you are working on scores a hit (makes it through your entire shield, the text field has to be reset manually. Do this by tapping the Clear button before entering the next word. Scoring is based on the length of the word, how quickly the word is entered, and the current level. There is also a bonus given at the end of the game based on how much of the shield remains.

    Diagnostics

    This section describes some situations that could occur and some suggestions for dealing with them.

    Cursor is visible but gestures do not produce characters

    This typically means that the Newton has run out of memory (RAM). It may be accompanied by the following message: The application does not have enough memory right now...Restarting Newton may fix the problem. If this warning is displayed, click the appropriate button to restart your Newton. Otherwise do a soft restart by pressing the Reset button under the battery cover on the back. Be sure to do a soft restart.

    The Gesture Mosaic no longer appears on the screen

    Typically this means that Gesture Mosaic is covered by another program. Gesture Mosaic is designed to be the topmost program running to maintain access to the mosaic. But other programs may also claim the top position. The solution is to close other programs until Gesture Mosaic reappears.

    Error occurs when you tap on the keyboard icon

    If you need to open the Newton's built in keyboard, first minimize or close Gesture Mosaic.



    To find out more about Mosaic Input Technologies, contact brian@amtelcom.com, or call 608/838-4194.
    Copyright © 1995 American-Tele-Systems Inc.