P. Astheimer et al.  are presenting interaction
diagrams for interactions in 2D (figure 4.6
Figure 4.6 : Layered model for 2D interactions
Figure 4.7 : Layered model for 3D interactions
Although these tables have been especially designed for interactions in Virtual Environments (VE), they can also serve as an underlying model for interactions in a multimodal system. In this case, the application level has to be changed significantly, but interaction techniques like navigation, object manipulation, gesture recognition, natural speech recognition, or eye tracing will stay the same.