Skip to main content
Fig. 5 | Scientific Phone Apps and Mobile Devices

Fig. 5

From: “Twhirleds”: Spun and whirled affordances controlling multimodal mobile-ambient environments with reality distortion and synchronized lighting to preserve intuitive alignment

Fig. 5

Architecture: Our CVE provides a shared infrastructure, allowing heterogeneous, multimodal, cloudy clients to display data from multiple twirling affordances. The client-server architecture uses a “star” or “hub-and-spokes” topology to logically arrange multimodal control and display clients around a central CVE session server, sometimes with mediating “glue” middleware. Shared channels are subscribed to, and runtime client-generated events are multicast to peers at the edge of the network. For instance, a mobile client (bottom left) joins a session at launch-time, and then proceeds to stream orientation updates. Events are transmitted (left) into workstation-platformed event handlers. For iOS devices such as iPhones and iPads, events are converted by an iOS–CVE transcoder (left center) before being forwarded to a session server (center). The server redistributes events to channel-subscribed clients (periphery), which display them according to whatever local state (such as virtual camera position) and modality (auditory, visual, stereographic, etc.)

Back to article page