Multimodal Technologies and Interaction

4 pages, 217 KiB

Open AccessEditorial

Acknowledgment to Reviewers of Multimodal Technologies and Interaction in 2020

by Multimodal Technologies and Interaction Editorial Office

Multimodal Technol. Interact. 2021, 5(1), 4; https://doi.org/10.3390/mti5010004 - 18 Jan 2021

Viewed by 3554

Peer review is the driving force of journal development, and reviewers are gatekeepers who ensure that Multimodal Technologies and Interaction maintains its standards for the high quality of its published papers [...] Full article

18 pages, 727 KiB

Open AccessArticle

Design Space for Voice-Based Professional Reporting

by Jaakko Hakulinen, Tuuli Keskinen, Markku Turunen and Sanni Siltanen

Multimodal Technol. Interact. 2021, 5(1), 3; https://doi.org/10.3390/mti5010003 - 11 Jan 2021

Cited by 1 | Viewed by 4348

Abstract

Speech technology has matured so that voice-based reporting utilizing speech-to-text can be applied in various domains. Speech has two major benefits: it enables efficient reporting and speech input improves the quality of the reports since reporting can be done as a part of the workflow without delays between work and reporting. However, designing reporting voice user interfaces (VUIs) for professional use is challenging, as there are numerous aspects from technology to organization and language that need to be considered. Based on our experience in developing professional reporting VUIs with different stakeholders representing both commercial and public sector, we define a design space for voice-based reporting systems. The design space consists of 28 dimensions grouped into five categories: Language Processing, Structure of Reporting, Technical Limitations in the Work Domain, Interaction Related Aspects in the Work Domain, and Organization. We illustrate the design space by discussing four voice-based reporting systems, designed and implemented by us, and describing a design process that utilizes it. The design space enables designers to identify critical aspects of professional reporting VUIs and optimize those for their target domain. The design space can be used as a practical tool especially by designers with limited experience on speech technologies. Full article

► Show Figures

Figure 1

39 pages, 14691 KiB

Open AccessArticle

Forming Cognitive Maps of Ontologies Using Interactive Visualizations

by Jonathan Demelo and Kamran Sedig

Multimodal Technol. Interact. 2021, 5(1), 2; https://doi.org/10.3390/mti5010002 - 11 Jan 2021

Cited by 1 | Viewed by 5033

Abstract

Ontology datasets, which encode the expert-defined complex objects mapping the entities, relations, and structures of a domain ontology, are increasingly being integrated into the performance of challenging knowledge-based tasks. Yet, it is hard to use ontology datasets within our tasks without first understanding the ontology which it describes. Using visual representation and interaction design, interactive visualization tools can help us learn and develop our understanding of unfamiliar ontologies. After a review of existing tools which visualize ontology datasets, we find that current design practices struggle to support learning tasks when attempting to build understanding of the ontological spaces within ontology datasets. During encounters with unfamiliar spaces, our cognitive processes align with the theoretical framework of cognitive map formation. Furthermore, designing encounters to promote cognitive map formation can improve our performance during learning tasks. In this paper, we examine related work on cognitive load, cognitive map formation, and the use of interactive visualizations during learning tasks. From these findings, we formalize a set of high-level design criteria for visualizing ontology datasets to promote cognitive map formation during learning tasks. We then perform a review of existing tools which visualize ontology datasets and assess their interface design towards their alignment with the cognitive map framework. We then present PRONTOVISE (PRogressive ONTOlogy VISualization Explorer), an interactive visualization tool which applies the high-level criteria within its design. We perform a task-based usage scenario to illustrate the design of PRONTOVISE. We conclude with a discussion of the implications of PRONTOVISE and its use of the criteria towards the design of interactive visualization tools which help us develop understanding of the ontological space within ontology datasets. Full article

► Show Figures

Figure 1

12 pages, 256 KiB

Open AccessArticle

Designing Slow Cities for More Than Human Enrichment: Dog Tales—Using Narrative Methods to Understand Co-Performative Place-Making

by Jane Turner and Ann Morrison

Multimodal Technol. Interact. 2021, 5(1), 1; https://doi.org/10.3390/mti5010001 - 23 Dec 2020

Cited by 10 | Viewed by 4785

Abstract

Designing for slow cities and the need to design for future urban environments that include the more than human is a major priority for our times. This position paper problematizes the nature–culture divide in research about place and place-making, where place is understood to be about the sense of meaning we layer on locations in the physical world. It emphasizes the importance of narrative identity and place-making in the context of designing for urban environmental futures and creation of slow cities. We present an overview of a methodology to re-emplace place-making with animals in the context of slow cities and designing for the more than human. The work discussed here explores the use of narrative inquiry with some early narrative data (in the form of stories) about dog walks and those moments where our companion animals demonstrate agentic place-based meaning-making. The problem of understanding “what animals want” and how they make might ”make sense” of an experience is approached via a focus on a rich exemplar case in order to distinguish between emplotment (narrative meaning-making as self) and emplacement (narrative meaning-making as an aspect of place). This is used to create a framework for future evaluation with a view to revealing how “more than human stories”—just like our own familiar human stories—are also about agency and meaning in place. This recognition has import for ways in which we might approach decentring the human when we frame urban design activities. Full article

(This article belongs to the Special Issue Animal Centered Computing: Enriching the Lives of Animals)

Journal Menu

Journal Browser

Multimodal Technol. Interact., Volume 5, Issue 1 (January 2021) – 4 articles

Further Information

Guidelines

MDPI Initiatives

Follow MDPI