Integrating Multi-Agent Systems with Mixed Reality: the case of MiRAgE framework

Mixed Reality (MR) is quickly becoming a mainstream technology to be exploited for designing smart environments blending physical and virtual objects, introducing new opportunities in supporting individual and cooperative human activities. Recent technological advances in such technological scenario – composed by new kind of devices and new software frameworks/libraries and techniques – are offering new opportunities for the research in agents and Multi-Agent Systems (MAS). In particular, to explore their application both in the design and development of mixed reality based smart environments and in the study of agents’ use concerning the real world going beyond simulations and more. In this paper, we describe the MiRAgE framework, designed and developed to build Mixed Reality agent-based environments where agents can observe and manipulate a blended reality composed of a mix of physical objects and holograms, also interacting and cooperate with humans. Moreover, the paper describes and discuss a case study where MiRAgE has been used to develop a software system where agents act along with humans and holograms.