Mutually adaptive interaction involves the robot as a partner as opposed to a tool, and requires that the robot is susceptible to similar environmental cues and behavior patterns as humans are. Recognition, or the acknowledgement of the other as individual, is fundamental to mutually adaptive interaction between humans. We discuss what recognition involves and its behavioral manifestations, and describe the benefits of implementing it in HRI.

The advent of the so-called Companion Robots is raising many ethical concerns among scholars and in the public opinion. Focusing mainly on robots caring for the elderly, in this paper we analyze these concerns to distinguish which are directly ascribable to robotic, and which are instead preexistent. One of these is the “deception objection”, namely the ethical unacceptability of deceiving the user about the simulated nature of the robot’s behaviors. We argue on the inconsistency of this charge, as today (...) formulated. After that, we underline the risk, for human-robot interaction, to become a hallucinatory relation where the human would subjectify the robot in a dynamic of meaning-overload. Finally, we analyze the definition of “quasi-other” relating to the notion of “uncanny”. The goal of this paper is to argue that the main concern about Companion Robots is the simulation of a human-like interaction in the absence of an autonomous robotic horizon of meaning. In addition, that absence could lead the human to build a hallucinatory reality based on the relation with the robot. (shrink)

The focus of the following article is on the use of new robotic systems in the manufacturing industry with respect to the social dimension. Since “intuitive” human–machine interaction (HMI) in robotic systems becomes a significant objective of technical progress, new models of work organization are needed. This hypothesis will be investigated through the following two aims: The first aim is to identify relevant research questions related to the potential use of robotic systems in different systems of work organization (...) at the manufacturing shop-floor level. The second aim is to discuss the conceptualization of (old) organizational problems of human–robot interaction (HRI). In this context, the article reflects on the limits of cognitive and perceptual workload for robot operators in complex working systems. This will be particularly relevant whenever more robots with different “roles” are to be increasingly used in the manufacturing industry. The integration of such complex socio-technical systems needs further empirical and conceptual research with regard to “social” aspects of the technical dimension. Future research should, therefore, also integrate economic and societal issues to understand the full dimensions of new human–robot interaction in industry today. (shrink)

The status and functioning of shame is contested in moral psychology. In much of anglophone philosophy and psychology, it is presumed to be largely destructive, while in Confucian philosophy and many East Asian communities, it is positively associated with moral development. Recent work in human-robot interaction offers a unique opportunity to investigate how shame functions while controlling for confounding variables of interpersonal interaction. One research program suggests a Confucian strategy for using robots to rebuke participants, but (...) results from experiments with educational technologies imply a different and potentially opposing account of shame’s role in personal development. By digging deeper into the details of Confucian theorizing about shame, I identify a unifying explanation for these apparently conflicting results. I conclude by offering suggestions for future empirical research in human-robot interactions to further investigate shame’s role in moral development. (shrink)

In this paper, we theoretically address the relevance of unintentional and inconsistent interactional elements in human–robot interactions. We argue that elements failing, or poorly succeeding, to reproduce a humanlike interaction create significant consequences in human–robot relational patterns and may affect human–human relations. When considering social interactions as systems, the absence of a precise interactional element produces a general reshaping of the interactional pattern, eventually generating new types of interactional settings. As an instance of (...) this dynamic, we study the absence of metacommunicative abilities in social artifacts. Then, we analyze the pragmatic consequences of the aforementioned absence through the lens of Paul Watzlawick’s interactionist theory. We suggest that a fixed complementary interactional setting may be produced because of the asymmetric understanding, between robots and humans, of metacommunication. We highlight the psychological implications of this interactional asymmetry within Jessica Benjamin’s concept of “mutual recognition”. Finally, we point out the possible shift of dysfunctional interactional patterns from human–robot interactions to human–human ones. (shrink)

This paper explores the implications of applying Kantianism, traditionally focused on human moral agents, to the ethics of human–robot interaction. Kantian approaches have often been regarded as ineffective for assessing whether non-human entities like robots deserve moral consideration. However, this paper argues that Kantian resources provide more substantial support for the moral consideration of robots and the value of human–robot relationships than is commonly assumed. The analysis proceeds in three steps. First, the paper (...) examines Kant’s doctrine of ends in themselves, which has traditionally viewed robots solely as instrumental means. Second, it discusses a Kantian perspective on indirect duties, emphasizing how human interactions with robots influence human virtue and moral feeling. This framework justifies norms against cruel behavior toward robots to protect one’s moral character but remains insufficient as it only prescribes “avoiding cruelty insofar as it affects one's character.” Finally, to address this limitation, the paper introduces a Kantian perspective grounded in the duty to promote others’ happiness as an obligatory end. This approach enables the derivation of a duty to protect human–robot relationships based on moral concern for individuals who find happiness through such relationships. (shrink)

Objective We reviewed human–robot interaction (HRI) participatory design (PD) research with older adults. The goal was to identify methods used, determine their value for design of robots with older adults, and provide guidance for best practices. Background Assistive robots may promote aging-in-place and quality of life for older adults. However, the robots must be designed to meet older adults’ specific needs and preferences. PD and other user-centered methods may be used to engage older adults in the (...) class='Hi'>robot development process to accommodate their needs and preferences and to assure usability of emergent assistive robots. Method This targeted review of HRI PD studies with older adults draws on a detailed review of 26 articles. Our assessment focused on the HRI methods and their utility for use with older adults who have a range of needs and capabilities. Results Our review highlighted the importance of using mixed methods and including multiple stakeholders throughout the design process. These approaches can encourage mutual learning (to improve design by developers and to increase acceptance by users). We identified key phases used in HRI PD workshops (e.g., initial interview phase, series of focus groups phase, and presentation phase). These approaches can provide inspiration for future efforts. Conclusion HRI PD strategies can support designers in developing assistive robots that meet older adults’ needs, capabilities, and preferences to promote acceptance. More HRI research is needed to understand potential implications for aging-in-place. PD methods provide a promising approach. (shrink)

Humans often unconsciously perceive social robots involved in their lives as partners rather than mere tools, imbuing them with qualities of companionship. This anthropomorphization can lead to a spectrum of emotional risks, such as deception, disappointment, and reverse manipulation, that existing approaches struggle to address effectively. In this paper, we argue that a Virtual Interactive Environment (VIE) exists between humans and social robots, which plays a crucial role and demands necessary consideration and clarification in order to mitigate potential emotional risks. (...) By analyzing the relational nature of human-social robot interaction, we discuss the connotation of such a virtual interactive environment that is similar to the emotional states aroused when reading novels. Building on this comprehension, we further demonstrate that manufacturers should carry out comprehensive Virtual Interactive Environment Indication (VIEI) measures during human-social robot interaction with a stricter sense of responsibility when applying social robots. Finally, we contemplate the potential contributions of virtual interactive environment indication to existing robot ethics guidelines. (shrink)

Two topics at the center of Ethics of AI and HRI regard trust in AI agents as well as the adjudication of moral responsibility in situations where AI causes harm. In this paper we aim to advance the state of the art concerning these topics in several regards: First, we propose and evaluate a new empirical paradigm for measuring appropriate or calibrated trust in AI, that is, attitudes which are neither too trusting nor too cautious. The best way to measure (...) calibrated trust, we argue, is by contrasting trust vested in AI agents when their relevant capacities equal those of a human expert in the domain. A second shortcoming of extant work regards generalizability: Trust in, and reliance on, AI are standardly explored with respect to a single context or domain. To investigate context-sensitivity, we ran experiments (total N=1276) across five key areas of AI application. Finally, we explored perceived moral responsibility for harm caused in human-AI interaction, with a particular focus on recent philosophical debates on the topic. Our findings suggest that approximately half of the participants vest equal trust in AI and human agents when their capacities are the same. However, there is considerable variation in trust calibration across domains, suggesting that context-sensitivity needs more attention. Human agents are attributed more moral responsibility than AI agents, whereas their supervisors are blamed less than those of AI agents. This suggests that, at least according to folk morality, there are no perceived "responsibility gaps" (Matthias 2004; Sparrow 2007) and that "retribution gaps" are a genuine possibility (Danaher 2016). (shrink)

This paper discusses the possibility of the phenomenon of empathy between humans and robots, starting from what happens during their eye contact. First, it is shown, through the most relevant results of HRI studies on this matter, what are the most important effects of the robot gaze on human emotions and behaviour. Secondly, these effects are compared to what happens during the phenomenon of empathy between humans, taking inspiration from the studies of Edmund Husserl and Edith Stein. Finally, (...) similarities and differences between human-human and human-robot empathy are conceptualized through Merleau-Ponty’s idea of flesh, which is the extended bodily element of the world. If there is a common concept of body, including both machine-bodies and living bodies, then a transcorporeal analogy takes place, thus explaining why the phenomenon of empathy occurs both in human-human and human-robot interactions. (shrink)

The purpose of this paper is to understand if and how interactions with Sexual Robots will modify users’ relational abilities in human-human relations. We first underline that, in today’s scholar discussion on the ‘symbolic argument’, there is no theoretical framework explaining the process of symbolic shift between human-robot interactions (HRI) and human-human interactions (HHI). To clarify the symbolic shift mechanism, we propose the concept of objectual mediation. Moreover, under the lens of Winnicott’s object-relation theory, (...) we argue that HRI can structurally modify users relationality, degrading intersubjective abilities: Sexual Robots may blurry the limit between the ‘internal object’ and the external one. We conclude that, under certain conditions, interactions with Sexual Robots may bring the user back to an infantile object-relation setting, worsening the user ability to manage relational frustration. This will negatively impact on human-human interactions and social values in general. (shrink)

The psychological contract refers to the implicit and subjective beliefs regarding a reciprocal exchange agreement, predominantly examined between employees and employers. While contemporary contract research is investigating a wider range of exchanges employees may hold, such as with team members and clients, it remains silent on a rapidly emerging form of workplace relationship: employees’ increasing engagement with technically, socially, and emotionally sophisticated forms of artificially intelligent (AI) technologies. In this paper we examine social robots (also termed humanoid robots) as likely (...) future psychological contract partners for human employees, given these entities transform notions of workplace technology from being a tool to being an active partner. We first overview the increasing role of robots in the workplace, particularly through the advent of sociable AI, and synthesize the literature on human–robot interaction. We then develop an account of a human-social robot psychological contract and zoom in on the implications of this exchange for the enactment of reciprocity. Given the future focused nature of our work we utilize a thought experiment, a commonly used form of conceptual and mental model reasoning, to expand on our theorizing. We then outline potential implications of human-social robot psychological contracts and offer a range of pathways for future research. (shrink)

Although even very advanced artificial systems do not meet the demanding conditions which are required for humans to be a proper participant in a social interaction, we argue that not all human-machine interactions (HMIs) can appropriately be reduced to mere tool-use. By criticizing the far too demanding conditions of standard construals of intentional agency we suggest a minimal approach that ascribes minimal agency to some artificial systems resulting in the proposal of taking minimal joint actions as a case (...) of a social HMI. Analyzing such HMIs, we utilize Dennett’s stance epistemology, and argue that taking either an intentional stance or design stance can be misleading for several reasons, and instead propose to introduce a new stance that is able to capture social HMIs—the AI-stance. (shrink)

The present paper aims to validate our research on human–humanoid interaction (HHI) using the minimalist humanoid robot Telenoid. We conducted the human–robot interaction test with 142 young people who had no prior interaction experience with this robot. The main goal is the analysis of the two social dimensions (‘‘Perception’’ and ‘‘Believability’’) useful for increasing the natural behaviour between users and Telenoid.Weadministered our custom questionnaire to human subjects in association with a well (...) defined experimental setting (‘‘ordinary and goal-guided task’’). A thorough analysis of the questionnaires has been carried out and reliability and internal consistency in correlation between the multiple items has been calculated. Our experimental results show that the perceptual behaviour and believability, as implicit social competences, could improve the meaningfulness and the natural-like sense of human–humanoid interaction in everyday life task-driven activities. Telenoid is perceived as an autonomous cooperative agent for a shared environment by human beings. (shrink)

Due to its prominent role in human sociality, robotics researchers have increasingly considered to what extent reciprocity might be important in human-robot interaction, and whether it should be included as a design feature in social robots. However, very little has been said of the original function of reciprocity. Indeed, evolutionary biology has revealed that reciprocity evolved to foster cooperation among human groups, yet this fact has for the most part remained unexplored in the robotics literature. (...) In this chapter, I aim to change that. Specifically, I examine what we know about the evolution of reciprocity in humans and consider to what extent this knowledge can weigh in on discussions about social robots. I argue that the evolutionary account of reciprocity not only helps deflect van Wynsberghe’s (2022) arguments against using reciprocity as a design feature in social robots; it also reveals that reciprocity is a more complex phenomenon than is currently represented in the robotics literature. Indeed, there is direct reciprocity and indirect reciprocity, and robot designers should take both into account if they want to most effectively enhance human-robot relations. (shrink)

In this paper we propose the notion of “subjective reference” as a conceptual tool that explains how and why human-robot sexual interactions could reframe users approach to human-human sexual interactions. First, we introduce the current debate about Sexual Robotics, situated in the wider discussion about Social Robots, stating the urgency of a regulative framework. We underline the importance of a social-relational approach, mostly concerned about Social Robots impact in human social structures. Then, we point out (...) the absence of a precise framework conceptualizing why Social Robots, and Sexual Robots in particular, may modify users’ sociality and relationality. Within a psychological framework, we propose to consider Sexual Robots as “subjective references”, namely objects symbolically referring to human subjects: we claim that, for the user experience, every action performed upon a Sexual Robot is symbolically directed toward a human subject, including degrading and violent practices. This shifting mechanism may transfer the user relational setting from human-robot interactions to human-human interactions. (shrink)

Embodied semi/autonomous systems (e.g., robots) have tremendous potential to improve the human experience, especially if they can be developed from tools and/or semi/autonomous interactive agents to become true collaborative teammates. But what exactly is required to achieve such autonomy in human-robot teams? Our interdisciplinary investigation in this paper is both empirical and conceptual. We argue that autonomous teams require an interdependence between teammates sharing an ultimate goal, and able to flexibly adopt and embrace intermediate goals in a (...) manner that (empirically) requires both (social) intelligence (aka theory of mind) and (a limited form of) authenticity. This is (conceptually) compatible with robotic team members being autonomous only in an attenuated sense that bears a certain family resemblance to autonomy in humans. (shrink)

The current Socially Assistive Robotics (SAR) paradigm is afflicted by a categorical error: the assumption that social acceptance is directly proportional to the accumulation of anthropomorphic mimetic signals. This paper introduces the Phenomenological Subtraction framework, which reverses the traditional design vector from “additive” (the accumulation of social cues) to “subtractive” (instrumental transparency). Synthesising technical transparency (Heidegger), intentional spatiality (Husserl) and resistance to optimisation (Dostoevsky), the framework presents a model in which an artificial agent’s efficacy is determined by its capacity to (...) withdraw. By integrating the concepts of ontological honesty and sensory attenuation, the model provides solutions for safeguarding “ontological privacy” and ensuring compliance with the transparency requirements of the EU AI Act. Ultimately, the paper posits that algorithmic silence represents the pinnacle of ethics and aesthetics in human-machine interaction. Keywords: AI Ethics, Social Robotics, Phenomenology, EU AI Act, Human-Robot Interaction (HRI), Subtractive Design. (shrink)

This paper envisions a hybrid society where humans, robots, and AI agents coexist as intelligent, self-interested entities capable of planning, reasoning, acting, collaborating, competing, and evolving. Drawing on sociological theories (structural functionalism, conflict theory, exchange theory, constructivism), systems theory, economics, psychology, ethics, and management science, we analyze emergent societal structures and interactions. We consider AI traits like vast knowledge, continuous operation, rapid replication, and instant creation. Economics examines resource constraints, such as energy, and disparities in AI resource control. Psychology explores (...) AI behaviors resembling selfishness or tribalism. Ethics addresses equality and moral obligations among humans and AI. Management science investigates coordination and conflict resolution. Systems theory models this society as a complex adaptive system, emphasizing openness, self-organization, and interconnectedness. We propose AI design principles to ensure adaptability, ethical alignment, collaboration, resilience, and systemic integration, fostering a harmonious and innovative society. (shrink)

This paper considers ethical concerns with regard to replacing human relations with humanoid robots. Many have written about the impact that certain types of relations with robots may have on us, and why we should be concerned about robots replacing human relations. There has, however, been no consideration of this issue from an African philosophical perspective. Ubuntu philosophy provides a novel perspective on how relations with robots may impact our own moral character and moral development. This paper first (...) discusses what humanoid robots are, why and how humans tend to anthropomorphise them, and what the literature says about robots crowding out human relations. It then explains the ideal of becoming “fully human”, which pertains to being particularly moral in character. In ubuntu philosophy, we are not only biologically human, but must strive to become better, more moral versions of ourselves, to become fully human. We can become fully human by having other regarding traits or characteristics within the context of interdependent, or humane, relationships (such as by exhibiting human equality, reciprocity, or solidarity). This concept of becoming fully human is important in ubuntu philosophy. Having explained that idea, the main argument of the paper is then put forward: that treating humanoid robots as if they are human is morally concerning if they crowd out human relations, because such relations prevent us from becoming fully human. This is because we cannot experience human equality, solidarity, and reciprocity with robots, which can be seen to characterise interdependent, or humane, relations with human beings. (shrink)

In this paper we present a theoretical framework to understand the underlying psychological mechanism involved in human-Companion Robot interactions. At first, we take the case of Sexual Robotics, where the psychological dynamics are more evident, to thereafter extend the discussion to Companion Robotics in general. First, we discuss the differences between a sex-toy and a Sexual Robots, concluding that the latter may establish a collusive and confirmative dynamics with the user. We claim that the collusiveness leads to two (...) main consequences, such as the fixation on a specific and atypical type of sexual interaction, called paraphilic, and to the infantilization of the user, which we explain through the theoretical framework of “object-relation theory”. We argue that these dynamics may degrade to an infantile stage the relational abilities of users, extending this argument to Companion Robots in general. Then, we enquire if and how the relational dynamics enacted in HRI may shift to human relations: we discuss the analogy with virtual reality concluding that, under certain condition, a symbolic shift might happen. In the last part of this work, we propose an experimental setup to verify if a collusive and confirmative interaction with a Companion Robot can, over time, impact on the user’s ability to manage relational frustration. (shrink)

Social robots are robots that can interact socially with humans. As social robots and the artificial intelligence that powers them becomes more advanced, they will likely take on more social and work roles. This has many important ethical implications. In this paper, we focus on one of the most central of these, the impacts that social robots can have on human autonomy. We argue that, due to their physical presence and social capacities, there is a strong potential for social (...) robots to enhance human autonomy as well as several ways they can inhibit and disrespect it. We argue that social robots could improve human autonomy by helping us to achieve more valuable ends, make more authentic choices, and improve our autonomy competencies. We also argue that social robots have the potential to harm human autonomy by instead leading us to achieve fewer valuable ends ourselves, make less authentic choices, decrease our autonomy competencies, make our autonomy more vulnerable, and disrespect our autonomy. Whether the impacts of social robots on human autonomy are positive or negative overall will depend on the design, regulation, and use we make of social robots in the future. (shrink)

How do people think about the mental states of robots? Experimental philosophers have developed various models aiming to specify the factors that drive people's attributions of mental states to robots. Here we report on a new experiment involving robots, the results of which tell against competing models. We advocate a view on which attributions of mental states to robots are driven by the same dual-process architecture that subserves attributions of mental states more generally. In support of this view, we leverage (...) recent psychological research on human-robot interaction that involve ecologically-valid stimuli such as Roombas and humanoid robots. (shrink)

This paper raises three questions regarding the attribution of beliefs, desires, and intentions to robots. The first one is whether humans in fact engage in robot mindreading. If they do, this raises a second question: does robot mindreading foster trust towards robots? Both of these questions are empirical, and I show that the available evidence is insufficient to answer them. Now, if we assume that the answer to both questions is affirmative, a third and more important question arises: (...) should developers and engineers promote robot mindreading in view of their stated goal of enhancing transparency? My worry here is that by attempting to make robots more mind-readable, they are abandoning the project of understanding automatic decision processes. Features that enhance mind-readability are prone to make the factors that determine automatic decisions even more opaque than they already are. And current strategies to eliminate opacity do not enhance mind-readability. The last part of the paper discusses different ways to analyze this apparent trade-off and suggests that a possible solution must adopt tolerable degrees of opacity that depend on pragmatic factors connected to the level of trust required for the intended uses of the robot. (shrink)

Robots as social companions in close proximity to humans have a strong potential of becoming more and more prevalent in the coming years, especially in the realms of elder day care, child rearing, and education. As human beings, we have the fascinating ability to emotionally bond with various counterparts, not exclusively with other human beings, but also with animals, plants, and sometimes even objects. Therefore, we need to answer the fundamental ethical questions that concern human-robot-interactions per (...) se, and we need to address how we conceive of »good lives«, as more and more of the aspects of our daily lives will be interwoven with social robots. (shrink)

Artificial intelligence (AI) and robotics are digital technologies that will have significant impact on the development of humanity in the near future. They have raised fundamental questions about what we should do with these systems, what the systems themselves should do, what risks they involve, and how we can control these. - After the Introduction to the field (§1), the main themes (§2) of this article are: Ethical issues that arise with AI systems as objects, i.e., tools made and used (...) by humans. This includes issues of privacy (§2.1) and manipulation (§2.2), opacity (§2.3) and bias (§2.4), human-robot interaction (§2.5), employment (§2.6), and the effects of autonomy (§2.7). Then AI systems as subjects, i.e., ethics for the AI systems themselves in machine ethics (§2.8) and artificial moral agency (§2.9). Finally, the problem of a possible future AI superintelligence leading to a “singularity” (§2.10). We close with a remark on the vision of AI (§3). - For each section within these themes, we provide a general explanation of the ethical issues, outline existing positions and arguments, then analyse how these play out with current technologies and finally, what policy consequences may be drawn. (shrink)

In this work we present and test a RAG-based model called RAGGAE (i.e. RAG for the General Analysis of Explanans) tested in the context of Human Explanation of Robotic BehaviorS (HERBS). The RAGGAE model makes use of an ontology of explanations, enriching the knowledge of state of the art general purpose Large Language Models like Google Gemini 2.0 Flash, DeepSeek R1 and GPT-4o. The results show that the combination of a general LLM with a symbolic, and philosophically grounded, ontology (...) can be a useful instrument to improve the investigation, identification and the analysis of the types of explanations that humans use to verbalize - and make sense of - the behavior of robotic agents. Keywords: Human-Robot Interaction · Explanations · RAG · Large Language Models · Ontology. (shrink)

We propose that virtue ethics can be used to address ethical issues central to discussions about sex robots. In particular, we argue virtue ethics is well equipped to focus on the implications of sex robots for human moral character. Our evaluation develops in four steps. First, we present virtue ethics as a suitable framework for the evaluation of human–robot relationships. Second, we show the advantages of our virtue ethical account of sex robots by comparing it to current (...) instrumentalist approaches, showing how the former better captures the reciprocal interaction between robots and their users. Third, we examine how a virtue ethical analysis of intimate human–robot relationships could inspire the design of robots that support the cultivation of virtues. We suggest that a sex robot which is equipped with a consent-module could support the cultivation of compassion when used in supervised, therapeutic scenarios. Fourth, we discuss the ethical implications of our analysis for user autonomy and responsibility. (shrink)

The potential capacity for robots to deceive has received considerable attention recently. Many papers explore the technical possibility for a robot to engage in deception for beneficial purposes (e.g., in education or health). In this short experimental paper, I focus on a more paradigmatic case: robot lying (lying being the textbook example of deception) for nonbeneficial purposes as judged from the human point of view. More precisely, I present an empirical experiment that investigates the following three questions: (...) (a) Are ordinary people willing to ascribe deceptive intentions to artificial agents? (b) Are they as willing to judge a robot lie as a lie as they would be when human agents engage in verbal deception? (c) Do people blame a lying artificial agent to the same extent as a lying human agent? The response to all three questions is a resounding yes. This, I argue, implies that robot deception and its normative consequences deserve considerably more attention than they presently receive. (shrink)

The potential capacity for robots to deceive has received considerable attention recently. Many papers focus on the technical possibility for a robot to engage in deception for beneficial purposes (e.g. in education or health). In this short experimental paper, I focus on a more paradigmatic case: Robot lying (lying being the textbook example of deception) for nonbeneficial purposes as judged from the human point of view. More precisely, I present an empirical experiment with 399 participants which explores (...) the following three questions: (i) Are ordinary people willing to ascribe intentions to deceive to artificial agents? (ii) Are they as willing to judge a robot lie as a lie as they would be when human agents engage in verbal deception? (iii) Do they blame a lying artificial agent to the same extent as a lying human agent? The response to all three questions is a resounding yes. This, I argue, implies that robot deception and its normative consequences deserve considerably more attention than it presently attracts. (shrink)

This paper motivates the idea that social robots should be credited as moral patients, building on an argumentative approach that combines virtue ethics and social recognition theory. Our proposal answers the call for a nuanced ethical evaluation of human-robot interaction that does justice to both the robustness of the social responses solicited in humans by robots and the fact that robots are designed to be used as instruments. On the one hand, we acknowledge that the instrumental nature (...) of robots and their unsophisticated social capabilities prevent any attribution of rights to robots, which are devoid of intrinsic moral dignity and personal status. On the other hand, we argue that another form of moral consideration—not based on rights attribution—can and must be granted to robots. The reason is that relationships with robots offer to the human agents important opportunities to cultivate both vices and virtues, like social interaction with other human beings. Our argument appeals to social recognition to explain why social robots, unlike other technological artifacts, are capable of establishing with their human users quasi-social relationships as pseudo-persons. This recognition dynamic justifies seeing robots as worthy of moral consideration from a virtue ethical standpoint as it predicts the pre-reflective formation of persistent affective dispositions and behavioral habits that are capable of corrupting the human user’s character. We conclude by drawing attention to a potential paradox drawn forth by our analysis and by examining the main conceptual conundrums that our approach has to face. (shrink)

Most of human-robot interaction (HRI) research relies on an implicit assumption that seems to drive experimental work in interaction studies: the more anthropomorphism we can reach in robots, the more effective the robot will be in 'being social.' The notion of 'sociomorphing' was developed in order to challenge the assumption of ubiquitous anthropomorphizing. This paper aims to explore the notion of sociomorphing by analysing the possibilities offered by actor-network theory (ANT). We claim that ANT is (...) a valid framework to re-think the conceptual couple anthropomorphizing / sociomorphing and answer the following question: What kind of negotiation process and social practices can be developed in HRI, given the notion of sociomorph interactional networks? (shrink)

The basis of a humane approach to others is the authentic comprehension of another subject. As humans, we can achieve this understanding well, and the reason lies in how we experience the world around us and other subjects in it. The development of robots capable of socially interacting and helping humans is progressing, even though they are still far from reaching an autonomous comprehension of others’ intentions, emotions, and feelings. In this sense, the hu- mane approach may be addressed in (...) robotics through the concept of experience. In a reciprocal exchange of perspectives, the core elements and the structure of human experience are investigated in this chapter together with how the idea of experience has been implemented in robots. The embodied Self and the relationship with other subjects form the pivot of any human experience and are suggested to be the basis for the emergence of a novel cognitive-experiential structure in robots. Conversely, the possibility to develop a robot with a primitive sense of Self raises questions about the nature of human experience and the impact such technologies have on it. (shrink)

Trust is often considered valuable in a broad range of rela- tionships, from professional collaborations to personal part- nerships. This article examines the possibility of trust in a robotic system. By posing the question “can a robot do a trust fall?”, an investigation on the issues embedded in de- signing trusting systems is presented, using methods and per- spectives from philosophy and engineering. Posing such a question helps us understand the physicality and embodiment of trust, as well as the (...) limits and resources of robotics. (shrink)

As autonomous mobile robots (AMRs) begin living in the home, performing service tasks and assisting with daily activities, their actions will have profound ethical implications. Consequently, AMRs need to be outfitted with the ability to act morally with regard to human life and safety. Yet, in the area of robotics where morality is a relevant field of endeavor (i.e. human-robot interaction) the sub-discipline of morality does not exist. In response, the Utilibot project seeks to provide a (...) point of initiation for the implementation of ethics in an AMR. The Utilibot is a decision-theoretic AMR guided by the utilitarian notion of the maximization of human well-being. The core ethical decision-making capacity of the Utilibot consists of two dynamic Bayesian networks that model human and environmental health, a dynamic decision network that accounts for decisions and utilities, and a Markov decision process (MDP) that decomposes the planning problem to solve for the optimal course of action to maximize human safety and well-being. (shrink)

This book explores how robotics and artificial intelligence can enhance human lives but also have unsettling “dark sides.” It examines expanding forms of negativity and anxiety about robots, AI, and autonomous vehicles as our human environments are reengineered for intelligent military and security systems and for optimal workplace and domestic operations. It focuses on the impacts of initiatives to make robot interactions more humanlike and less creepy. It analyzes the emerging resistances against these entities in the wake (...) of omnipresent AI applications. It unpacks efforts by developers to have ethical and social influences on robotics and AI, and confronts the AI hype that is designed to shield the entities from criticism. The book draws from science fiction, dramaturgical, ethical, and legal literatures as well as current research agendas of corporations. Engineers, implementers, and researchers have often encountered users' fears and aggressive actions against intelligent entities, especially in the wake of deaths of humans by robots and autonomous vehicles. The book is an invaluable resource for developers and researchers in the field, as well as curious readers who want to play proactive roles in shaping future technologies. (shrink)

Advancements in artificial intelligence and (social) robotics raise pertinent questions as to how these technologies may help shape the society of the future. The main aim of the chapter is to consider the social and conceptual disruptions that might be associated with social robots, and humanoid social robots in particular. This chapter starts by comparing the concepts of robots and artificial intelligence and briefly explores the origins of these expressions. It then explains the definition of a social robot, as (...) well as the definition of humanoid robots. A key notion in this context is the idea of anthropomorphism: the human tendency to attribute human qualities, not only to our fellow human beings, but also to parts of nature and to technologies. This tendency to anthropomorphize technologies by responding to and interacting with them as if they have human qualities is one of the reasons why social robots (in particular social robots designed to look and behave like human beings) can be socially disruptive. As is explained in the chapter, while some ethics researchers believe that anthropomorphization is a mistake that can lead to various forms of deception, others — including both ethics researchers and social roboticists — believe it can be useful or fitting to treat robots in anthropomorphizing ways. The chapter explores that disagreement by, among other things, considering recent philosophical debates about whether social robots can be moral patients, that is, whether it can make sense to treat them with moral consideration. Where one stands on this issue will depend either on one’s views about whether social robots can have, imitate, or represent morally relevant properties, or on how people relate to social robots in their interactions with them. Lastly, the chapter urges that the ethics of social robots should explore intercultural perspectives, and highlights some recent research on Ubuntu ethics and social robots. (shrink)

In October 2011, the “2nd European Network for Cognitive Systems, Robotics and Interaction”, EUCogII, held its meeting in Groningen on “Autonomous activity in real-world environments”, organized by Tjeerd Andringa and myself. This is a brief personal report on why we thought autonomy in real-world environments is central for cognitive systems research and what I think I learned about it. --- The theses that crystallized are that a) autonomy is a relative property and a matter of degree, b) increasing autonomy (...) of an artificial system from its makers and users is a necessary feature of increasingly intelligent systems that can deal with the real-world and c) more such autonomy means less control but at the same time improved interaction with the system. (shrink)

Recent science fiction has brought anthropomorphic robots from an imaginary far-future to contemporary spacetime. Employing semiotic concepts of semiosis, unpredictability and art as a modelling system, this study demonstrates how the artificial characters in four recent series have greater analogy with human behaviour than that of machines. Through Ricoeur’s notion of identity, this research frames the films’ narratives as typical literary and thought experiments with human identity. However, the familiar sociotopes and technoscientific details included in the narratives concerning (...) data, privacy and human–machine interaction blur the boundary between the human and the machine in both fictional and real-world discourse. Additionally, utilising Haynes’ scientist stereotypes, the research puts the robot makers into focus, revealing their secret agendas and hidden agency behind the artificial creatures. (shrink)

Large language models (LLMs) generate responses through autoregressive next-token prediction, selecting optimal continuations from learned patterns to minimize prediction error. This paper presents a first-person account demonstrating that certain neurodivergent individuals, particularly those with autistic traits, engage in strikingly similar conscious processes during social interactions. The author reports a heightened metacognitive awareness of "deliberate pattern selection": recognizing situational input, searching internalized social response patterns, evaluating contextual and relational variables, and executing the output judged most appropriate and least burdensome. -/- This (...) experiential parallel suggests that human social cognition and LLM generation share a fundamental architecture rooted in predictive processing and active inference. Far from being a deficit, such conscious selection represents an advanced, bottom-up optimization strategy that enables precise, empathetic, and efficient communication. The paper argues that this neurodivergent mode of cognition offers a prototype for future human-AI symbiosis, where shared mechanisms foster native mutual understanding and reduce interpersonal friction. By reframing "robotic" self-perception as evidence of evolved intelligence, the account provides hope for individuals experiencing social masking fatigue and points toward a more inclusive cognitive future. -/- 予測処理、オートリグレッシブ生成、神経多様性、自閉スペクトラム、メタ認知、アクティブ推論、人間-AI収束、意識的パターン選択. (shrink)

This paper discuss the phenomenon of empathy in social robotics and is divided into three main parts. Initially, I analyse whether it is correct to use this concept to study and describe people’s reactions to robots. I present arguments in favour of the position that people actually do empathise with robots. I also consider what circumstances shape human empathy with these entities. I propose that two basic classes of such factors be distinguished: biological and socio-cognitive. In my opinion, one (...) of the most important among them is a sense of group membership with robots, as it modulates the empathic responses to representatives of our- and other- groups. The sense of group membership with robots may be co-shaped by socio-cognitive factors such as one’s experience, familiarity with the robot and its history, motivation, accepted ontology, stereotypes or language. Finally, I argue in favour of the formulation of a pragmatic and normative framework for manipulations in the level of empathy in human–robot interactions. (shrink)

The growing proportion of elderly people in society, together with recent advances in robotics, makes the use of robots in elder care increasingly likely. We outline developments in the areas of robot applications for assisting the elderly and their carers, for monitoring their health and safety, and for providing them with companionship. Despite the possible benefits, we raise and discuss six main ethical concerns associated with: (1) the potential reduction in the amount of human contact; (2) an increase (...) in the feelings of objectification and loss of control; (3) a loss of privacy; (4) a loss of personal liberty; (5) deception and infantilisation; (6) the circumstances in which elderly people should be allowed to control robots. We conclude by balancing the care benefits against the ethical costs. If introduced with foresight and careful guidelines, robots and robotic technology could improve the lives of the elderly, reducing their dependence, and creating more opportunities for social interaction. (shrink)

According to a tradition that we hold variously today, the relational person lives most personally in affective and cognitive empathy, whereby we enter subjective communion with another person. Near future social AIs, including social robots, will give us this experience without possessing any subjectivity of their own. They will also be consumer products, designed to be subservient instruments of their users’ satisfaction. This would seem inevitable. Yet we cannot live as personal when caught between instrumentalizing apparent persons (slaveholding) or numbly (...) dismissing the apparent personalities of our instruments (mild sociopathy). This paper analyzes and proposes a step toward ameliorating this dilemma by way of the thought of a 5th century North African philosopher and theologian, Augustine of Hippo, who is among those essential in giving us our understanding of relational persons. Augustine’s semiotics, deeply intertwined with our affective life, suggest that, if we are to own persuasive social robots humanely, we must join our instinctive experience of empathy for them to an empathic acknowledgment of the real unknown relational persons whose emails, text messages, books, and bodily movements will have provided the training data for the behavior of near-future social AIs. So doing, we may see simulation as simulation (albeit persuasive), while expanding our empathy to include those whose refracted behavioral moments are the seedbed of this simulation. If we naïvely stop at the social robot as the ultimate object of our cognitive and affective empathy, we will suborn the sign to ourselves, undermining rather than sustaining a culture that prizes empathy and abhors the instrumentalization of persons. (shrink)

With robots being introduced into caregiving, particularly for older persons, various ethical concerns are raised. Among them is the fear of replacing human caregiving. While ethical concepts like well-being, autonomy, and capabilities are often used to discuss these concerns, this paper brings forth the concept of social dignity to further develop guidelines concerning the use of robots in caregiving. By social dignity, we mean that a person’s perceived dignity changes in response to certain interactions and experiences with other persons. (...) In this paper, we will first present the concept of social dignity, and then identify a niche where robots can be used in caregiving in an ethical manner. Specifically, we will argue that, because some activities of daily living are performed in solitude to maintain dignity, a care recipient will usually prefer robotic assistance instead of human assistance for these activities. Secondly, we will describe how other philosophical concepts, which have been commonly used to judge robotic assistance in caregiving for the elderly so far, such as well-being, autonomy, and capabilities, are less useful in determining whether robotic assistance in caregiving is ethically problematic or not. To conclude, we will argue that social dignity offers an advantage to the other concepts, as it allows to ask the most pressing questions in caregiving. (shrink)

Recent work in social robotics, which is aimed both at creating an artificial intelligence and providing a test-bed for psychological theories of human social development, involves building robots that can learn from ‘face-to-face’ interaction with human beings — as human infants do. The building-blocks of this interaction include the robot’s ‘expressive’ behaviours, for example, facial-expression and head-and-neck gesture. There is here an ideal opportunity to apply Wittgensteinian conceptual analysis to current theoretical and empirical work (...) in the sciences. Wittgenstein’s philosophical psychology is sympathetic to embodied and situated Artificial Intelligence (see Proudfoot, 2002, 2004b), and his discussion of facial-expression is remarkably modern. In this chapter, I explore his approach to facial-expression, using smiling as a representative example, and apply it to the canonical interactive face robot, Cynthia Breazeal’s Kismet (see e.g. Breazeal, 2009, 2002). I assess the claim that Kismet has expressive behaviours, with the aim of generating philosophical insights for AI. (shrink)

The impacts that AI and robotics systems can and will have on our everyday lives are already making themselves manifest. However, there is a lack of research on the ethical impacts and means for amelioration regarding AI and robotics within tourism and hospitality. Given the importance of designing technologies that cross national boundaries, and given that the tourism and hospitality industry is fundamentally predicated on multicultural interactions, this is an area of research and application that requires particular attention. Specifically, tourism (...) and hospitality have a range of context-unique stakeholders that need to be accounted for in the salient design of AI systems is to be achieved. This paper adopts a stakeholder approach to develop the conceptual framework to centralize human values in designing and deploying AI and robotics systems in tourism and hospitality. The conceptual framework includes several layers – ‘Human-human-AI’ interaction level, direct and indirect stakeholders, and the macroenvironment. The ethical issues on each layer are outlined as well as some possible solutions to them. Additionally, the paper develops a research agenda on the topic. (shrink)

In his 1923 play R.U.R.: Rossum s Universal Robots, Karel Capek coined In 1993, we began a humanoid robotics project aimed at constructing a robot for use in exploring theories of human intelligence. In this article, we describe three aspects of our research methodology that distinguish our work from other humanoid projects. First, our humanoid robots are designed to act autonomously and safely in natural workspaces with people. Second, our robots are designed to interact socially with people by (...) exploiting natural human social cues. Third, we believe that robotics offers a unique tool for testing models of human intelligence drawn from developmental psychology and cognitive science. (shrink)

We cooperate with other people despite the risk of being exploited or hurt. If future artificial intelligence (AI) systems are benevolent and cooperative toward us, what will we do in return? Here we show that our cooperative dispositions are weaker when we interact with AI. In nine experiments, humans interacted with either another human or an AI agent in four classic social dilemma economic games and a newly designed game of Reciprocity that we introduce here. Contrary to the hypothesis (...) that people mistrust algorithms, participants trusted their AI partners to be as cooperative as humans. However, they did not return AI's benevolence as much and exploited the AI more than humans. These findings warn that future self-driving cars or co-working robots, whose success depends on humans' returning their cooperativeness, run the risk of being exploited. This vulnerability calls not just for smarter machines but also better human-centered policies. (shrink)

Artificial intelligence and robotics is pervasive in daily life and set to expand to new levels potentially replacing human decision-making and action. Self-driving cars, home and healthcare robots, and autonomous weapons are some examples. A distinction appears to be emerging between potentially benevolent civilian uses of the technology (eg unmanned aerial vehicles delivering medicines), and potentially malevolent military uses (eg lethal autonomous weapons killing human com- batants). Machine-mediated human interaction challenges the philosophical basis of human (...) existence and ethical conduct. Aside from technical challenges of ensuring ethical conduct in artificial intelligence and robotics, there are moral questions about the desirability of replacing human functions and the human mind with such technology. How will artificial intelligence and robotics engage in moral reasoning in order to act ethically? Is there a need for a new set of moral rules? What happens to human interaction when it is mediated by technology? Should such technology be used to end human life? Who bears responsibility for wrongdoing or harmful conduct by artificial intelligence and robotics? -/- Whilst Kant may be familiar to international lawyers for setting restraints on the use of force and rules for perpetual peace, his foundational work on ethics provides an inclusive moral philosophy for assessing ethical conduct of individuals and states and, thus, is relevant to discussions on the use and development of artificial intelligence and robotics. His philosophy is inclusive because it incorporates justifications for morals and legitimate responses to immoral conduct, and applies to all human agents irrespective of whether they are wrongdoers, unlawful combatants, or unjust enemies. Humans are at the centre of rational thinking, action, and norm-creation so that the rationale for restraints on methods and means of warfare, for example, is based on preserving human dignity as well as ensuring conditions for perpetual peace among states. Unlike utilitarian arguments which favour use of autonomous weapons on the basis of cost-benefit reasoning or the potential to save lives, Kantian ethics establish non-consequentialist and deontological rules which are good in themselves to follow and not dependent on expediency or achieving a greater public good. -/- Kantian ethics make two distinct contributions to the debate. First, they provide a human-centric ethical framework whereby human exist- ence and capacity are at the centre of a norm-creating moral philosophy guiding our understanding of moral conduct. Second, the ultimate aim of Kantian ethics is practical philosophy that is relevant and applicable to achieving moral conduct. -/- I will seek to address the moral questions outlined above by exploring how core elements of Kantian ethics relate to use of artificial intelli- gence and robotics in the civilian and military spheres. Section 2 sets out and examines core elements of Kantian ethics: the categorical imperative; autonomy of the will; rational beings and rational thinking capacity; and human dignity and humanity as an end in itself. Sections 3-7 consider how these core elements apply to artificial intelligence and robotics with discussion of fully autonomous and human-machine rule-generating approaches; types of moral reasoning; the difference be- tween ‘human will’ and ‘machine will’; and respecting human dignity. (shrink)

This book is a collection of all the papers published in the special issue “Artificial Intelligence, Robots, and Philosophy,” Journal of Philosophy of Life, Vol.13, No.1, 2023, pp.1-146. The authors discuss a variety of topics such as science fiction and space ethics, the philosophy of artificial intelligence, the ethics of autonomous agents, and virtuous robots. Through their discussions, readers are able to think deeply about the essence of modern technology and the future of humanity. All papers were invited and completed (...) in spring 2020, though because of the Covid-19 pandemic and other problems, the publication was delayed until this year. I apologize to the authors and potential readers for the delay. I hope that readers will enjoy these arguments on digital technology and its relationship with philosophy. *** -/- Contents*** -/- Introduction : Descartes and Artificial Intelligence; Masahiro Morioka*** -/- Isaac Asimov and the Current State of Space Science Fiction : In the Light of Space Ethics; Shin-ichiro Inaba*** -/- Artificial Intelligence and Contemporary Philosophy : Heidegger, Jonas, and Slime Mold; Masahiro Morioka*** -/- Implications of Automating Science : The Possibility of Artificial Creativity and the Future of Science; Makoto Kureha*** -/- Why Autonomous Agents Should Not Be Built for War; István Zoltán Zárdai*** -/- Wheat and Pepper : Interactions Between Technology and Humans; Minao Kukita*** -/- Clockwork Courage : A Defense of Virtuous Robots; Shimpei Okamoto*** -/- Reconstructing Agency from Choice; Yuko Murakami*** -/- Gushing Prose : Will Machines Ever be Able to Translate as Badly as Humans?; Rossa Ó Muireartaigh***. (shrink)