Staff, Author at Institute of Futures Research

May 11, 2023

(Featured) Bare statistical evidence and the legitimacy of software-based judicial decisions

Eva Schmidt et al. explore the question of whether evidence provided by software systems can serve as a legitimate basis for judicial decisions, focusing on two primary cases: recidivism predictions and DNA cold hit cases. The authors approach this question by analyzing the nature of bare statistical evidence and its relation to individualized evidence. They argue that while bare statistical evidence is generally considered insufficient to meet the standard of proof in criminal and civil cases, software-generated evidence can be individualized and, thus, meet this standard of proof under certain conditions.

In the case of recidivism predictions, the authors discuss the use of software systems such as COMPAS, which rely on bare statistical evidence to estimate the risk of an individual reoffending. They argue that for a sentence to be just and have the potential to serve as an incentive, it must be based on the specific features of the individual concerned, rather than solely on general features of a group that they belong to, which may correlate with high recidivism risk. The authors maintain that bare statistical evidence alone is insufficient for sentencing decisions.

Regarding DNA cold hit cases, the authors propose that statistical evidence generated by software systems like TrueAllele can be individualized through abductive reasoning or inference to the best explanation when it comes to cases of extreme probability. They argue that when the best explanation for the evidence is that the defendant is the source of the crime scene DNA, the evidence can be considered individualized and, thus, meet the standard of proof for criminal cases. This aligns with the normic account of individualized evidence, which posits that the best explanation of a piece of evidence is also the most normal explanation.

The authors’ analysis raises broader philosophical questions concerning the nature of evidence, the role of statistical reasoning in judicial decision-making, and the ethical implications of using software systems in the courtroom. It highlights the importance of distinguishing between different types of support, such as abductive (normic) support and probabilistic support, and of understanding the connections and disconnections between these concepts. Moreover, the paper touches on issues related to transparency, explainability, and fairness in the use of software systems as decision-making aids in the legal context.

Future research could further explore the implications of using software systems for other types of legal evidence and decision-making processes, as well as the ethical and epistemological challenges that these systems pose. Additionally, investigating the relationship between individualized evidence and statistical reasoning could shed light on the nature of evidence itself and the standards of proof required in various legal contexts. Finally, future work could focus on the development of guidelines and best practices for the implementation and evaluation of software systems in the courtroom, addressing issues such as transparency, explainability, and the appropriate weighting of statistical and individualized evidence.

Abstract

Can the evidence provided by software systems meet the standard of proof for civil or criminal cases, and is it individualized evidence? Or, to the contrary, do software systems exclusively provide bare statistical evidence? In this paper, we argue that there are cases in which evidence in the form of probabilities computed by software systems is not bare statistical evidence, and is thus able to meet the standard of proof. First, based on the case of State v. Loomis, we investigate recidivism predictions provided by software systems used in the courtroom. Here, we raise problems for software systems that provide predictions that are based on bare statistical evidence. Second, by examining the case of People v. Chubbs, we argue that the statistical evidence provided by software systems in cold hit DNA cases may in some cases suffice for individualized evidence, on a view on which individualized evidence is evidence that normically supports the relevant proposition (Smith, in Mind 127:1193–1218, 2018).
Bare statistical evidence and the legitimacy of software-based judicial decisions

May 10, 2023May 10, 2023

(Featured) Algorithmic Nudging: The Need for an Interdisciplinary Oversight

Christian Schmauder et al. critically assess the implications and risks of employing “black box” AI systems for the development and implementation of personalized nudges in various domains of life. They begin by outlining the power and promise of algorithmic nudging, drawing attention to how AI-driven nudges could bring about widespread benefits in areas such as health, finance, and sustainability. However, they contend that outsourcing nudging to opaque AI systems poses challenges in terms of understanding the underlying reasons for their effectiveness and addressing potential unintended consequences.

The authors delve deeper into the nuances of algorithmic nudging by examining the role of personalized advice in influencing human decision-making. They highlight a key concern that arises when AI systems attempt to maximize user satisfaction: the tendency of the algorithms to exploit cognitive biases in order to achieve desired outcomes. Consequently, the effectiveness of the AI-developed nudges might come at the cost of truthfulness, ultimately undermining the very goals they were designed to achieve.

To address this issue, the authors advocate for the need to look “under the hood” of AI systems, arguing that understanding the underlying cognitive processes harnessed by these systems is crucial for mitigating unintended side effects. They emphasize the importance of interdisciplinary collaboration between computer scientists, cognitive scientists, and psychologists in the development, monitoring, and refinement of AI systems designed to influence human decision-making.

The authors’ exploration of the limitations and risks of “black box” AI nudges raises broader philosophical concerns, particularly in relation to the ethics of autonomy, transparency, and accountability. These concerns call into question the balance between leveraging AI-driven nudges to benefit society and preserving individual autonomy and freedom of choice. Furthermore, the analysis highlights the tension between relying on AI’s predictive power and fostering a deeper understanding of the mechanisms driving human behavior.

This paper provides a valuable foundation for future research on the ethical and philosophical implications of AI-driven nudging. Further investigation could delve into the possible approaches to designing more transparent and explainable AI systems, exploring how such systems might enhance, rather than hinder, human decision-making processes. Additionally, researchers could examine the moral responsibilities of AI developers and regulators, studying the ethical frameworks necessary to guide the development and deployment of AI nudges that respect human autonomy, values, and dignity. Ultimately, a deeper understanding of these complex philosophical questions will be instrumental in realizing the full potential of AI-driven nudges while safeguarding against their potential pitfalls.

Abstract

Nudge is a popular public policy tool that harnesses well-known biases in human judgement to subtly guide people’s decisions, often to improve their choices or to achieve some socially desirable outcome. Thanks to recent developments in artificial intelligence (AI) methods new possibilities emerge of how and when our decisions can be nudged. On the one hand, algorithmically personalized nudges have the potential to vastly improve human daily lives. On the other hand, blindly outsourcing the development and implementation of nudges to “black box” AI systems means that the ultimate reasons for why such nudges work, that is, the underlying human cognitive processes that they harness, will often be unknown. In this paper, we unpack this concern by considering a series of examples and case studies that demonstrate how AI systems can learn to harness biases in human judgment to reach a specified goal. Drawing on an analogy in a philosophical debate concerning the methodology of economics, we call for the need of an interdisciplinary oversight of AI systems that are tasked and deployed to nudge human behaviours.
Algorithmic Nudging: The Need for an Interdisciplinary Oversight

May 10, 2023May 10, 2023

(Featured) Levels of explicability for medical artificial intelligence: What do we normatively need and what can we technically reach?

Frank Ursin et al. investigate the ethical considerations associated with medical artificial intelligence (AI), particularly in the context of radiology. They emphasize the importance of implementing explainable AI (XAI) techniques to address epistemic and explanatory concerns that arise when AI is employed in medical decision-making. The authors outline a four-level approach to explicability, comprising disclosure, intelligibility, interpretability, and explainability, with each successive level representing an escalation in the level of detail and clarity provided to the patient or physician.

The authors argue that XAI has great potential in the medical field, and they present two examples from radiology to illustrate its practical applications. The first example involves the use of image inpainting techniques to generate sharper and more detailed saliency maps, which can help localize relevant regions within radiological images. The second example highlights the importance of natural language communication in XAI, where an image-to-text model is used to generate medical reports based on radiological images. These two examples demonstrate that incorporating XAI techniques in radiology can provide valuable insights and improved communication for medical practitioners and patients.

In the paper’s conclusion, the authors emphasize the need for a tailored approach to explicability that considers the needs of patients and the scope of medical decisions. They also advocate for the use of insights gained from medical AI ethics to re-evaluate established medical practices and confront biases in medical classification systems. By applying the four levels of explicability in a thoughtful manner, the authors posit that ethically defensible information processes can be established when utilizing medical AI.

This paper touches on broader philosophical issues related to the ethics of technology, medical autonomy, and the nature of trust in AI-driven decision-making. As AI becomes increasingly integrated into various domains of human activity, questions about transparency, fairness, and the moral implications of AI systems become paramount. This paper demonstrates the necessity of establishing an ethical framework for AI applications in healthcare, providing valuable insights that can be extended to other disciplines as well. By considering the complex interplay between AI-driven systems and human agents, the authors also underscore the importance of understanding how technological advancements impact the broader social fabric and the values we uphold as a society.

Future research in this area could explore the generalizability of the four-level approach to explicability in other medical domains or even non-medical contexts. Additionally, researchers may investigate how the incorporation of diverse perspectives in the development of AI systems and explainability techniques can mitigate the potential for biases and discriminatory outcomes. It would also be valuable to study how XAI can be adapted to the specific needs and preferences of individual patients or physicians, creating personalized approaches to explicability. Lastly, researchers may wish to assess the long-term impact of integrating XAI in medical practice, particularly in terms of patient satisfaction, physician trust, and overall quality of care.

Abstract

Definition of the problem

The umbrella term “explicability” refers to the reduction of opacity of artificial intelligence (AI) systems. These efforts are challenging for medical AI applications because higher accuracy often comes at the cost of increased opacity. This entails ethical tensions because physicians and patients desire to trace how results are produced without compromising the performance of AI systems. The centrality of explicability within the informed consent process for medical AI systems compels an ethical reflection on the trade-offs. Which levels of explicability are needed to obtain informed consent when utilizing medical AI?

Arguments

We proceed in five steps: First, we map the terms commonly associated with explicability as described in the ethics and computer science literature, i.e., disclosure, intelligibility, interpretability, and explainability. Second, we conduct a conceptual analysis of the ethical requirements for explicability when it comes to informed consent. Third, we distinguish hurdles for explicability in terms of epistemic and explanatory opacity. Fourth, this then allows to conclude the level of explicability physicians must reach and what patients can expect. In a final step, we show how the identified levels of explicability can technically be met from the perspective of computer science. Throughout our work, we take diagnostic AI systems in radiology as an example.

Conclusion

We determined four levels of explicability that need to be distinguished for ethically defensible informed consent processes and showed how developers of medical AI can technically meet these requirements.
Levels of explicability for medical artificial intelligence: What do we normatively need and what can we technically reach?

May 9, 2023

(Featured) A phenomenological perspective on AI ethical failures: The case of facial recognition technology

Yuni Wen and Matthias Holweg conduct a philosophical analysis of the responses of four prominent technology firms to the ethical concerns surrounding the use and development of facial recognition technology. The article meticulously delves into the controversies surrounding Amazon, IBM, Microsoft, and Google, as they grapple with public backlash and stakeholder disapproval. By analyzing these cases, the authors elucidate four distinct strategies that these organizations employ to mitigate potential reputation loss: deflection, improvement, validation, and pre-emption. They astutely highlight the spectrum of these responses, ranging from the most accommodative to the most defensive approach.

The authors propose three possible antecedents that may determine an organization’s response strategy to controversial AI technology: the financial importance of the technology to the company, the strategic importance of the technology to the company’s product and service offerings, and the degree to which the controversial technology violates the company’s stated public values. Through their examination of the facial recognition controversies and the strategies employed by the tech giants, they provide invaluable insights into how these factors contribute to shaping the responses of companies facing ethical dilemmas in AI technology.

Although the article’s primary focus is on large technology firms, it acknowledges the limitations of its analysis and encourages further research on small and medium-sized firms, non-profit organizations, public sector organizations, and other entities that may intentionally misuse AI for nefarious purposes. It also highlights the need for future research to consider the interplay between organizational strategies and the varying global regulatory landscape concerning AI technology, given the diverse policy initiatives and regional differences.

The article not only contributes to the ongoing discourse about AI ethics but also resonates with broader philosophical debates on corporate social responsibility and the role of organizations in shaping a just and equitable society. In an era of unprecedented technological advances and heightened awareness of ethical concerns, this research raises pertinent questions about the duties and responsibilities that companies bear in addressing the potential social and moral implications of their products and services. It underscores the challenge that organizations face in balancing financial interests and strategic goals with ethical imperatives and societal expectations.

To enrich our understanding of the complex interplay between organizations and AI ethics, future research could explore the processes through which companies develop and implement their response strategies, with an emphasis on the role of leadership, organizational culture, and internal and external stakeholder dynamics. Moreover, investigating how these strategies evolve over time and assessing their effectiveness in addressing public concerns could provide valuable insights into best practices for organizations navigating the ethical minefield of AI technology. Ultimately, this line of inquiry would contribute significantly to our understanding of how corporations can foster the responsible development and use of AI, ensuring that its potential benefits are realized while mitigating its ethical risks.

Abstract

As more and more companies adopt artificial intelligence to increase the efficiency and effectiveness of their products and services, they expose themselves to ethical crises and potentially damaging public controversy associated with its use. Despite the prevalence of AI ethical problems, most companies are strategically unprepared to respond effectively to the public. This paper aims to advance our empirical understanding of company responses to AI ethical crises by focusing on the rise and fall of facial recognition technology. Specifically, through a comparative case study of how four big technology companies responded to public outcry over their facial recognition programs, we not only demonstrated the unfolding and consequences of public controversies over this new technology, but also identified and described four major types of company responses—Deflection, Improvement, Validation, and Pre-emption. These findings pave the way for future research on the management of controversial technology and the ethics of AI.
A phenomenological perspective on AI ethical failures: The case of facial recognition technology

May 9, 2023

(Featured) Merging Minds: The Conceptual and Ethical Impacts of Emerging Technologies for Collective Minds

David M. Lyreskog et al. outline and analyze the ethical implications and conceptual challenges surrounding technologically enabled collective minds (TCMs). The paper proposes four main categories to help understand the varying levels of unity and directionality in TCMs: DigiMinds, UniMinds, NetMinds, and MacroMinds. Each category has its own set of unique ethical challenges, which the authors argue should be considered in a multidimensional manner to effectively address the complexities of agency and responsibility in TCMs.

DigiMinds are minimally direct, minimally directional interfaces, such as virtual avatars in digital spaces, where individuals are separate but can communicate through digital means. UniMinds are low-directional, highly direct interfaces, in which senders can communicate and manipulate neuronal behavior in receivers. This category is further divided into Weak UniMinds, which are collaborative interfaces, and Strong UniMinds, which create an entirely new joint entity. NetMinds, on the other hand, are minimally direct, highly directional tools that facilitate vast networks of collective thinking, such as swarm intelligence applications. Lastly, MacroMinds are maximally direct and maximally directed tools, with multiple participants connected through interfaces that allow direct neuronal transmissions in all directions. This category is also subdivided into Weak MacroMinds, which are collaborative interfaces, and Strong MacroMinds, which create new joint entities.

The authors argue that each of these four categories challenges our current understanding of collective and joint actions, urging a reevaluation of the conceptual and ethical frameworks that guide our thinking. For instance, UniMinds and MacroMinds raise questions about identity, agency, and responsibility when a new entity emerges from the connected individuals. In NetMinds, the role of the computer as an organizer poses challenges concerning responsibility and transparency. The paper suggests that instead of a binary approach, future ethical analyses should consider the technological specifications, the domain in which the TCM is deployed, and the reversibility of joining a Collective Mind.

This research taps into broader philosophical issues surrounding the nature of identity, consciousness, and agency in an increasingly interconnected world. As we move towards a future where technology not only extends our cognitive capabilities but also has the potential to fundamentally reshape our understanding of what it means to be an individual, we are forced to reevaluate our traditional conceptions of personhood, ethics, and responsibility. TCMs challenge the philosophical foundations of agency and responsibility, as well as the ways in which we understand and define collective versus individual actions and decisions.

To further explore the ethical and conceptual challenges of TCMs, future research could delve deeper into the practical implications of integrating these technologies into various aspects of our society, such as healthcare, education, governance, and commerce. Avenues for research might include examining the legal and policy ramifications of TCMs, the potential for power imbalances in such systems, and the implications for privacy and autonomy. Additionally, scholars could investigate how the experience of participating in a TCM might impact our sense of self and our relationships with others. By addressing these areas, we can move towards a more comprehensive understanding of the complex ethical landscape of technologically enabled collective minds and prepare ourselves for the challenges that lie ahead.

Abstract

A growing number of technologies are currently being developed to improve and distribute thinking and decision-making. Rapid progress in brain-to-brain interfacing and swarming technologies promises to transform how we think about collective and collaborative cognitive tasks across domains, ranging from research to entertainment, and from therapeutics to military applications. As these tools continue to improve, we are prompted to monitor how they may affect our society on a broader level, but also how they may reshape our fundamental understanding of agency, responsibility, and other key concepts of our moral landscape.

In this paper we take a closer look at this class of technologies – Technologies for Collective Minds – to see not only how their implementation may react with commonly held moral values, but also how they challenge our underlying concepts of what constitutes collective or individual agency. We argue that prominent contemporary frameworks for understanding collective agency and responsibility are insufficient in terms of accurately describing the relationships enabled by Technologies for Collective Minds, and that they therefore risk obstructing ethical analysis of the implementation of these technologies in society. We propose a more multidimensional approach to better understand this set of technologies, and to facilitate future research on the ethics of Technologies for Collective Minds.
Merging Minds: The Conceptual and Ethical Impacts of Emerging Technologies for Collective Minds

May 8, 2023May 8, 2023

(Featured) Philosophical foundation of the right to mental integrity in the age of neurotechnologies

Andrea Lavazza and Rodolfo Giorgi argue that the development and use of neurotechnology present new challenges to privacy, mental integrity, and autonomy, necessitating a reevaluation of existing ethical frameworks and the introduction of new rights to protect individuals against potential threats to these fundamental aspects of human dignity.

The authors first examine the concept of intentionality, highlighting its importance for understanding the subjective and first-person perspective of mental experiences. They argue that neurotechnology poses a risk to intentionality by potentially manipulating or monitoring individuals’ mental processes. This risk extends to the first-person perspective, as the development of brain-computer interfaces could blur the boundaries between the self and external entities, undermining the sense of ownership and agency that is integral to personal identity.

The paper further discusses the significance of autonomy in moral decision-making and identity-building. Drawing upon moral constructivism, the authors contend that privacy and mental integrity are crucial for individuals to engage in the process of moral self-determination. They assert that neurotechnology has the potential to interfere with this process, leading to misinterpretations of mental states and behaviors, and ultimately hindering individuals’ ability to make autonomous choices and form their own moral judgments.

This research contributes to broader philosophical issues by shedding light on the complex relationship between emerging neurotechnology and fundamental aspects of human nature, such as intentionality, autonomy, and personal identity. It underscores the importance of establishing a right to mental integrity in order to protect these essential elements of human dignity in a world increasingly influenced by advancements in neuroscience and technology.

For future research, it is vital to investigate the ethical and legal implications of the right to mental integrity, delineating its scope and limitations in relation to neurotechnology. This may include examining the potential consequences of different types of interventions, ranging from non-invasive monitoring to direct manipulation of brain states. Additionally, interdisciplinary collaboration between philosophers, neuroscientists, and policymakers will be crucial to developing comprehensive ethical guidelines that address the profound challenges posed by the ongoing development and implementation of neurotechnology in various domains of human life. By bridging these disciplines, we can ensure that the protection of mental integrity remains a central consideration as we navigate the uncharted territory of human-machine interaction.

Abstract

Neurotechnologies broadly understood are tools that have the capability to read, record and modify our mental activity by acting on its brain correlates. The emergence of increasingly powerful and sophisticated techniques has given rise to the proposal to introduce new rights specifically directed to protect mental privacy, freedom of thought, and mental integrity. These rights, also proposed as basic human rights, are conceived in direct relation to tools that threaten mental privacy, freedom of thought, mental integrity, and personal identity. In this paper, our goal is to give a philosophical foundation to a specific right that we will call right to mental integrity. It encapsulates both the classical concepts of privacy and non-interference in our mind/brain. Such a philosophical foundation refers to certain features of the mind that hitherto could not be reached directly from the outside: intentionality, first-person perspective, personal autonomy in moral choices and in the construction of one’s narrative, and relational identity. A variety of neurotechnologies or other tools, including artificial intelligence, alone or in combination can, by their very availability, threaten our mental integrity. Therefore, it is necessary to posit a specific right and provide it with a theoretical foundation and justification. It will be up to a subsequent treatment to define the moral and legal boundaries of such a right and its application.
Philosophical foundation of the right to mental integrity in the age of neurotechnologies

May 8, 2023

(Featured) Artificial intelligence and the doctor–patient relationship expanding the paradigm of shared decision making

Giorgia Lorenzini et al. examine the evolving nature of the doctor-patient relationship in the context of integrating artificial intelligence (AI) into healthcare. They focus on the shared decision-making (SDM) process between doctors and patients, a consensual partnership founded on communication and respect for voluntary choices. The authors argue that the introduction of AI can potentially enhance SDM, provided it is implemented with care and consideration. The paper addresses the communication between doctors and AI and the communication of this interaction to patients, evaluating its potential impact on SDM and proposing strategies to preserve both doctors’ and patients’ autonomy.

The authors explore the communication and autonomy challenges arising from AI integration into clinical practice. They posit that AI’s influence could unintentionally limit doctors’ autonomy by heavily guiding their decisions, which in turn raises questions about the balance of power in the decision-making process. The paper emphasizes the importance of doctors understanding AI’s recommendations and checking for errors while also being competent in working with AI systems. By examining the “black box problem” of AI’s opaqueness, the authors argue that explainability is crucial for fostering the AI-doctor relationship and preserving doctors’ autonomy.

The paper then investigates doctor-patient communication and autonomy within the context of AI integration. The authors argue that in order to promote patients’ autonomy and encourage their participation in SDM, doctors must disclose and discuss AI’s involvement in the clinical evaluation process. They also contend that AI should consider patients’ preferences and unique situations, thus ensuring that their values are respected and that they are able to participate actively in the SDM process.

In relating the research to broader philosophical issues, the authors’ examination of the AI-doctor-patient relationship aligns with questions surrounding the ethical and moral implications of AI in society. As AI increasingly permeates various aspects of our lives, its impact on human autonomy, agency, and moral responsibility becomes a focal point for philosophical inquiry. The paper contributes to this discourse by delving into the specific context of healthcare and the evolving dynamics of the doctor-patient relationship, providing a microcosm for understanding the broader implications of AI integration in human decision-making processes.

As the authors outline the potential benefits and challenges of incorporating AI into the SDM process, future research could investigate the practical implementation of AI in various clinical settings, evaluating the effectiveness of AI-doctor collaboration in promoting SDM. Further research might also address the training and education necessary for medical professionals to adapt to AI integration, ensuring a seamless transition that optimizes patient care. Additionally, exploring methods for incorporating patients’ values into AI algorithms could provide a path to more personalized and autonomy-respecting AI-assisted healthcare.

Abstract

Artificial intelligence (AI) based clinical decision support systems (CDSS) are becoming ever more widespread in healthcare and could play an important role in diagnostic and treatment processes. For this reason, AI-based CDSS has an impact on the doctor–patient relationship, shaping their decisions with its suggestions. We may be on the verge of a paradigm shift, where the doctor–patient relationship is no longer a dual relationship, but a triad. This paper analyses the role of AI-based CDSS for shared decision-making to better comprehend its promises and associated ethical issues. Moreover, it investigates how certain AI implementations may instead foster the inappropriate paradigm of paternalism. Understanding how AI relates to doctors and influences doctor–patient communication is essential to promote more ethical medical practice. Both doctors’ and patients’ autonomy need to be considered in the light of AI.
Artificial intelligence and the doctor–patient relationship expanding the paradigm of shared decision making

May 8, 2023May 8, 2023

(Featured) Mobile health technology and empowerment

Karola V. Kreitmair critically evaluates the notion of empowerment that has become pervasive in the discourse surrounding direct-to-consumer (DTC) mobile health technologies. The author argues that while these technologies claim to empower users by providing knowledge, enabling control, and fostering responsibility, the actual outcome is often not genuine empowerment but merely the perception of empowerment. This distinction has significant implications for individuals who might be seeking to affect behavior change and improve their health and well-being.

The paper meticulously breaks down the concept of empowerment into five key features: knowledgeability, control, responsibility, availability of good choices, and healthy desires. The author presents a thorough review of the evidence related to the efficacy, privacy, and security concerns surrounding the use of m-health technologies. They demonstrate that these technologies, while marketed as empowering tools, often fail to live up to their promises and, in some cases, even contribute to negative health outcomes or exacerbate existing issues such as disordered eating.

The core of the argument lies in the distinction between genuine empowerment and the mere perception of empowerment. The author posits that, rather than fostering true empowerment, DTC m-health technologies often create a psychological illusion of control and knowledgeability. This illusion can lead users to form unrealistic expectations and place undue burden on themselves to effect change when the necessary conditions for change are not met. This “empowerment paradox” ultimately calls into question the purported benefits of DTC m-health technologies and the societal narrative around personal responsibility and control over one’s health.

This paper’s findings resonate with broader philosophical discussions around individual autonomy, agency, and the role of technology in shaping our lives. The empowerment paradox highlights the complex interplay between the individual and the structural factors that shape health outcomes. It raises crucial questions about the ethical implications of profit-driven technologies and the responsibilities of technology developers, marketers, and users in navigating an increasingly technologically-driven healthcare landscape. The insights from this paper contribute to ongoing debates about the nature of empowerment and the limits of individual autonomy in an age where our lives are increasingly mediated by technology.

Future research should focus on the prevalence and consequences of the empowerment paradox in the context of DTC m-health technologies. A deeper understanding of how individuals make decisions around their health in the presence of perceived empowerment could inform the development of more effective and ethically responsible technologies. Additionally, examining the social and cultural factors that influence the marketing and adoption of these technologies may provide insight into how the industry can foster genuine empowerment, rather than perpetuating an illusion of control. Ultimately, a more nuanced understanding of the relationship between DTC m-health technologies and empowerment will pave the way for a more responsible and equitable approach to healthcare in the digital age.

Abstract

Mobile Health (m-health) technologies, such as wearables, apps, and smartwatches, are increasingly viewed as tools for improving health and well-being. In particular, such technologies are conceptualized as means for laypersons to master their own health, by becoming “engaged” and “empowered” “managers” of their bodies and minds. One notion that is especially prevalent in the discussions around m-health technology is that of empowerment. In this paper, I analyze the notion of empowerment at play in the m-health arena, identifying five elements that are required for empowerment. These are (1) knowledge, (2) control, (3) responsibility, (4) the availability of good choices, and (5) healthy desires. I argue that at least sometimes, these features are not present in the use of these technologies. I then argue that instead of empowerment, it is plausible that m-health technology merely facilitates a feeling of empowerment. I suggest this may be problematic, as it risks placing the burden of health and behavior change solely on the shoulders of individuals who may not be in a position to affect such change.
Mobile health technology and empowerment

May 5, 2023

(Featured) Moral distance, AI, and the ethics of care

Carolina Villegas-Galaviz and Kirsten Martin analyze the ethical implications of AI decision-making and suggest the ethics of care as a framework for mitigating its negative impacts. They argue that AI exacerbates moral distance by creating proximity and bureaucratic distance, which lead to a lack of consideration for the needs of all stakeholders. The ethics of care, which emphasizes interdependent relationships, context and circumstances, vulnerability, and voice, can help contextualize the issue and bring us closer to those at a distance. The authors note that this framework can aid in the development of algorithmic decision-making tools that consider the ethics of care.

The authors argue that moral distance arises from proximity and bureaucratic distance. Proximity distance refers to the physical, cultural, and temporal separation between people, while bureaucratic distance refers to hierarchy, complexity, and principle-based decision-making. These types of moral distance are inherent in how AI works, and the authors contend that AI exacerbates them. The authors also suggest that the ethics of care can help mitigate the negative impacts of AI by emphasizing the need for interdependent relationships, contextual understanding, vulnerability, and voice.

The authors argue that the ethics of care is useful in analyzing algorithmic decision-making in AI. They suggest that the ethics of care offers a mechanism for designing and developing algorithmic decision-making tools that consider the needs of all stakeholders. However, they acknowledge that the ethics of care may not be a comprehensive solution to all moral problems or harms.

The paper raises broader philosophical issues about the role of ethics in technology. It highlights the need to consider the ethical implications of technology and the importance of developing ethical frameworks for AI decision-making. The authors suggest that the ethics of care offers a new conversation for the critical examination of AI and underscores the importance of hearing diverse voices and considering the needs of all stakeholders in technology development.

Future research should explore the legal, moral, epistemic, and practical aspects of moral distance and their specific implications. It should also examine the full range of feminist theory and its potential to mitigate the problem of representativeness in the technology workforce. The authors note that interdisciplinary and intercultural teams are essential in developing and deploying AI ethically. Finally, they suggest that a deeper understanding of the ethics of care could have implications for other areas of philosophical inquiry, such as environmental ethics and bioethics.

Abstract

This paper investigates how the introduction of AI to decision making increases moral distance and recommends the ethics of care to augment the ethical examination of AI decision making. With AI decision making, face-to-face interactions are minimized, and decisions are part of a more opaque process that humans do not always understand. Within decision-making research, the concept of moral distance is used to explain why individuals behave unethically towards those who are not seen. Moral distance abstracts those who are impacted by the decision and leads to less ethical decisions. The goal of this paper is to identify and analyze the moral distance created by AI through both proximity distance (in space, time, and culture) and bureaucratic distance (derived from hierarchy, complex processes, and principlism). We then propose the ethics of care as a moral framework to analyze the moral implications of AI. The ethics of care brings to the forefront circumstances and context, interdependence, and vulnerability in analyzing algorithmic decision making.
Moral distance, AI, and the ethics of care

May 5, 2023

(Featured) AI Moral Enhancement: Upgrading the Socio-Technical System of Moral Engagement

Richard Volkman and Katleen Gabriels critically examine current approaches to AI moral enhancement and propose a new model that more closely aligns with the reality of moral progress as a socio-technical system. The paper begins by discussing two main approaches to AI moral enhancement: the exhaustive approach, which aims to program AI systems with complete moral knowledge, and the auxiliary approach, which seeks to use AI as a tool to assist humans in moral decision-making. The authors argue that the exhaustive approach is overly ambitious and unattainable, while the auxiliary approach, as exemplified by Lara and Deckers’ Socratic Interlocutor, lacks the depth and nuance necessary for genuine moral engagement.

Instead, the authors propose an alternative model of AI moral enhancement that emphasizes the importance of moral diversity, ongoing dialogue, and the cultivation of practical wisdom. Their model envisions a modular system of AI “mentors”, each embodying a distinct moral perspective, engaging in conversation with one another and with the user. This system would more accurately represent the complex, evolving socio-technical process of moral progress and would be safer and more effective than the existing proposals for AI moral enhancement.

The authors address potential objections to their proposal, arguing that the goal of moral enhancement should not be to transcend human limitations but to engage more deeply with our moral thinking. They emphasize that their approach to moral enhancement is not aimed at simplifying the process of moral improvement but at making us more skilled in the ways of practical wisdom. They conclude that their proposal represents a path to genuine moral enhancement that is more achievable and less fraught with risk than previous approaches.

This research contributes to broader philosophical discussions about the nature and scope of moral progress, the role of technology in moral enhancement, and the limits of human rationality. By engaging with these issues, the paper not only critiques existing proposals but also highlights the importance of considering the historical, social, and technological dimensions of moral inquiry. In doing so, it raises questions about the extent to which AI can and should be involved in human moral development, and how best to navigate the potential risks and benefits associated with such involvement.

As for future research, several avenues present themselves. First, it would be fruitful to explore the development of these AI “mentors” in more detail, focusing on the technical and ethical challenges associated with creating AI systems that embody diverse moral perspectives. Additionally, empirical studies could be conducted to assess the effectiveness of such AI mentors in promoting moral enhancement among users. Finally, interdisciplinary research could be undertaken to better understand the complex relationship between AI, moral enhancement, and broader social and cultural dynamics, in order to ensure that future AI moral enhancement efforts are both safe and effective.

Abstract

Several proposals for moral enhancement would use AI to augment (auxiliary enhancement) or even supplant (exhaustive enhancement) human moral reasoning or judgment. Exhaustive enhancement proposals conceive AI as some self-contained oracle whose superiority to our own moral abilities is manifest in its ability to reliably deliver the ‘right’ answers to all our moral problems. We think this is a mistaken way to frame the project, as it presumes that we already know many things that we are still in the process of working out, and reflecting on this fact reveals challenges even for auxiliary proposals that eschew the oracular approach. We argue there is nonetheless a substantial role that ‘AI mentors’ could play in our moral education and training. Expanding on the idea of an AI Socratic Interlocutor, we propose a modular system of multiple AI interlocutors with their own distinct points of view reflecting their training in a diversity of concrete wisdom traditions. This approach minimizes any risk of moral disengagement, while the existence of multiple modules from a diversity of traditions ensures pluralism is preserved. We conclude with reflections on how all this relates to the broader notion of moral transcendence implicated in the project of AI moral enhancement, contending it is precisely the whole concrete socio-technical system of moral engagement that we need to model if we are to pursue moral enhancement.
AI Moral Enhancement: Upgrading the Socio-Technical System of Moral Engagement