No Access

Automation Bias in Intelligent Time Critical Decision Support Systems

Mary Cummings

Mary Cummings

Massachusetts Institute of Technology

Search for more papers by this author

Session: IS-15: Human Interaction with Intelligent Systems

Published Online:19 Jun 2012https://doi.org/10.2514/6.2004-6313

See PDF for references

Cited by
- The impact of AI errors in a human-in-the-loop process
  7 January 2024 | Cognitive Research: Principles and Implications, Vol. 9, No. 1
- The fine line between automation and augmentation in website usability evaluation
  2 May 2024 | Scientific Reports, Vol. 14, No. 1
- Eye tracking insights into physician behaviour with safe and unsafe explainable AI recommendations
  2 August 2024 | npj Digital Medicine, Vol. 7, No. 1
- Addressing Human Factors Related to Artificial Intelligence Integrated Visual Cueing
  21 Oct 2024
- Health AI needs meaningful human involvement: lessons from war
  16 October 2024 | Nature Medicine, Vol. 42
- Bias in Using AI for Recruiting: Legal Considerations
  14 December 2023 | Information Systems Management, Vol. 41, No. 4
- The Efficiency-Accountability Tradeoff in AI Integration: Effects on Human Performance and Over-Reliance
  1 Oct 2024 | Computers in Human Behavior: Artificial Humans, Vol. 10
- Trustworthy Artificial Intelligence in Dentistry: Learnings from the EU AI Act
  23 September 2024 | Journal of Dental Research, Vol. 103, No. 11
- Human-Artificial Intelligence Teaming for the U.S. Navy: Developing a Holistic Research Roadmap
  29 August 2024 | Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 68, No. 1
- AI hype as a cyber security risk: the moral responsibility of implementing generative AI in business
  23 February 2024 | AI and Ethics, Vol. 4, No. 3
- The rationality of explanation or human capacity? Understanding the impact of explainable artificial intelligence on human-AI trust and decision performance
  1 Jul 2024 | Information Processing & Management, Vol. 61, No. 4
- Requirements modeling of resilience-aware human-on-the-loop PNT of multiple UASs
  6 Jun 2024
- Human control of AI systems: from supervision to teaming
  28 May 2024 | AI and Ethics, Vol. 31
- Cognitive Biases in Fact-Checking and Their Countermeasures: A Review
  1 May 2024 | Information Processing & Management, Vol. 61, No. 3
- Ethical decision-making in human-automation collaboration: a case study of the nurse rostering problem
  3 April 2024 | AI and Ethics, Vol. 53
- A comparative user study of human predictions in algorithm-supported recidivism risk assessment
  15 March 2024 | Artificial Intelligence and Law, Vol. 104
- Bending the Automation Bias Curve: A Study of Human and AI-Based Decision Making in National Security Contexts
  1 April 2024 | International Studies Quarterly, Vol. 68, No. 2
- Fairness of artificial intelligence in healthcare: review and recommendations
  4 August 2023 | Japanese Journal of Radiology, Vol. 42, No. 1
- User Friendly and Adaptable Discriminative AI: Using the Lessons from the Success of LLMs and Image Generation Models
  1 January 2024 | SSRN Electronic Journal, Vol. 49
- An (E)Affective Bind: Situated Affectivity and the Prospect of Affect Recognition
  1 Jan 2024 | IEEE Transactions on Affective Computing, Vol. 15, No. 1
- FDA regulation of anesthesia and critical care medical devices
  1 Jan 2024
- Exporing the Relevance of UX in a Machine-Dominated Iot Landscape: Is It Becoming Obsolete?
  1 June 2024
- Introduction
  3 August 2024
- Legally-Salient Variables for AWS
  3 August 2024
- Automated Decision-Making in the Public Sector: A Multidisciplinary Literature Review
  21 August 2024
- Der Mensch im Mittelpunkt: Einblick in die Gestaltung Menschenzentrierter Künstlicher Intelligenz
  19 September 2024
- Human–machine collaboration for enhanced decision-making in governance
  2 December 2024 | Data & Policy, Vol. 6
- ABCs: Differentiating Algorithmic Bias, Automation Bias, and Automation Complacency
  18 May 2023
- Understanding the Effects of Personalized Recommender Systems on Political News Perceptions: A Comparison of Content-Based, Collaborative, and Editorial Choice-Based News Recommender System
  4 May 2023 | Journal of Broadcasting & Electronic Media, Vol. 151
- Automation Bias in Breast AI
  1 May 2023 | Radiology, Vol. 307, No. 4
- Rams, hounds and white boxes: Investigating human–AI collaboration protocols in medical diagnosis
  1 Apr 2023 | Artificial Intelligence in Medicine, Vol. 138
- The Switch, the Ladder, and the Matrix: Models for Classifying AI Systems
  4 January 2023 | Minds and Machines, Vol. 33, No. 1
- Auditor Judgment Bias Research: A 50-Year Trend Analysis and Emerging Technology Use
  4 April 2023 | Journal of Information Systems, Vol. 37, No. 1
- Recommending Ourselves to Death: Values in the Age of Algorithms
  4 August 2023
- Defining the Relationship Between the Level of Autonomy in a Computer and the Cognitive Workload of Its User
  24 August 2023
- Delegation of Administrative Powers to AI Systems
  15 January 2023
- The Divergence of Auditors’ Stated Risk Assessments and Planned Audit Responses to Clients’ Use of Artificial Intelligence
  1 January 2023 | SSRN Electronic Journal, Vol. 101
- Algorithms and Influence Artificial Intelligence and Crisis Decision-Making
  7 October 2022 | International Studies Quarterly, Vol. 66, No. 4
- Delegating strategic decision-making to machines: Dr. Strangelove Redux?
  30 April 2020 | Journal of Strategic Studies, Vol. 45, No. 3
- The ethics of algorithms: key problems and solutions
  20 February 2021 | AI & SOCIETY, Vol. 37, No. 1
- Algorithmic Sentencing
  17 Feb 2022
- YAPAY ZEKÂ ALGORİTMALARININ ANONİM ORTAKLIKLARDA ALINAN STRATEJİK KARARLAR BAKIMINDAN YÖNETİM KURULUNA SAĞLAYABİLECEĞİ OLASI KATKILAR
  1 February 2022 | Ankara Hacı Bayram Veli Üniversitesi Hukuk Fakültesi Dergisi
- Organization Routines in Next Generation Manufacturing
  26 August 2022
- Paradoxien der Digitalisierung von Organisationen
  31 March 2022
- Kognitive Irrtümer in der Arbeitswelt
  9 June 2022
- Technical, Ethical, Legal, and Societal Challenges With Digital Twin Systems for the Management of Chronic Diseases in Children and Young People
  31 October 2022 | Journal of Medical Internet Research, Vol. 24, No. 10
- Fair Governance with Humans and Machines
  1 Jan 2022 | SSRN Electronic Journal
- Trust, Automation Bias and Aversion: Algorithmic Decision-Making in the Context of Credit Scoring
  30 Dec 2021 | Interdisciplinary Description of Complex Systems, Vol. 19, No. 4
- Emergence of network effects and predictability in the judicial system
  2 February 2021 | Scientific Reports, Vol. 11, No. 1
- AI-based Models for Resource Allocation and Resource Demand Forecasting Systems in Aviation: A Survey and Analytical Study
  23 Nov 2021
- Toward Human–Autonomy Teaming in Single-Pilot Operations: Domain Analysis and Requirements
  Güliz Tokadlı,
  Michael C. Dorneich and
  Michael Matessa
  6 July 2021 | Journal of Air Transportation, Vol. 29, No. 4
- Regulating human control over autonomous systems
  20 July 2020 | Regulation & Governance, Vol. 15, No. 4
- Guidelines for Assessing and Minimizing Risks of Emotion Recognition Applications
  28 Sep 2021
- Ethics-Based Auditing of Automated Decision-Making Systems: Nature, Scope, and Limitations
  6 July 2021 | Science and Engineering Ethics, Vol. 27, No. 4
- A conceptual framework for establishing trust in real world intelligent systems
  1 Aug 2021 | Cognitive Systems Research, Vol. 68
- How machine-learning recommendations influence clinician treatment selections: the example of antidepressant selection
  4 February 2021 | Translational Psychiatry, Vol. 11, No. 1
- In‐the‐loop or on‐the‐loop? Interactional arrangements to support team coordination with a planning agent
  6 March 2017 | Concurrency and Computation: Practice and Experience, Vol. 33, No. 8
- Mind Wandering Influences EEG Signal in Complex Multimodal Environments
  1 April 2021 | Frontiers in Neuroergonomics, Vol. 2
- ‘Catalytic nuclear war’ in the age of artificial intelligence & autonomy: Emerging military technology and escalation risk between nuclear-armed states
  13 January 2021 | Journal of Strategic Studies, Vol. 3
- Disparate Impact Diminishes Consumer Trust Even for Advantaged Users
  23 June 2021
- Technology as Terrorism: Police Control Technologies and Drone Warfare
  15 December 2021
- The Ethics of Algorithms: Key Problems and Solutions
  3 November 2021
- Progressive Disclosure
  16 October 2020 | ACM Transactions on Interactive Intelligent Systems, Vol. 10, No. 4
- Overview of machine learning and its adaptability in mechanical engineering
  1 Nov 2020 | Materials Today: Proceedings, Vol. 61
- Micro-entries: Encouraging Deeper Evaluation of Mental Models Over Time for Interactive Data Systems
  1 Oct 2020
- Datafied child welfare services: unpacking politics, economics and power
  14 February 2020 | Policy Studies, Vol. 41, No. 5
- Human-Autonomy Teaming for Critical Command and Control Functions
  1 Sep 2020
- A Framework on Division of Work Tasks between Humans and Robots in the Home
  27 July 2020 | Multimodal Technologies and Interaction, Vol. 4, No. 3
- A Case for Humans-in-the-Loop: Decisions in the Presence of Erroneous Algorithmic Scores
  23 April 2020
- Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making
  22 January 2020
- Autonomous Agents in the Wild: Human Interaction Challenges
  28 November 2019
- Predictive Policing in 2025: A Scenario
  18 July 2020
- The Ethics of Algorithms: Key Problems and Solutions
  1 Jan 2020 | SSRN Electronic Journal, Vol. 20
- Algorithmic Decision-Making and the Control Problem
  11 December 2019 | Minds and Machines, Vol. 29, No. 4
- Lethal Autonomous Weapons: Meaningful Human Control or Meaningful Human Certification? [Opinion]
  1 Dec 2019 | IEEE Technology and Society Magazine, Vol. 38, No. 4
- The Impact of Increasing Autonomy on Training Requirements in a UAV Supervisory Control Task
  12 August 2019 | Journal of Cognitive Engineering and Decision Making, Vol. 13, No. 4
- I can do better than your AI
  17 March 2019
- Progressive disclosure
  17 March 2019
- Mitigating the Attraction Effect with Visualizations
  1 Jan 2019 | IEEE Transactions on Visualization and Computer Graphics, Vol. 25, No. 1
- Risk Profiling by Law Enforcement Agencies in the Big Data Era: Is There a Need for Transparency?
  16 April 2019
- Regulating for 'Normal AI Accidents'
  27 December 2018
- The fallacy of inscrutability
  15 October 2018 | Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 376, No. 2133
- Changes in driver glance behavior when using a system that automates steering to perform a low-speed parallel parking maneuver
  1 Oct 2018 | Transportation Research Part F: Traffic Psychology and Behaviour, Vol. 58
- The soldier’s tolerance for autonomous systems
  11 July 2018 | Paladyn, Journal of Behavioral Robotics, Vol. 9, No. 1
- Automated production of audiovisual informative content
  1 Jun 2018
- Activity Theory as a Framework to Analyze Technology-Mediated Elderly Care
  9 October 2017 | Mind, Culture, and Activity, Vol. 25, No. 1
- Development of a Functionality Matrix for a Cognitive Assistant on Long Distance Space Missions
  28 September 2017 | Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 61, No. 1
- Towards a Clinical Support System for the Early Diagnosis of Sepsis
  14 May 2017
- AI and the Automation of Wisdom
  27 October 2017
- System Architecture for Personalized Automatic Audio-Visual Content Generation from Web Feeds to an iTV Platform
  13 July 2017
- Unmanned aerial systems (UAS) operators’ accuracy and confidence of decisions: Professional pilots or video game players?
  22 May 2017 | Cogent Psychology, Vol. 4, No. 1
- Automated Decision-Making and Big Data: Concerns for People With Mental Illness
  25 October 2016 | Current Psychiatry Reports, Vol. 18, No. 12
- Do-it-yourself services and work-like chores: on civic duties and digital public services
  14 June 2016 | Personal and Ubiquitous Computing, Vol. 20, No. 4
- Artificial Intelligence and Space Robotics: Questions of Responsibility
  9 Mar 2016
- Development of a Recognition Primed Decision Agent for supervisory control of autonomy
  1 Mar 2016
- Towards Modeling the Behavior of Autonomous Systems and Humans for Trusted Operations
  8 April 2016
- Human Supervisory Control of Robotic Teams: Integrating Cognitive Modeling with Engineering Design
  1 Dec 2015 | IEEE Control Systems, Vol. 35, No. 6
- Influencing Trust for Human–Automation Collaborative Scheduling of Multiple Unmanned Vehicles
  9 June 2015 | Human Factors: The Journal of the Human Factors and Ergonomics Society, Vol. 57, No. 7
- Representing multi-national rules of engagement using ontologies and rules as constraints for courses of action
  1 May 2015
- Verifying Correctness of Information in Flight-Deck User Interface using Hybrid System Observability
  Bongjun Yang,
  Padmanabhan K. Menon and
  Inseok Hwang
  2 January 2015
- Responsibility and War Machines
  1 Jan 2015
- Human Factors Perspective on Next Generation Unmanned Aerial Systems
  9 August 2014
- Task Versus Vehicle-Based Control Paradigms in Multiple Unmanned Vehicle Supervision by a Single Operator
  1 Jun 2014 | IEEE Transactions on Human-Machine Systems, Vol. 44, No. 3
- Customization bias in decision support systems
  26 April 2014
- Drivers’ Mental Workload In Agricultural Semi-Autonomous Vehicles
  30 September 2013 | Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 57, No. 1
- Human–Automation Collaboration in Occluded Trajectory Smoothing
  1 Mar 2013 | IEEE Transactions on Human-Machine Systems, Vol. 43, No. 2
- Managing Information for Real-Time Decision Support at Community Level
  1 Jan 2013 | International Journal of Information Communication Technologies and Human Development, Vol. 5, No. 1
- An Approach to Multi‐Criteria Decision Problems Under Severe Uncertainty
  25 March 2013 | Journal of Multi-Criteria Decision Analysis, Vol. 20, No. 1-2
- Operator Object Function Guidance for a Real-Time Unmanned Vehicle Scheduling Algorithm
  Andrew S. Clare ,
  Mary L. Cummings ,
  Jonathan P. How ,
  Andrew K. Whitten and
  Olivier Toupet
  10 January 2013 | Journal of Aerospace Computing, Information, and Communication, Vol. 9, No. 4
- Development and Evaluation of an Automated Path Planning Aid
  Robert Watts ,
  H. Claus Christmann ,
  Eric N. Johnson ,
  Karen Feigh and
  Panagiotis Tsiotras
  6 December 2012 | Journal of Aircraft, Vol. 49, No. 6
- Human-automated path planning optimization and decision support
  1 Feb 2012 | International Journal of Human-Computer Studies, Vol. 70, No. 2
- Automation bias: a systematic review of frequency, effect mediators, and mitigators
  1 January 2012 | Journal of the American Medical Informatics Association, Vol. 19, No. 1
- Participatory design for computerization of clinical practice guidelines
  1 Oct 2011 | Journal of Biomedical Informatics, Vol. 44, No. 5
- Computing the Effects of Operator Attention Allocation in Human Control of Multiple Robots
  1 May 2011 | IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, Vol. 41, No. 3
- Supporting intelligent and trustworthy maritime path planning decisions
  1 Oct 2010 | International Journal of Human-Computer Studies, Vol. 68, No. 10
- The Design of a HSMM-Based Operator State Modeling Display
  Ryan Castonia,
  Yves Boussemart and
  Mary Cummings
  14 June 2012
- Predictive Model for Human-Unmanned Vehicle Systems
  Jacob W. Crandall ,
  M. L. Cummings and
  Carl E. Nehme
  23 May 2012 | Journal of Aerospace Computing, Information, and Communication, Vol. 6, No. 11
- Pilot feedback for an automated planning aid system in the cockpit
  1 Oct 2009
- Context-Aware Team Task Allocation to Support Mobile Police Surveillance
  1 Jan 2009
- Why Are People’s Decisions Sometimes Worse with Computer Support?
  1 Jan 2009
- Operator scheduling strategies in supervisory control of multiple UAVs
  1 May 2007 | Aerospace Science and Technology, Vol. 11, No. 4
- Collaborative Human-Computer Decision Support for Planetary Surface Traversal
  Jessica Marquez,
  M. Cummings,
  Nicholas Roy,
  Maithilee Kunda and
  Dava Newman
  15 June 2012
What's Popular

Automation Bias in Intelligent Time Critical Decision Support Systems

What's Popular

Topics