{"id":11320,"date":"2026-05-13T17:42:22","date_gmt":"2026-05-13T17:42:22","guid":{"rendered":"https:\/\/sawahsolutions.com\/range\/west-pointers-can-be-trained-to-better-evaluate-appreciate-ai-study-finds\/"},"modified":"2026-05-13T17:42:22","modified_gmt":"2026-05-13T17:42:22","slug":"west-pointers-can-be-trained-to-better-evaluate-appreciate-ai-study-finds","status":"publish","type":"post","link":"https:\/\/sawahsolutions.com\/range\/west-pointers-can-be-trained-to-better-evaluate-appreciate-ai-study-finds\/","title":{"rendered":"West Pointers can be trained to better evaluate, appreciate AI, study finds"},"content":{"rendered":"
\n

Although Americans generally trust AI less than, say, Chinese people, they are often willing to accept a chatbot\u2019s wrong answers. As Pentagon leaders push broader use of such tools, a new paper offers some reassuring news: West Point cadets can be trained to be more appropriately skeptical of AI\u2019s output\u2014while remaining broadly optimistic about its potential.\u00a0\u00a0<\/p>\n

Researchers from Georgetown University, the University of Pennsylvania, and the U.S. Military Academy published a paper last week comparing 236 West Point cadets to a demographically similar sample of 702 members of the public. The paper explores automation bias\u2014<\/em>humans\u2019 tendency to over-rely on automation\u2014and algorithm aversion<\/em>, an inclination to \u201cprematurely distrust automated outputs in ways that increase the risk of accidents or mistakes.\u201d<\/p>\n

One hypothesis they sought to test was that the pressures of battle would make military members would be more inclined to trust faulty outputs from a decision-support system, or DSS.<\/p>\n

\u201cMajor powers such as the United States, China, and Russia are experimenting with integrating AI DSS into their command structures, thereby decreasing their sensor-to-shooter timelines,\u201d they write. This might lead officers \u201cto delegate decision-making authority to AI DSS.\u201d<\/p>\n

The military has long grappled with AI-enabled decision assistants. But the recent arrival of large language models like ChatGPT, Claude, and Gemini led West Point to declare a special academic focus for the 2024-25 school year:\u00a0 \u201cThe Human and the Machine: Leadership on the Emerging Battlefield.\u201d<\/p>\n

This and other efforts seemed to work. In the study, West Pointers demonstrated \u201cAI knowledge scores\u201d nearly twice as high as the general public, and were less than half as likely to commit an automation bias error\u2014that is, to trust a mistaken chatbot.<\/p>\n

Cadets were also more likely to assess AI output by looking at the tool\u2019s own confidence indicators, something few regular users do.<\/p>\n

\u201cThese findings align with the way the USMA seeks to train cadets so they can achieve justified confidence, that is, to be properly calibrated so their expectations of an AI system\u2019s accuracy match the reality of the accuracy of the system,\u201d the researchers wrote.<\/p>\n

In the study, about twice as many cadets expressed worry about the dangerous consequences of AI than did members of the public, but they were much less likely to describe AI as \u201csinister.\u201d\u00a0<\/p>\n

Cadets were also more enthusiastic about the potential of the technology: 87.7 percent saw strong beneficial applications for AI compared to 72.5 percent of the public, while 79.5 percent described it as \u201cexciting,\u201d versus 61.6 percent of the public.<\/p>\n

UPenn\u2019s Michael C. Horowitz, a former deputy assistant defense secretary for force development and emerging capabilities, told Defense One<\/em> that the study \u201cshows what some of the opportunities might look like for further training within the U.S. military at least. This suggests that training to reduce the risk of automation bias for military personnel using artificial intelligence could be effective.\u201d<\/p>\n

Horowitz noted that cadets\u2019 training is \u201cprobably not representative of the average military right now, but it shows the path forward, at least for the U.S. military.\u201d<\/p>\n

Such training might also benefit the U.S. public, which might soothe the worries of technologists and leaders who say Americans\u2019 declining trust in AI, compared to populations in China, is a national security concern.\n\n<\/svg><\/p>\n<\/div>\n