Kori Schake on AI in Defense: Risks and Transparency

In a recent appearance on Bloomberg Tech, Kori Schake, Senior Fellow and Director of Defense Policy Studies at the American Enterprise Institute (AEI), discussed the critical role of Artificial Intelligence (AI) in national defense and the inherent challenges in its adoption. Schake, a respected voice in defense policy with extensive experience, argued against the notion of blacklisting or nationalizing AI providers, emphasizing the potential harm such measures could inflict on the defense sector and national security.

The full discussion can be found on Bloomberg Technology's YouTube channel.

Kori Schake's Expertise

Kori Schake brings a wealth of experience to the discussion on defense and technology. Her work at AEI focuses on understanding and shaping defense policy, with a particular interest in the intersection of emerging technologies and national security. Her background includes advisory roles and extensive research on military strategy, alliances, and the future of warfare, making her insights particularly valuable in understanding the complexities of AI integration within the Department of Defense (DoD).

The Perils of Blacklisting AI Providers

Schake directly addressed the idea of barring certain AI providers from defense contracts, particularly those from countries like China. She stated, "The idea that you could nationalize or blacklist a leading American company is outrageous and it's going to discourage other leading edge tech firms from being willing to expose their business by participating in the defense ecosystem." This perspective highlights the potential for such a move to stifle innovation and create a chilling effect on domestic technology companies that could otherwise contribute to national security capabilities. By imposing such restrictions, the DoD risks alienating crucial partners and limiting its access to cutting-edge AI solutions.

The Need for Transparency in Defense AI

A central theme of Schake's argument was the critical need for transparency in how AI is developed and deployed within the defense sector. She emphasized the difficulty in assessing the risks associated with AI without clear visibility into its underlying mechanisms and data. "It's an open question... where AI is now... we do not want it to be used for domestic surveillance... or for predatory use of the law," Schake remarked, underscoring the ethical and security implications. The lack of transparency can lead to a situation where the government is unaware of the full capabilities and potential biases of the AI systems it relies upon, creating vulnerabilities.

Congressional Action and Indemnification

Schake advocated for legislative action to address these transparency concerns. She suggested that Congress should establish clearer guidelines and potentially mandate certain levels of transparency in defense AI contracts. "What Congress really runs defense policy and can legislate in this space... is to suggest that companies on the cutting edge of AI are being transparent and that their product is being used as we are advertising its product," she stated. Furthermore, she highlighted the importance of indemnification: "We need proof and we need indemnification that our product is being used as we are advertising its product." This would ensure that companies are accountable for how their AI technologies are utilized and provide the government with recourse if the AI is misused or fails to perform as expected.

AI's Value in National Security

Despite the challenges, Schake acknowledged the immense value AI brings to national security. She pointed out that AI's ability to process vast amounts of data and identify patterns is invaluable for threat assessment and intelligence gathering. "AI is proving incredibly valuable for the defense space, surveying enormous amounts of data and for example, identifying threat portfolios," she explained. This capability is essential for understanding complex geopolitical landscapes and anticipating potential conflicts. The ability to sift through and analyze data at a scale far beyond human capacity is a key advantage offered by AI.

Building Confidence in Defense AI

Ultimately, Schake stressed the importance of building trust and confidence in AI systems within the defense establishment. She argued that the DoD needs to move beyond simply adopting AI to understanding and validating its effectiveness and ethical implications. "And those are not unreasonable standards. And they provide the basis for what Congress perhaps ought to put into law and until we have better transparency and understanding of what these models are capable of, we do not want it to be used for domestic surveillance... or for predatory use of the law," she concluded. Establishing clear standards and ensuring that AI deployments align with ethical principles and legal frameworks are paramount for the responsible integration of this transformative technology into national defense.