> Artificial general intelligence will not only complicate existing geopolitical dynamics; it will also present novel national security challenges. Imagine an unprecedented AI-enabled cyberattack that wreaks havoc on financial institutions, private corporations, and government agencies and shuts down physical systems ranging from critical infrastructure to industrial robotics. In today’s world, determining who is responsible for cyberwarfare is already a challenging and time-intensive task. Any number of state and nonstate actors possess both the means and motivations to carry out destabilizing attacks. In a world with increasingly advanced AI, however, the situation would be even more complex. Policymakers would have to contemplate not only the possibility that an operation of this scale might be the prelude to a military campaign but also that it might be the work of an autonomous, self-replicating AI agent.
> Planning for this scenario requires evaluating how today’s capabilities can handle tomorrow’s challenges. Governments cannot rely on present-day tools and techniques to quickly and confidently assess a threat, let alone apply relevant countermeasures. Given AI systems’ proven capacity to deceive and dissemble, current systems may be unable to determine whether an AI agent is operating on its own or at the behest of an adversary. Planners need to find new ways to assess its motivations and how to deter escalation.
> Preparing for the worst requires reevaluating “attribution agnostic” steps to harden cyberdefenses, isolate potentially compromised data centers, and prevent the incapacitation of drones or connected vehicles. Planners need to assess whether current military and continuity of operations protocols can handle threats from adversarial AI. Public distrust of the government and technology companies will make it even more difficult to reassure a worried populace in the event of artificial intelligence–fueled misinformation. Given that an autonomous AI agent is not likely to respect national boundaries, adequate preparations would involve setting up channels with partners and adversaries alike to coordinate an effective international response.
Veraticus on
This seems to misunderstand the capabilities of LLMs.
Alarmed_Crazy_6620 on
What might save us, me, and you is that the robots love their children too
3 Comments
> Artificial general intelligence will not only complicate existing geopolitical dynamics; it will also present novel national security challenges. Imagine an unprecedented AI-enabled cyberattack that wreaks havoc on financial institutions, private corporations, and government agencies and shuts down physical systems ranging from critical infrastructure to industrial robotics. In today’s world, determining who is responsible for cyberwarfare is already a challenging and time-intensive task. Any number of state and nonstate actors possess both the means and motivations to carry out destabilizing attacks. In a world with increasingly advanced AI, however, the situation would be even more complex. Policymakers would have to contemplate not only the possibility that an operation of this scale might be the prelude to a military campaign but also that it might be the work of an autonomous, self-replicating AI agent.
> Planning for this scenario requires evaluating how today’s capabilities can handle tomorrow’s challenges. Governments cannot rely on present-day tools and techniques to quickly and confidently assess a threat, let alone apply relevant countermeasures. Given AI systems’ proven capacity to deceive and dissemble, current systems may be unable to determine whether an AI agent is operating on its own or at the behest of an adversary. Planners need to find new ways to assess its motivations and how to deter escalation.
> Preparing for the worst requires reevaluating “attribution agnostic” steps to harden cyberdefenses, isolate potentially compromised data centers, and prevent the incapacitation of drones or connected vehicles. Planners need to assess whether current military and continuity of operations protocols can handle threats from adversarial AI. Public distrust of the government and technology companies will make it even more difficult to reassure a worried populace in the event of artificial intelligence–fueled misinformation. Given that an autonomous AI agent is not likely to respect national boundaries, adequate preparations would involve setting up channels with partners and adversaries alike to coordinate an effective international response.
This seems to misunderstand the capabilities of LLMs.
What might save us, me, and you is that the robots love their children too