The Trump administration can blacklist AI firm Anthropic from all Pentagon contracts, a federal appeals court ruled Friday, in a decision that expands the executive branch’s authority to designate U.S. businesses as national security risks.

The D.C. Circuit Court of Appeals ruled 2-1 that the Defense Department had good reason to conclude that the company’s artificial intelligence products pose a supply chain risk to the department and its contractors because the company includes code in its models that restricts them from performing certain tasks. Anthropic has said that it will not allow its products to be used for autonomous weapons or mass domestic surveillance.

“The Department had ample support for its conclusion that the continued integration of Claude into the Department’s information systems, by the Department or its contractors, presented a statutorily covered national-security risk,” the court wrote. “As Anthropic admits, the company encodes restrictions into Claude that prevent the model from performing tasks that Anthropic wishes to prevent.”

  • NotMyOldRedditName@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    2 months ago

    If national security can depend on autonomous decision making and this software refuses it, isn’t that a risk to national security if it’s used?

    What if a supplier uses it without knowledge, and somewhere in the kill command chain it rejects it?

    I think it’s pretty stupid and board because this also impacts things like a contractor writing an email, but the logic that something will refuse a command that can be considered national security seems reasonable?

    This also doesn’t mean we should be doing this, but if we are, then yes it’d be a risk.