An AI weapons scanning company has retracted claims that its technology was tested by the UK government.
Evolv Technology makes “intelligent” scanners designed to replace metal detectors by identifying people carrying concealed guns, knives and bombs.
But the company has come under increasing criticism for overstating what its technology can accomplish.
Evolve told BBC News it had changed its claims about the UK test to “better reflect the process that was undertaken”.
The US Federal Trade Commission (FTC) is investigating the company’s “marketing practices.” The Securities and Exchange Commission (SEC) launched an investigation into the company last month.
Evolv scanners are used at Manchester Arena, as well as many large stadiums and hundreds of schools in the United States.
The company said its AI weapons scanner had been tested by the UK government’s National Protection and Security Agency (NPSA).
On February 20th, the company issued a press release stating that after numerous tests, the NPSA “concluded that the Evolv Express solution is highly effective at detecting firearms and many other types of weapons.” It contained a claim that it was one of the
However, BBC News can reveal that the NPSA does not conduct this type of testing.
When BBC News brought this to Evolv’s attention, the company said: “Following consultation with the NPSA, we have updated the language used in our February 20 press release to better reflect the process adopted. I did,” he said.
Instead, it said, an independent company “tested and validated” Evolv’s technology using NPSA standards.
However, British company Metrics NDT, which carried out the test, told BBC News: “It would be incorrect to say that we have ‘validated’ the system.”
“Strict scrutiny”
Metrix NDT managing director Nick Fox told BBC News that Evolv’s system has actually been tested to NPSA specifications.
But when asked whether he felt Metric NDT was “very effective at detecting firearms and many other types of weapons,” he said, “It’s not within our power to make value judgments about the results.” It’s not within the range.”
Evolv told the BBC that in addition to these results, it provides serious potential customers with a full third-party test report on detection performance.
Professor Marion Oswald, who until last year served on the advisory board of the government’s Data Ethics Innovation Center, told BBC News she was concerned that the technology would displace “proven” security options.
“This highlights the need for very tight scrutiny and potential additional regulation of companies making these types of claims,” she told BBC News.
And she worried about how customers would be affected, “especially if allegations were made about how certain government agencies were involved.”
Evolv has previously said its technology detects “signatures” of hidden weapons.
“The composition of the metal, the shape, the fragmentation of the metal, we have tens of thousands of these signatures for every weapon out there,” CEO Peter George said in 2021. . “Every gun, every bomb, every big tactical knife.”
However, the company has faced criticism over its inability to reliably detect knives and bombs. Evolv says it can currently detect “many types of knives and some explosives.”
In 2022, following a Freedom of Information request by security analysis firm Internet Protocol Video Market (IPVM), BBC News reported that in tests at a US facility, Evolv’s technology consistently killed knives and certain types of bombs. It was revealed that it was found to be undetectable.
Evolv should notify potential customers, testers said.
However, during that investigation, in August 2022, Evolv also told BBC News that the NPSA (then called the National Infrastructure Protection Center CPNI) had tested the system. “We carried out the tests together with the UK CPNI,” a representative told BBC News.
“We would like to further understand the capabilities of weapons detection devices,” an Interior Ministry official said.
Evolv also revised another claim in a Feb. 20 press release. Evolv initially cited the designation of its technology under the Department of Homeland Security (DHS) law as an example of recent “third-party testing.”
This was later changed to reflect the fact that this designation did not pertain to the implementation of a new test by DHS, but rather an evaluation of other evidence.
Last May, BBC News revealed further details of a stabbing at a New York school using an Evolv scanner.
Proctor High School’s then-superintendent Brian Nolan said in a statement that “our investigation determined that the Evolv weapon detection system…was not designed to detect knives.”
The victim sued Evolv, and the scanner was replaced with 10 metal detectors.
“I deeply regret it.”
The company has changed the front of its website many times.
Initially claiming its purpose was to create a “weapons-free zone,” its website now says its mission is to create a “safer experience.”
The company said last year that it regretted confusion about the functionality of its technology.
“We believe wholeheartedly in our technology and mission, and we deeply regret any statements we have made in the past that have caused confusion or generalized our capabilities at the time.” .
But questions remain about how Evolv has explained the potential of its technology to customers and the testing it has undergone.
