San Francisco bans government use of facial recognition technology
Yesterday, San Francisco became the first major city in the United States to ban government use of facial recognition technology. The Stop Secret Surveillance Ordinance passed in an 8-1 vote. A second vote next week is expected to be a formality. The ordinance prevents city agencies, including the police department, from using facial recognition technology, or information from other systems that use the technology. [Kate Conger, Richard Fausset, and Serge F. Kovaleski / New York Times]
The ban comes as the use of facial recognition technology by government agencies and companies becomes more common in the U.S. and around the world. A number of local and state police departments use the technology as does U.S. Customs and Border Protection, at many airports and other ports of entry. (San Francisco’s ordinance will not cover federal agencies, including at airports and ports.) Recent reporting by NBC News looked at how facial recognition, rather than being reserved for the most serious cases, has become a routine policing tool. One study estimates that 1 in 4 U.S. police agencies have access to systems that allow them to tap into vast databases to run facial recognition searches. [Jon Schuppe / NBC News]
There has been growing concern about the technology’s potential for error, abuse, and widespread surveillance. Last year, the ACLU tested Amazon’s Rekognition software, by building a database of 25,000 publicly available arrest photos and comparing photos of members of Congress against the database. The software misidentified 28 members of Congress as present in the database. Forty percent of the representatives who were misidentified were people of color (though people of color make up only 20 percent of Congress), including civil rights hero Representative John Lewis of Georgia.
In January, MIT researchers published a study that found that Rekognition, which Amazon has aggressively marketed to police departments and ICE, had a high error rate in identifying the gender of female faces and darker-skinned faces. Rekognition’s error rate was higher than that of comparable technology from Microsoft and IBM, whose own high error rates had been the subject of previous study that led the companies to release more accurate technology. [Natasha Singer / New York Times]
Amazon has marketed Rekognition to police departments and ICE despite concerns about inaccuracy, particularly with respect to misidentification of people of color and women. Recently, Microsoft asked governments in the U.S. and elsewhere to move forward with comprehensive regulation, in a statement from the company’s president that warned of “a commercial race to the bottom, with tech companies forced to choose between social responsibility and market success.”
But accuracy is only one of the concerns. The use of facial recognition technology along with mass surveillance has enormous implications for privacy. As Nathan Sheard of the Electronic Frontier Foundation wrote yesterday, alluding to the use of real-time facial recognition technology, “we are at a precipice where this technology could soon be used to track people in real-time. This would place entire communities of law-abiding residents into a perpetual line-up, as they attend worship, spend time with romantic partners, attend protests, or simply go about their daily lives.” [Nathan Sheard / Electronic Frontier Foundation]
Cities are leading the fight to take back power over surveillance technology. In California, Oakland is on track to pass a ban on facial recognition technology that is similar to San Francisco’s. (Like San Francisco’s, Oakland’s ban would not prohibit private use of the technology.) Oakland already requires a public approval process for any new surveillance technology. Both cities’ police departments do not use facial recognition software but, as Sarah Holder and Tanvi Misra write in City Lab, “preemptively prohibiting the technology fits into a broader effort to establish San Francisco and Oakland as ‘digital sanctuaries’—places where government data collecting and sharing is underpinned by transparency, accountability, and equity.” [Sarah Holder and Tanvi Misra / City Lab]
San Francisco’s ordinance still permits private individuals to share tips with law enforcement, as long as agencies do not actively seek information that they know comes from facial recognition systems. Agencies must ask how information was obtained. A legislative aide to Aaron Peskin, the ordinance’s lead sponsor, told Wired that this would allow the city to track unintended consequences. “If there’s a huge uptick, then that might mean we’re shoving facial recognition into a less-regulated private sector,” he said. [Gregory Barber / Wired]
While San Francisco and Oakland, and California as a whole, are at the forefront of the fight for power in regulating surveillance, cities across the country are stepping up to regulate government use of these tools. In Somerville, Massachusetts, the City Council appears likely to pass a ban similar to San Francisco’s. [Gregory Barber / Wired]
A local Oakland privacy advocate told Holder and Misra why the city, and the Bay Area at large, has a particular responsibility when it comes to surveillance technology. “We’re where all this technology is being developed,” he said. “I think it’s important that—in the home of technology—that we establish these rules and guidelines.” [Sarah Holder and Tanvi Misra / City Lab]
|