
Four Maryland high school students sue after AI mistakes Doritos bag for gun
Football players say they are âÂÂtraumatizedâ after being handcuffed and detained by police while waiting for rides home
Four current and former students at a Maryland high school have filed a lawsuit a year after armed police detained them, prompted by an AI alert that mistook a bag of Doritos for a gun, in an incident that left them âÂÂfearing for their livesâÂÂ.
The plaintiffs sued Omnilert, the company behind the AI gun-detection system, Baltimore county police, the board of education, individual officers and the school principal, alleging unlawful detention and search because of technological and human errors.
âÂÂThese students were failed not only by a technology that is prone to false alerts, but also by the very adults meant to keep them safe when we send them to school,â said Damon Hewitt, the president and executive director of the Lawyersâ Committee for Civil Rights Under Law, which is representing the students. âÂÂInstead of this protection, they were met with guns and traumatized. And it could have been even worse.âÂÂ
The incident took place last fall. The students had just wrapped up football practice on the evening of 20 October when their coach passed out bags of Doritos to the team, according to the complaint. Taki Allen, a junior at the time, took several bags and was with his friends near the picnic tables waiting for their ride, when six local police cruisers emerged with lights flashing. Many officers unholstered their weapons and the students put their hands in the air, the complaint said.
The legal complaint stated that the plaintiffs âÂÂwere in shock and feared for their lives after being stopped, ordered to their knees, handcuffed and searchedâ by armed officers. One officer allegedly told them as he left the scene: âÂÂHey, thanks for not running away, that would have been a real problem.âÂÂ
The complaint described a chaotic series of events in which OmnilertâÂÂs AI gun-detection system flagged the chips bag as a firearm with 90% confidence. Omnilert Gun Detect system scans security footage for signs of firearms. âÂÂThat alert kept going even after school staff and local police reviewed the image and determined it was a mistake,â the lawsuit stated.
While Omnilert markets its product as reliable and leading to âÂÂfewer false positivesâÂÂ, the lawsuit states that MarylandâÂÂs office of the inspector general for education âÂÂfound that more than 99% of OGD Alerts in Baltimore County Public Schools were false positives that required no police responseâÂÂ.
Omnilert, the school principal, Baltimore police and the board of education did not immediately respond to a Guardian request for comment.
An Omnilert spokesperson previously told the Baltimore Banner that the company was reviewing the lawsuit and was âÂÂtruly sorry for the fear they and their families experienced. We understand why they want answers.â A spokesperson for Baltimore county told the New York Times that the district cannot comment on pending litigation.
The lawsuit included texts from the school principal making light of the incident in messages to fellow administrators that contained emojis of a smiley face crying with laughter. The complaint said she did not apologize to the students.
One officer allegedly said as he began to leave the scene: âÂÂFucking Omnialertsâ and: âÂÂStupid AI cameras.â His colleague allegedly joked to the plaintiffs: âÂÂBe careful on school property, especially holding stuff like that ⦠be careful with your chips bags.âÂÂ
The students didnâÂÂt find that funny, and reported feeling pain from tight handcuffs, as well as lasting emotional distress, according to the complaint.
Taki Allen said he no longer feels safe waiting for rides or hanging out at school after hours; he often pays for rides home to avoid waiting for rides from friends or family.
Freida Winfield, whose son Keith is part of the lawsuit, was en route to pick up him and his friends when they were detained. âÂÂNo child in Baltimore county should face this kind of danger while waiting outside his own school for a ride home from his mother,â said Winfield.
