Flock Technologies has developed an AI-based search system that scans networked cameras to identify individuals described by officers via text input. While promising enhanced surveillance capabilities, the tool faces backlash over data privacy, questionable accuracy, and insufficient safeguards.
- AI searches video feeds based on officers' text descriptions
- New rules aim to curb misuse but cannot prevent all abuses
- Experts highlight concerns around accuracy and sensitive content monitoring
What happened
Flock Technologies created an AI-driven tool that lets police define an area and search live video streams from multiple cameras for individuals matching a written description. The technology continuously scans footage, allowing law enforcement to track persons of interest over large areas. In recent months, Flock has faced backlash as several police departments and city councils canceled contracts due to privacy and civil liberty concerns.
Following public criticism and legal scrutiny, including a congressional inquiry and state investigations, Flock announced new measures: shorter data retention periods, mandatory case codes for searches, and automated audits to detect misuse. WIRED analyzed some code sent to officers but found that many control mechanisms operate on Flock’s servers, leaving key details opaque and enforcement limited.
Why it matters
Flock’s AI tool marks a significant expansion in automated surveillance capabilities by enabling textual descriptions to drive real-time searches across city-wide camera networks. While this may aid investigations, technological experts warn the AI’s accuracy is limited and its decisions on permissible searches are made without external transparency. This creates risks of wrongful identification and potential violations of privacy and constitutional rights.
Critically, Flock’s system screens search terms for sensitive characteristics like race and religion, often blocking searches tagged with these categories, but notably allows searches related to political and cultural expression to proceed without restrictions. This policy raises alarm among civil rights advocates who emphasize the protected status of such expression under the First Amendment.
What to watch next
Stakeholders will closely monitor how effectively Flock’s new safeguards are enforced and whether they truly prevent abuse. There is also keen interest in whether further regulatory oversight or legal challenges will emerge given past instances of unauthorized data sharing and broad surveillance practices. Transparency on data retention, internal monitoring, and AI decision-making processes will be critical for public trust.
Additionally, the debate over balancing innovative surveillance technology with civil liberties remains ongoing. Policymakers, advocacy groups, and technology experts are expected to scrutinize both the ethical implications and operational accuracy of Flock’s AI as it becomes more widely deployed in law enforcement contexts.