This Is Flock’s AI Search Tool for Cops
Flock's AI search tool for police faces scrutiny over accuracy and potential misuse.
Flock Safety's new AI-powered search tool allows police to find individuals based on written descriptions across multiple cameras. Despite company claims of safeguards, analysis of the tool's code reveals that while abusive uses may be recorded, they are not necessarily prevented. Experts raise concerns about the AI's accuracy and its handling of sensitive search categories like race and religion.
AI summary of the linked source. Not reviewed by an editor. How this works
Run Flock Safety?
Get an email when a new story names Flock Safety, usually within the hour.
Free. Your list stays private and never appears in a subject line. One click stops it. How Vendor Watch worksPrivacy
The lesson from this incident
Full lessonFlock Safety's AI-powered surveillance tool allows law enforcement to search for individuals using natural language descriptions across a wide camera network, but code analysis reveals that policy violations are logged rather than actively blocked. This represents a critical gap between perceived safeguards and actual technical enforcement — a system that records misuse after the fact provides no real protection for individuals whose data is improperly queried. The tool's handling of sensitive attributes like race and religion raises significant civil liberties and bias concerns, as AI accuracy issues in these categories can lead to wrongful targeting. When powerful surveillance technology is deployed without hard technical controls, organizational policy alone is insufficient to prevent abuse.
What helps against this
How we list vendors- Identity threat detection and response (ITDR)
Attackers who log in with real, stolen credentials get noticed.
- Breach and attack simulation
You only find out whether your security tools stop an attack when a real attacker tries.
- AI application security
Prompt injection, data leaks through AI tools and unapproved AI use get caught.