Fast Facts
- Flock blocks searches using prohibited attributes like religion and nationality, and attempts to search these terms are automatically prevented.
- When searches include protected speech (e.g., slogans or symbols), officers receive warnings, log the attempt, and must acknowledge before proceeding.
- The system can be bypassed, such as searching for images of religious attire instead of direct keywords, raising concerns about privacy and misuse.
- Warnings mainly serve as records rather than effective deterrents, highlighting the importance of analyzing both search inputs and outputs for safety.
Flock’s AI Search Tool and Its Rules
Flock created an AI search tool for police officers. It helps them find information through keywords. However, it has strict rules. Officers cannot search using protected traits like religion or nationality. If they try, the system blocks the search immediately. This prevents misuse of sensitive data. When searches include words with constitutional protections, warnings appear. Officers then must acknowledge the warning and add a comment. They can choose to continue or stop. This process aims to balance effective searches with privacy concerns.
Strengths and Limitations of the System
The system offers some flexibility for legitimate cases. For example, a description mentioning a suspect’s clothing may trigger a warning. Officers can continue after giving a reason. When they do, their activity is logged and reviewed later. Yet, experts note that blocking certain words is not foolproof. Sometimes, searches are worked around, such as searching for clothing linked to a religion instead of the religion itself. This makes complete control difficult. Additionally, the system struggles with complex content, like images or video. It’s not always accurate, and mistakes can happen.
Impacts and Considerations
Warnings are meant to discourage misuse, but they don’t always stop determined users. For example, an officer might ignore a warning and proceed. Systems record these attempts, creating a trail for review. Some researchers say that to improve safety, both what is input and what comes out of the system should be checked carefully. Currently, these safeguards serve more as records rather than strict deterrents. As a result, ongoing oversight is needed to ensure fairness and prevent errors in police searches.
Discover More Technology Insights
Learn how the Internet of Things (IoT) is transforming everyday life.
Explore past and present digital transformations on the Internet Archive.
AITechV1
