This girls-only app uses AI to screen users genders what could go wrong? – The Verge

A new social app called Giggle is pitching itself as a girls-only networking platform. To sign up, users have to take a selfie. And while that might not sound too invasive, the app then uses bio-metric gender verification software to determine whether that person is a woman. If that wasnt already bad enough, the technology doesnt work if youre trans.

[G]iggle is for all girls, the company points out on its website, before adding, Due to the gender-verification software that giggle uses, trans-girls will experience trouble with being verified. Its the stuff of a dystopian novel.

Giggle, founded by Australian screenwriter Sall Grover, supposedly looks at the bone structure of a persons face to determine their gender. Thats problematic on a number of fronts, not least of which is that bone structure is clearly a poor indicator of gender identity. Nevertheless, Giggle says the science is sound. Its Bio-Science, not pseudo-science like phrenology, the website declares.

Except it sounds a lot like pseudo-science. On Twitter, people called out the apps inherent transphobia. We shall await our judgement like sheep, one user wrote. All it takes is one selfieif giggle lets us in, we are welcomed into the society of women, to pass forevermore. If not, we shall be abandoned in a heap of offals and excrement.

Grover responded to the criticism, tweeting that shed consulted trans women while building the app and determined it was best to openly admit the softwares limits. We worked with trans girls who decided it was best to be upfront with a flaw so there wasnt any hurtful misgendering, she explained. Later, she said she was grateful for the feedback and agreed that some of the wording on the website was hideous.

The apps privacy policy is also a cause for concern, however. As one Twitter user pointed out, Giggle can collect a ton of personal information, including peoples images, location, preferences, and browsing data. Giggle is able to then share that information with third-party websites and services, including facial recognition providers, chat room providers, and marketers. It also collects sensitive information including peoples sexual practices or sex life, their criminal records, and their private health information.

Its unclear why Giggle would need access to such granular data, given that its goal is primarily to connect women with potential roommates or travel buddies. But in an era of ever-expanding surveillance, with companies like Clearview AI identifying peoples faces without their knowledge or consent, an app built on dubious biometric screening and extensive data collection should be cause for concern. While Giggles website says the app is designed to give girls choice, control and connection, its technology seems to do just the opposite.

Giggle did not immediately respond to a request for comment.