Facebook moderators ‘err on the side of an adult’ when uncertain of age in possible abuse photos

A serious accountability for tech corporations is to watch content material on their platforms for little one sexual abuse materials (CSAM), and if any is discovered, they’re legally required to report it to the Nationwide Heart for Lacking and Exploited Kids (NCMEC). Many corporations have content material moderators in place that overview content material flagged for doubtlessly being CSAM, they usually decide whether or not the content material needs to be reported to the NCMEC.

Nonetheless, Fb has a coverage that might imply it’s underreporting little one sexual abuse content material, in line with a brand new report from The New York Instances. A Fb coaching doc directs content material moderators to “err on the facet of an grownup” once they don’t know somebody’s age in a photograph or video that’s suspected to be CSAM, the report mentioned.

The coverage was made for Fb content material moderators working at Accenture and is mentioned in a California Legislation Overview article from August:

Interviewees additionally described a coverage referred to as “bumping up,” which every of them personally disagreed with. The coverage applies when a content material moderator is unable to readily decide whether or not the topic in a suspected CSAM photograph is a minor (“B”) or an grownup (“C”). In such conditions, content material moderators are instructed to imagine the topic is an grownup, thereby permitting extra photos to go unreported to NCMEC.

Right here is the corporate’s reasoning for the coverage, from The New York Instances:

Antigone Davis, head of security for Meta, confirmed the coverage in an interview and mentioned it stemmed from privateness considerations for individuals who put up sexual imagery of adults. “The sexual abuse of kids on-line is abhorrent,” Ms. Davis mentioned, emphasizing that Meta employs a multilayered, rigorous overview course of that flags much more photos than some other tech firm. She mentioned the implications of erroneously flagging little one sexual abuse could possibly be “life-changing” for customers.

When reached for remark, Fb (which is now underneath the Meta company umbrella) pointed to Davis’ quotes within the NYT. Accenture didn’t instantly reply to a request for remark. Accenture declined to remark to The New York Instances.

Replace March thirty first, 9:09PM ET: Fb pointed to Davis’ quotes within the NYT.