Message screening

 

The plan: To search all of your private messages and automatically report you to the police

The EU wants all private electronic messages to be monitored and searched by unreliable algorithms for possible child pornographic content. Providers of e-mail, messenger and chat services are to be allowed to search the content of all private messages without suspicion for known and unknown child and youth pornography and for the “initiation of sexual contacts” with minors – also with the help of error-prone “artificial intelligence”. If an algorithm flags a message as suspicious, message content and customer data may be disclosed to law enforcement agencies and non-governmental organisations worldwide, without human review. The users reported will never know about this, regardless of the outcome of the investigation.

Until now, only major US services such as GMail, Outlook.com and Facebook Messenger are indiscriminately screening all private messages. However, the EU Commission wants to oblige all providers to do so in future.

What does this have to do with you?

  • Due to unreliable algorithms your nude photos could fall into the hands of employees of US corporations and the police – regardless of whether you are an adult or not. Your nude photos could end up being circulated and abused.
  • You could be wrongfully suspected of possessing child pornography. US corporations algorithms often report perfectly legal holiday photos of children on the beach to the police – up to 90% of the algorithmically generated reports are unfounded. If you are sent unsolicited illegal material you will also be reported to the police. Teenagers who send self-generated nude pictures are particularly at risk of being reported – 40% of investigations for “child pornography” in Germany target minors.
  • You could be in big trouble the next time you travel abroad. Reports are forwarded to various countries like the US, which lacks basic data protection rules – with unforeseeable consequences for you.
  • Your private messages and flirtations can be read by employees of US corporations if algorithms wrongfully flag you for „soliciting minors“.
  • If secure encryption is removed to be able to scan for illegal content, your private messages are no longer safe from mass surveillance by intelligence agencies and misuse by criminals. Whistleblowers who take high risks to expose scandals and democracy activists in dictatorships may end up in prison due to the lack of secure communications!

The Timeline

The proposal is currently being negotiated between the Parliament, the Council and the Commission in the so-called trilogue. The detailed positions of each institution can be found here. Child protection organizations are exerting pressure. All parliamentary groups are in favor of general monitoring, except for Greens/EFA and GUE/NGL. The regulation is to be passed at the beginning of 2021. 

By mid-2021, the EU Commission wants to present a draft law that would force all providers to permanently and indiscriminately search the content of all private messages.

According to the European Court of Justice, the permanent and indiscriminate automated analysis of private communications violates our fundamental rights and is prohibited (§ 177). For this reason, MEP Patrick Breyer has reported the US companies Facebook and Google to the Data Protection Authorities for a breach of the General Data Protection Regulation.

Upcoming Dates (to be confirmed):

  • 14 January 2021: Internal Meeting
  • 15 January 2021: Technical Negotiations between Council, Commission and Parliament (Technical Trilogue)
  • 18  January 2021: Shadows-Meeting among the Parliament’s Negotiators
  • 19 January 2021: Internal Meeting
  • 20 January 2021: Technical Negotiations between Council, Commission and Parliament (Technical Trilogue)
  • Probably end of January: Negotiations between Council, Commission and Parliament (Political Trilogue)
  • Probably 2nd week of February: Vote in the Plenary of the European Parliament

What you can do

10 arguments against mass surveillance of private messages

  1. Mass surveillance is ineffective. The increasing number of reports demonstrates that the spread of child pornography cannot be curbed in this way – and encrypted channels are not included in the numbers, too. The right way forward is undercover investigations in „child pornography rings“.
  2. Mass surveillance criminalises minors. 40% of investigations for possession of “child pornography” in Germany are directed against minors who share such depictions for completely different reasons than adults, e.g. because they are inconsiderate, consider it “fun” or want to sound an alarm.
  3. Mass surveillance particularly harms young people and victims of abuse. Young people often send nude pictures of themselves, which threaten to fall into the wrong hands due to such algorithms. And victims of abuse need private communication channels in order to receive advice and help (e.g. from lawyers and psychologists), to discuss with other victims and in order to report cases confidentially.
  4. Mass surveillance makes it more difficult to prosecute child abuse. It pushes criminal communication further underground, where it is more difficult to intercept. Furthermore, the risk of being reported to the police and have their account blocked can deter users from reporting “child pornography”.
  5. Mass surveillance threatens secure encryption without backdoors, as encryption prevents such screening. Secure encryption protects minorities, LGBTQI persons, political dissidents, journalists, etc.
  6. Mass surveillance wrongfully incriminates thousands of users. According to the Swiss Federal Police, 90% of the content reported via the USA (NCMEC) is not criminally relevant, for example holiday photos on the beach with naked children.
  7. Mass surveillance privatises law enforcement, which under the rule of law belongs in the hands of independent public officials under judicial supervision.
  8. The proposed legislation is ineffective. It will not allow Facebook and others to continue mass surveillance. The proposed exception to the ePrivacy Directive is without prejudice to the General Data Protection Regulation (GDPR). Under the GDPR, mass surveillance remains illegal due to lack of a legal basis and proportionality. A complaint submitted by Patrick Breyer is pending with the data protection supervisory authorities.
  9. The proposed legislation violates fundamental rights and will not stand up in court. According to the case law of the European Court of Justice, a permanent automated analysis of communications is only proportionate if it is limited to suspects (Case C-511/18, paragraph 192).
  10. The proposed legislation creates a precedent for gradually destroying the fundamental right to respect for privacy: Will the same infrastructure be used in the future to search private messages for copyright infringements, defamation and content which the intelligence agencies are interested in? Will by the same reasoning our personal smartphones and computers be searched, letters opened and private homes bugged with AI “violence detection technology”?

Position Papers and Background Research:

Read more

Today the European Parliament's Civil liberties Committee voted to restrict the ePrivacy Directive which aims at protecting private communications. The
The EU Commission wants to legalise the mass screening and surveillance of all private electronic communications in search of possible
Patrick Breyer (Pirate Party), Member of the European Parliament, has filed a complaint with the data protection authority of Schleswig-Holstein
The European Parliament today debated a draft legislation by the EU Commission that would allow the screening without suspicion of
The EU Commission is proposing to screen and monitor all private electronic communications without suspicion in order to search for
The EU Commission wants all private electronic communications to be screened for possible child pornography, in the absence of any