---
title: "Five questions to Winston Maxwell"
id: "2475"
type: "post"
slug: "five-questions-to-winston-maxwell"
published_at: "2023-03-22T11:35:43+00:00"
modified_at: "2026-02-19T18:16:45+00:00"
url: "https://www.august-debouzy.com/en/legal-article/five-questions-to-winston-maxwell/"
markdown_url: "https://www.august-debouzy.com/en/legal-article/five-questions-to-winston-maxwell.md"
taxonomy_category:
  - "Legal Article"
taxonomy_language:
  - "English"
taxonomy_post_translations:
  - "pll_6980b593dace5"
taxonomy_tax_secteur:
  - "Tech and Digital"
---

Summarize with AI

**Does the draft AI Act adequately cover fundamental rights?**

Everyone’s talking about the proposed AI Act, but the European Court of Justice’s decisions of June 21, 2022 is just as important. In La Ligue des Droits Humains, the Court had to evaluate the compatibility of the PNR Directive, which authorizes police and intelligence authorities to use algorithms to analyze passenger data, with the EU Charter. The Court had to determine whether these surveillance measures were proportionate and necessary in a democratic society. The Court found that they were, but set forth a number of conditions. These conditions will apply, with more or less intensity, to any algorithmic processing that has significant impacts on fundamental rights. That’s why I think that the Court’s June 21, 2022 decision is at least as important as the AI Act when it comes to AI use cases that create a high risk for fundamental rights.

**What are the conditions imposed by the Court?**

One of the most radical conditions is to exclude machine learning entirely from algorithmic detection of terrorist risks. Only predetermined human-made rules can be used.

**Why did the Court exclude machine learning?**

Lack of explainability. Because a human reviewer examining a machine-learning generated risk score would not be able to understand the “reason” for the score, the human reviewer’s role would become ineffective. Also, a citizen who later wants to challenge a decision based on the risk score would lack an effective remedy because the reasons for the score would remain hidden.

**What other conditions did the Court impose?**

The court said that the models used to identify terrorist risks should take account of both “guilt” and “innocence” factors. I found this fascinating, because the Court is trying to insert some fair trail features within the algorithm itself!

The Court said that each algorithmic alert must be reviewed by a human, to detect possible false positives (false alerts), and to detect discrimination, though I’m not sure how review of an individual alert can possibly detect discrimination. The Court emphasized that the algorithmic system must not lead to indirect discrimination (“disparate impact” in US parlance) against protected groups. The Court required that the system be proven to be effective in detecting terrorism risks, but did not specify what “effective” means. Measuring effectiveness is a big issue in criminal detection because of the class imbalance problem (base rate fallacy), which leads inevitably to a high proportion of false positives.

**Does the AI Act cover any of these points?**

Not currently. The draft AI Act refers to “human oversight”, to “bias” and to risks to fundamental rights, but does not currently provide a human rights framework for analyzing the proportionality of AI risks. The Court’s June 21, 2022 decision does that, albeit for a very sensitive use case – anti-terrorism algorithms. Other use cases will be less sensitive than the PNR case, but the Court’s step-by-step analysis of proportionality should provide a template for evaluating any AI application that creates risks for fundamental rights, even private sector measures.

Share

- Linkedin
- Copy Link

Summarize with AI

### Sector

1

- [Tech and Digital](https://www.august-debouzy.com/en/tax-secteur/technologie-et-digital_en/)

## Discover more content that might interest you

News

[30/06/26 Deal 2 min August Debouzy advises Spacinov’s founding shareholders on Quilvest Capital Partners’ investment in Spacivox August Debouzy advised the founding shareholders of Spacinov, the French software company behind Spacivox, an omnichannel SaaS platform for B2C debt collection orchestration, on the investment by Quilvest Capital Partners as reference shareholder. Read more](https://www.august-debouzy.com/en/deal/august-debouzy-advises-spacinovs-founding-shareholders-on-quilvest-capital-partners-investment-in-spacivox/)
[19/12/25 Deal 2 min August Debouzy advises SPIE on the signing of an agreement for the contemplated acquisition of Artemys August Debouzy advised SPIE, the independent European leader in multi-technical services in the areas of energy infrastructure and communications, as well as its French digital services subsidiary SPIE ICS, in connection with the signing of an agreement for the contemplated acquisition of 93% of the share capital of Artemys, a… Read more](https://www.august-debouzy.com/en/deal/august-debouzy-advises-spie-on-the-signing-of-an-agreement-for-the-contemplated-acquisition-of-artemys/)
[08/12/25 Legal Article 5 min Toward a Two-Tier Liability Regime for Online Platforms? Analysis of the CJEU’s Russmedia Decision In a judgment dated 2 December 2025, the Court of Justice of the European Union held a marketplace operator liable for the unlawful processing of sensitive data published in a user’s advertisement. The CJEU ruled that the operator is responsible for the processing of advertisements published on its platform and… Read more](https://www.august-debouzy.com/en/legal-article/toward-a-two-tier-liability-regime-for-online-platforms-analysis-of-the-cjeus-russmedia-decision/)
