Legal Standing in Algorithmic Harm Cases. Collective Actions in Litigating Risk Models Across E-Government States
2025, 106, No. 1
Publication date
Publishing model
License type
Field
Discipline
Language of publication
Downloads
PDF 642 KB
Number of views:70
Number of downloads:32
Crossref citations:0
Altmetric score:0
Abstract
The paper demonstrates the cycle of access to justice in algorithmic harm cases. It analyses harm in deploying risk models in social security domains by two e-governments and compares legal standing provisions therein. Case studies have been selected from the domestic legal systems of Australia and the Netherlands. The paper concludes that as long as domestic judicial review mechanisms require demonstrating sufficient interest in the case, there are limited possibilities, if any, for the individual victims to claim algorithmic harm directly and seek access to justice. It is due to the individualistic nature of legal standing provisions vis-à-vis collective deployment of algorithmic decisionmaking processes. Conversely, algorithmic models can be addressed when public interest litigation is in place. However, this solution would not address an individual harm caused by the risk models but rather aim at removing the risk model from decision-making processes. Therefore, neither solution can satisfy all interests that various applicants, especially the vulnerable ones, may have in litigation.
Keywords:
Bibliography
Abungu C, 'Algorithmic Decision-Making and Discrimination in Developing Countries' (2022) 13 Journal of Law, Technology, & the Internet 39
Arandia PJ, 'Algorithmic Transparency in the Public Sector' (Official Journal and Publications Organisation of the Government of Catalonia 2023) Govern Obert 9110 Dominika Iwan -Sojka
Aspinwall M, 'Legal Mobilization without Resources? How Civil Society Organizations Generate and Share Alternative Resources in Vulnerable Communities' (2021) 48 Journal of Law and Society 202
https://doi.org/10.1111/jols.12290
Barocas S, 'Data Mining and the Discourse on Discrimination' (CS Yale, 2014) <https:// www.cs.yale.edu/homes/jf/Barocas-Taxonomy.pdf> accessed 29 October 2021
Barocas S and Selbst AD, 'Big Data's Disparate Impact' (2016) 104 671
https://doi.org/10.2139/ssrn.2477899
Bornstein S, 'Antidiscriminatory Algorithms' (2019) 70 Alabama Law Review 519
Bower A and others, 'Fair Pipelines' [2017] arXiv:1707.00391 [cs, stat] <http://arxiv.org/ abs/1707.00391> accessed 27 October 2021
Castelluccia C and Le Métayer D, 'Understanding Algorithmic Decision-Making: Opportunities and Challenges.' (Secretariat of the European Parliament 2019) PE 624.261 <https://data.europa.eu/doi/10.2861/536131> accessed 28 February 2023
Christian G, 'Legal Framework For The Use Of Artificial Intelligence (AI) Technology In The Canadian Criminal Justice System' <https://papers.ssrn.com/abstract=4712508> accessed 10 April 2024
https://doi.org/10.2139/ssrn.4712508
Chugh N, 'Risk Assessment Tools on Trial: AI Systems Go?' (2022) 41 IEEE Technology and Society Magazine 50
https://doi.org/10.1109/MTS.2022.3197123
Cofone IN, 'Algorithmic Discrimination Is an Information Problem' (2019) 70 Hastings Law Journal 1389
Creswell JW, Research Design: Qualitative, Quantitative, and Mixed Methods Approaches (SAGE 2013)
De Stefani P, 'Conceptualizing "Vulnerability" in the European Legal Space: Mixed Migration Flows and Human Trafficking as a Test' (2022) 4 Frontiers in Human Dynamics <https://www.frontiersin.org/articles/10.3389/f humd.2022.861178> accessed 2 January 2024
https://doi.org/10.3389/fhumd.2022.861178
'Denmark Faces Backlash over AI Welfare Surveillance' (Digital Watch Observatory, 19 November 2024) <https://dig.watch/updates/denmark-faces-backlash-over-ai-welfare-surveillance> accessed 28 November 2024
D'Rosario M and D'Rosario C, 'Beyond RoboDebt: The Future of Robotic Process Automation' (2020) 11 International Journal of Strategic Decision Sciences (IJSDS) 1
https://doi.org/10.4018/IJSDS.2020040101
Grozdanovski L, 'In Search of Effectiveness and Fairness in Proving Algorithmic Discrimination in EU Law' (2021) 58 Common Market Law Review <https:// kluwerlawonline.com/api/Product/CitationPDFURL?file=Journals\COLA\COLA 2021005.pdf> accessed 28 October 2024
https://doi.org/10.54648/COLA2021005
'Guidelines on Automated Individual Decision-Making and Profiling for the Purposes of Regulation 2016/679 (Wp251rev.01)' (The Working Party on the Protection of Individuals with regard to the Processing of Personal Data 2017) <https://ec.europa. eu/newsroom/article29/items/612053> accessed 27 November 2024
Gutierrez L, 'Walls of Red Wing: An Examination of Culturally-Informed Sentencing, Risk/Need Factors, and Treatment for Peoples of Indigenous Heritage in Canada's Criminal Justice System' (Carleton University 2018) <https://repository.library. carleton.ca/concern/etds/vx021f880> accessed 10 April 2024
Haag A and others, 'An Introduction to the Issues of Cross-Cultural Assessment Inspired by Ewert v Canada' (2016) 3 Journal of Threat Assessment and Management 65
https://doi.org/10.1037/tam0000067
Hakkarainen J, 'Naming Something Collective Does Not Make It So: Algorithmic Discrimination and Access to Justice' (2021) 10 Internet Policy Review <https://111 policyreview.info/articles/analysis/naming-something-collective-does-not-make-it-so- algorithmic-discrimination-and> accessed 3 January 2022
https://doi.org/10.14763/2021.4.1600
Katyal SK, 'Private Accountability in an Age of Artificial Intelligence' in Woodrow Barfield (ed), The Cambridge Handbook of the Law of Algorithms (Cambridge University Press 2020) <https://www.cambridge.org/core/books/cambridge-hand-book-of-the-law-of-algorithms/private-accountability-in-an-age-of-artificial-intelligence/DA0A28F858DE0184E6791B7AFCF904C5> accessed 6 March 2023
Kingsbury B, 'Human Rights in a Use Case World' in Nehal Bhuta and others (eds), The Struggle for Human Rights: Essays in honour of Philip Alston (Oxford Univer-sity Press 2021) < > accessed 15 April 2024
https://doi.org/10.1093/oso/9780198868064.003.0008
Koloßa S, 'Standing (Locus Standi)', Max Planck Encyclopedia of Comparative Constitutional Law (2021) <https://oxcon.ouplaw.com/display/10.1093/law-mpeccol/ law-mpeccol-e472? prd=MPECCOL> accessed 29 March 2024
Lejeune A and Ringelheim J, 'The Differential Use of Litigation by NGOs: A Case Study on Antidiscrimination Legal Mobilization in Belgium' (2022) 48 Law & Social Inquiry 1
https://doi.org/10.1017/lsi.2022.54
Madiega T, 'Artificial Intelligence Liability Directive' (European Parliamentary Research Service 2023) Briefing PE 739.342 <https://www.europarl.europa.eu/RegData/ etudes/BRIE/2023/739342/EPRS_BRI(2023)739342_EN.pdf> accessed 28 October 2024
Maxwell J, 'Judicial Review and the Digital Welfare State in the UK and Australia' <https://papers.ssrn.com/abstract=3896200> accessed 18 April 2024
Maxwell J and Tomlinson J, 'Proving Algorithmic Discrimination in Government Decision-Making' [2020] Oxford University Commonwealth Law Journal <https:// www.tandfonline.com/doi/abs/10.1080/14729342.2020.1833604> accessed 28 Octo-ber 2024
Mead G and Barbosa Neves B, 'Contested Delegation: Understanding Critical Public Responses to Algorithmic Decision-Making in the UK and Australia' (2023) 71 The Sociological Review 601
https://doi.org/10.1177/00380261221105380
Michaels R, 'The Functional Method of Comparative Law' in Mathias Reimann and Reinhard Zimmermann (eds), The Oxford Handbook of Comparative Law (Oxford University Press 2019) < > accessed 19 February 2025
https://doi.org/10.1093/oxfordhb/9780198810230.013.11
Naylor S, 'Robodebt, Kafka and Institutional Absurdism in Australia' (2023) 48 Alternative Law Journal 299
https://doi.org/10.1177/1037969X231211620
Ng Y-F, O'Sullivan M and Paterson M, 'Revitalising Public Law in a Technological Era: Rights, Transparency and Administrative Justice' (2020) 43 UNSW Law Journal <https://www.unswlawjournal.unsw.edu.au/wp-content/uploads/2020/09/11-NG-ET-AL.pdf> accessed 19 January 2024
https://doi.org/10.53637/YGTS5583
Nunn R, 'Discrimination in the Age of Algorithms' in Woodrow Barfield (ed), The Cambridge Handbook of the Law of Algorithms (Cambridge University Press 2020) <https://www.cambridge.org/core/books/cambridge-handbook-of-the-law-of-algorithms/discrimination-in-the-age-of-algorithms/947D7E2FEC14CFEBE7CC144 29DDFE717> accessed 1 March 2023
Orwat C, Risks of Discrimination through the Use of Algorithms ( Federal A nti- Discrimination Agency 2020) <https://publikationen.bibliothek.kit.edu/1000123477> accessed 4 January 2022
O'Sullivan M, 'Chapter 11: Artificial Intelligence and the Right to an Effective Remedy', Artificial Intelligence and International Human Rights Law (2024) <https://www. elgaronline.com/edcollchap-oa/book/9781035337934/book-part-9781035337934-19. xml> accessed 26 November 2024
Peña P and Varon J, 'Decolonising AI: A Transfeminist Approach to Data and Social Justice' in Association for Progressive Communications, Article 19 and Swedish International Development Cooperation Agency, Artificial intelligence: Human rights, social justice and development (Global Information Society Watch 2019) <https://giswatch.org/2019-artificial-intelligence-human-rights-social-justice-and-development> accessed 13 May 2022
Rane DS and others, Research Management And Methodology (AG PUBLISHING HOUSE (AGPH Books) 2022)
Raso J, 'Implementing Digitalisation in an Administrative Justice Context' in Marc Hertogh and others (eds), The Oxford Handbook of Administrative Justice (Oxford University Press 2022) < > accessed 19 May 2023
https://doi.org/10.1093/oxfordhb/9780190903084.013.27
Rinta-Kahila T and others, 'Algorithmic Decision-Making and System Destructiveness: A Case of Automatic Debt Recovery' (2022) 31 European Journal of Information Systems 313 -, 'Managing Unintended Consequences of Algorithmic Decision-Making: The Case of Robodebt' [2023] Journal of Information Technology Teaching Cases 20438869231165538
https://doi.org/10.1080/0960085X.2021.1960905-
Schmidt E, Sesing-Wagenpfeil A and Köhl MA, 'Bare Statistical Evidence and the Legitimacy of Software-Based Judicial Decisions' (2023) 201 Synthese 134
https://doi.org/10.1007/s11229-023-04141-2
Trewin D, Fisher N and Cressie N, 'The Robodebt Tragedy' (2023) 20 Significance 18 van Bekkum M and Borgesius FZ, 'Digital Welfare Fraud Detection and the Dutch SyRI Judgment' (2021) 23 European Journal of Social Security 323
https://doi.org/10.1177/13882627211031257
van Schendel S, 'The Challenges of Risk Profiling Used by Law Enforcement: Examining the Cases of COMPAS and SyRI' in Leonie Reins (ed), Regulating New Technologies in Uncertain Times (TMC Asser Press 2019) < 279-8_12> accessed 12 April 2024
https://doi.org/10.1007/978-94-6265-
Vellinga NE, 'Rethinking Compensation in Light of the Development of AI' [2024] International Review of Law, Computers & Technology 1
Villasenor J and Foggo V, 'Artificial Intelligence, Due Process and Criminal Sentencing' (2020) 2020 Michigan State Law Review 295
Wang X and others, 'Algorithmic Discrimination: Examining Its Types and Regulatory Measures with Emphasis on US Legal Practices' (2024) 7 Frontiers in Artificial Intelligence <https://www.frontiersin.org/journals/artificial-intelligence/articles/ 10.3389/frai.2024.1320277/full> accessed 27 December 2024
https://doi.org/10.3389/frai.2024.1320277
Washington AL, 'How to Argue with an Algorithm: Lessons from the COMPAS-ProPublica Debate' (2018) 17 Colorado Technology Law Journal 131113
Weerts H and others, 'Algorithmic Unfairness through the Lens of EU Non-Discrimination Law', FAccT Conference 2023 (ACM 2023) <https://hal.science/hal-04244693> accessed 28 October 2024
https://doi.org/10.1145/3593013.3594044
Wieringa M, '"Hey SyRI, Tell Me about Algorithmic Accountability": Lessons from a Landmark Case' (2023) 5 Data & Policy e2
https://doi.org/10.1017/dap.2022.39
Zuiderveen Borgesius F, 'Discrimination, Artificial Intelligence, and Algorithmic Decision-Making' (Council of Europe, Directorate General of Democracy 2018) <https://dare.uva.nl/search?identifier=7bdabff5-c1d9-484f-81f2-e469e03e2360> accessed 22 December 2021
Zuiderveen Borgesius FJ, 'Strengthening Legal Protection against Discrimination by Algorithms and Artificial Intelligence' (2020) 24 The International Journal of Human Rights 1572 LQDN et al v Caisses d'Allocations Familiales (Memorial) (Conseil d'État (France)) NJCM c.s v De Staat der Nederlanden (SyRI), Judgment [2020] The Hague District Court ECLI:NL:RBDHA:2020:1878 S and Marper v the United Kingdom [2008] ECtHR [GC] 30562/04, 30566/04
https://doi.org/10.1080/13642987.2020.1743976