Algorithmic Inclusion or Programmed Exclusion?
The Impact of Artificial Intelligence on Vulnerable Populations
DOI:
https://doi.org/10.12957/publicum.2025.94690Keywords:
Digital Inclusion, Artificial Intelligence, Algorithmic Discrimination, Social Vulnerability, Informational JusticeAbstract
The advance of artificial intelligence brings promises of efficiency and inclusion, but its expansion into public safety, education, employment, and credit exposes risks for vulnerable populations. This article critically examines so-called algorithmic inclusion, showing how models trained on data marked by historical inequalities can reproduce and intensify discrimination, especially amid structural invisibility and information asymmetry. The objective is to understand when artificial intelligence becomes programmed exclusion, disproportionately affecting historically marginalized groups. The methodology is qualitative, based on a critical literature review and an interdisciplinary approach that links ethics, theories of justice, and digital law. In conclusion, the article proposes guidelines for algorithmic governance that are transparent and explainable, with impact assessment, accountability, social participation, and data protection, all attentive to social differences. The study contributes to delineating the limits of technology and to supporting responsible public policies oriented toward informational justice.
References
ALNEMR, Nardine. Democratic self-government and the algocratic shortcut: the democratic harms in algorithmic governance of society. Contemporary Political Theory, v. 23, p. 205–227, 2024. Disponível em: https://doi.org/10.1057/s41296-023-00656-y. Acesso em: 16 jul. 2025.
BARREDO ARRIETA, Alejandro et al. Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI. Information Fusion, v. 58, p. 82–115, 2020. Disponível em: https://arxiv.org/pdf/1910.10045.pdf. Acesso em: 15 jul. 2025.
CHEONG, Adrian. Transparency and accountability in AI systems: safeguarding wellbeing in the age of algorithmic decision-making. Frontiers in Human Dynamics, Lausanne, v. 6, 2024. Disponível em: https://www.frontiersin.org/journals/human-dynamics/articles/10.3389/fhumd.2024.1421273/full. Acesso em: 16 jul. 2025.
COECKELBERGH, Mark. Ética de la inteligencia artificial. Tradução de Juan Antonio Cardona. Madrid: Ediciones Cátedra, 2021. p. 144.
CUNHA, João Paulo de Resende; MEIRELES, Luísa Gonçalves; MACHADO, Maíra Saruê; RUA BAPTISTA, Rachel. Abismo digital: desigualdades e privações no acesso à internet no Brasil. Observatório Itaú Cultural, São Paulo, 09 jun. 2023. Disponível em: https://www.itaucultural.org.br/secoes/observatorio-itau-cultural/abismo-digital-desigualdades-acesso-internet-brasil. Acesso em: 15 jul. 2025.
CHEONG, Ben Chester. Transparency and accountability in AI systems: safeguarding wellbeing in the age of algorithmic decision-making. Frontiers in Human Dynamics, v. 6, 3 jul. 2024. DOI: 10.3389/fhumd.2024.1421273. Disponível em: https://www.frontiersin.org/journals/human-dynamics/articles/10.3389/fhumd.2024.1421273/full. Acesso em: 8 jul. 2025.
COSTA, Inês Inocêncio. A problemática das decisões automatizadas à luz do direito à proteção de dados pessoais. Cadernos do CIJE, n. 10, p. 67–87, 2021. Disponível em: https://cije.up.pt/client/files/0000000001/4-ines-costa_1677.pdf. Acesso em: 5 jun. 2025.
ESAYAS, Samson Yosef. Algorithmic Governance and the Redefinition of Bureaucratic Accountability in Digital States. [S. l.]: publicado em [S. l.], 2023. Disponível em: https://www.researchgate.net/publication/392596320_Algorithmic_Governance_and_the_Redefinition_of_Bureaucratic_Accountability_in_Digital_States. Acesso em: 16 jul. 2025.
EUROPEAN UNION. Artificial Intelligence Act. Regulation (EU) 2024/1689 of 13 June 2024. Official Journal of the European Union, L 1689, 12 Jul. 2024. Disponível em: https://eur-lex.europa.eu/eli/reg/2024/1689/oj. Acesso em: 15 jul. 2025.
FRANÇA, Adriano; FURLIN, Neiva. Educação e desigualdades digitais durante a pandemia da Covid 19: análise da produção científica. Linguagens, Educação e Sociedade, Teresina, v. 27, n. 53, p. 300–326, 2023. Disponível em: https://periodicos.ufpi.br/index.php/lingedusoc/article/view/3667. Acesso em: 15 jul. 2025.
MONTEIRO, Julia Iunes; MARRAFON, Marco Aurélio. Legitimidade democrática na governança algorítmica: primeiros parâmetros para sua aplicação na regulação e no desenvolvimento da inteligência artificial e de políticas baseadas em dados. Revista Direitos Fundamentais & Democracia, v. 29, n. 1, p. 5–50, 2024. Disponível em: https://www.researchgate.net/publication/381719436. Acesso em: 15 jul. 2025.
MORI, Cristina Kiomi. Políticas públicas para inclusão digital no Brasil: aspectos institucionais e efetividade em iniciativas federais de disseminação de telecentros no período 2000-2010. 351 f. Tese (Doutorado em Serviço Social) – Instituto de Ciências Humanas, Universidade de Brasília, Brasília. 2011.
NED (National Endowment for Democracy). Setting Democratic Ground Rules for AI, 2023. Disponível em: https://www.ned.org/wp-content/uploads/2023/10/NED_Setting-Democratic-Ground-Rules-for-AI-Report_v6.pdf. Acesso em: 16 jul. 2025.
NISSENBAUM, Helen. Privacy in Context: Technology, Policy, and the Integrity of Social Life. Stanford, California: Stanford University Press, 2010. p. 233–235.
NOBLE, Safiya Umoja. Algorithms of oppression: how search engines reinforce racism. New York: New York University Press, 2018.
O’NEIL, Cathy. Algoritmos de destruição em massa: como o big data aumenta a desigualdade e ameaça a democracia. Tradução de Pedro Maia Soares. Rio de Janeiro: Difel, 2016. p. 29-30.
OECD. OECD Principles on Artificial Intelligence. Paris: OECD Publishing, 2019. Disponível em: https://www.oecd.org/content/dam/oecd/en/publications/reports/2019/06/what-are-the-oecd-principles-on-ai_f5a9a903/6ff2a1c4-en.pdf. Acesso em: 15 jul. 2025.
OLIVEIRA, Heitor Moreira de. A exclusão digital como obstáculo ao efetivo acesso à justiça eletrônica. In: RIGOLDI, Vivianne et al. (org.). Reconhecimento dos vulneráveis e direito ao desenvolvimento na era digital. v. 2. Curitiba: CRV, 2022. p. 27–38.
Renaissance Numérique. AI Governance: Empowering Civil Society, 2025. Disponível em: https://www.renaissancenumerique.org/wp-content/uploads/2025/02/250205_renaissancenumerique_aigovernance_report.pdf. Acesso em: 16 jul. 2025.
ROSA, Fernanda Ribeiro. Inclusão digital como política pública: disputas no campo dos direitos humanos. Sur: Revista Internacional de Derechos Humanos, São Paulo, v. 10, n. 18, p. 33 55, jun. 2013. Disponível em: https://www.corteidh.or.cr/tablas/r32486.pdf. Acesso em: 14 jul. 2025.
SCHWARTZ, Gilson. Educar para a emancipação digital. In: Reescrevendo a educação: propostas para um Brasil melhor. São Paulo: Ática; Scipione; Fundação Victor Civita, p. 125-133. 2006. Disponível em: <http://oei.es/pdfs/reescrevendo.pdf>. Acesso em: 14 Jul. 2025.
SILVEIRA, Sérgio Amadeu. A noção de exclusão digital diante das exigências de uma cibercidadania. In: HETKOWSKI, Tânia M. (Org.). Políticas públicas e inclusão digital. Salvador: EDUFBA. 2008. p. 20-41.
ULNICANE, Inga. Intersectionality in Artificial Intelligence: Framing Concerns and Recommendations for Action. Social Inclusion, v. 12, n. 1, p. 1–16, 2024. Disponível em: https://www.cogitatiopress.com/socialinclusion/article/view/7543. Acesso em: 15 jul. 2025
UNESCO. Recommendation on the Ethics of Artificial Intelligence. Adotada em 26 nov. 2021. Paris: UNESCO, 2021. Disponível em: https://www.unesco.org/en/artificial-intelligence/recommendation-ethics. Acesso em: 15 jul. 2025.
WARSCHAUER, Mark. Tecnologia e inclusão social: a exclusão digital em debate. Tradução de Carlos Szlak. São Paulo: Senac. 2006.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Matheus Gomes de Melo, Vivianne Rigoldi, Roberto da Freiria Estevão
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
The author(s) of the paper declare(s) to know and agree to the following rules:
1) The author(s) undertook the work presented to the journal, being entirely responsible for the ideas and concepts therein transmitted, which do not necessarily correspond to the point of view of Publicum’s Editors.
2) The ethical principles alluded to in the evaluation policy of the journal [RDN1] were met in the conduction of the work presented to submission.
3) The author(s) assume(s) authorship and responsibility for their work, declaring that it does not infringe any third party intellectual property rights.
4) The author(s) take(s) full responsibility for moral or patrimonial damages that the distribution of the work may generate to third parties.
5) The author(s) grant(s) the journal the rights to reproduce, edit and first publish the paper in any media – in particular in digital form – in an electronic archive on the Internet.
6) The author(s) confer(s) the right to the editors to modify the text submitted, without prejudice of its contents, when necessary to standardize the presentation of the works and to meet the norms of the journals’ own edition.
7) The author(s) agree(s) to the final form of the paper approved by the journal.
8) The author(s) authorize(s) the disclosure of the paper in the channels of communication of the Faculty of Law of UERJ.
9) The author(s) agree(s) with the reproduction of short extracts from the paper in other UERJ publications.
10) The author(s) recognize(s) that, through the abovementioned assignment and authorizations, he/she/they will not receive payment under any modality, meaning these will have the nature of scientific collaboration.
11) The author(s) is(are) aware that publication of the work may be refused if it is not considered appropriate, for any reason, whatsoever, and such refusal does not create responsibility and/or burdens of any kind to the journal or UERJ.
[RDN1]Ver COPE.
Publicum está licenciado com uma Licença Creative Commons Atribuição-NãoComercial 4.0 Internacional.
