The social implications of using AI
The other modules ask what the tool can do and how to check it. This one asks what it does to you, where it came from, and what it costs, because all three reach the people you serve. Relying on the tool changes the skill of the person relying on it. The training data was scraped from text that already existed, which is why your clients' languages are thin in it. The work of cleaning and rating that data was bought cheaply in the Global South. The buildings that run the models go up in specific neighborhoods, and rarely wealthy ones. You can use AI and still be able to say what it is when a client asks.
List what worries you, before anyone answers it
- Five minutes: everyone writes what actually worries them about AI, one worry per line, with no filtering and no rebuttals.
- Put the lines on the wall and sort them by how far out they reach, from you and your client to the world.
- Leave the wall up until the end of the module.
At the end, mark which worries this module answered and which ones only your community can settle.
The same tool at five scales
- You and your client Your skill and judgment, and whether the person in front of you gets a correct answer.
- Your agency Who may use what, which tasks get automated, and what happens to the staff who did them.
- Your community Trust in your agency, language access, and who gets asked before a data center is built nearby.
- The country Labor markets, copyright law, procurement rules, and who pays for the electricity.
- The world Whose text was taken, whose labor cleaned it, which languages were left out, and where the water went.
What relying on AI does to your skill
The first implication sits at your desk. A tool that does the easy half of the job takes the easy half of your practice with it, and the evidence for that is no longer speculative.
The clearest evidence so far comes from medicine. After AI assistance became routine at four endoscopy centers, the doctors' detection rate on the colonoscopies they did without AI fell by about six percentage points, and these were experienced clinicians with thousands of procedures behind them (Budzyn et al., 2025). Nobody decided to get worse. The skill moved into the tool, and it was missing on the day the tool was not there.
In a survey of 319 knowledge workers, the more people trusted the AI, the less critical thinking they reported doing, and the more they trusted their own judgment, the more they did. The work itself moved from producing an answer to verifying and managing what the machine produced (Lee et al., 2025). The output looks the same, and often better, so the shift is easy to miss.
In a field experiment, students given an unguarded AI tutor did better while they had it and then scored worse on their own than students who never had it, while a version built with guardrails avoided the harm (Bastani et al., 2025). AI does not ruin learning by itself. The tool has to be set up so the person still does the thinking, and that matters most for staff who are new and still building judgment.
When the draft, the summary, and the plan all arrive pre-made, the job turns into approving a machine's output. Much of what makes a caseworker good is the thinking that happens while writing the note and the discomfort that sends you back to the file, and that is the part the tool removes first. Say it out loud in supervision. A worker who feels like a reviewer of someone else's work is describing something real.
Do the hard case yourself first, then ask the tool and compare. Give new staff cases without the tool, on purpose, the way any profession trains. Treat "AI drafts, you decide" as a rule that protects your competence and not only your clients' accuracy.
AI is unlikely to replace you. It will quietly take the part of the work that made you good at it, and nobody notices until the day the tool is wrong, unavailable, or unaffordable.
Where the training data came from
Everything the model knows came from text somebody collected. Following that one sentence carefully explains both the language gap your clients run into and the labor that made the tool usable.
Everything the model has came from text that already existed in a form a company could collect. Knowledge that lives in speech, in a community, in paper files nobody scanned, or in a language with little written presence online is simply absent, and the model cannot notice its own absence. Who had money, publishing, and infrastructure decided what got digitized, so the shape of a model's knowledge follows the shape of economic and colonial history.
Vietnamese, Tagalog, Amharic, and Haitian Creole are each spoken by tens of millions of people. They are called low-resource for one reason: little of that language sits online as clean digitized text. Researchers have sorted the world's languages into tiers on exactly this basis, and the distance between the top tier and the rest is enormous (Joshi et al., 2020).
Where a language is thin online, the corpora get padded with whatever can be scraped, including religious translations, government notices, and machine-translated pages. An audit of the standard web-crawled multilingual datasets found systematic problems in the lower-resource corpora, with several holding less than half acceptable-quality sentences and dozens carrying the wrong language label altogether (Kreutzer et al., 2022). When a model answers your client in Amharic, that can be the material underneath it.
Because the text does not exist, companies pay to create it, scanning, transcribing, translating, recording, and writing the missing language. Meta released a translation model covering 200 languages (Meta AI, No Language Left Behind), and organizations such as Karya pay rural workers in India to record speech in their own languages, then sell the datasets to large technology companies (Karya). Both things are true at once. A language with almost no digital record can gain one, and the people who supplied it are usually paid contract rates, keep no ownership of the resource, and then watch the capability get sold back to them. Consent, pay, and who ends up owning the corpus decide which of the two it is.
A separate stream of work makes the model safe and agreeable, rating answers, ranking which reply is better, and filtering violent and sexual material out of the training data. Most of it happens in English, and it is outsourced to countries where English is widely spoken and wages are low, a pairing that exists because of colonial education systems. Reporting documented Kenyan workers paid on the order of two dollars an hour to read traumatic material so a chatbot would not repeat it (Perrigo, 2023), and peer-reviewed research on data-work platforms in Latin America found the same structure, in which the people who produce the data hold the least power in the chain (Miceli & Posada, 2022).
The published material was largely unlicensed as well. Authors sued Anthropic over millions of books, including copies pulled from pirate libraries and print books the company bought, sliced apart, and scanned (Washington Post, 2026); that case settled for about $1.5 billion. Newspapers led by the New York Times are still litigating against OpenAI (Reuters, 2026). One federal judge has held that training on lawfully obtained books is fair use and that downloading pirated ones is not. Other cases remain open, and the bill is unsettled.
Two injustices run through this, and they are not the same one. The languages your clients speak were left out of the data. The labor that made the tool usable was bought cheaply in places much like the ones they came from.
The energy and the water it takes
Every answer you get was computed in a building, on hardware that draws power and needs cooling. Your single question is small. The buildout behind it is not.
How much electricity this uses
Google measured its own assistant and reported a median text prompt at about 0.24 watt-hours of electricity and 0.26 millilitres of water, roughly nine seconds of television and five drops (Google, 2025). Other estimates for a chatbot query run closer to 2.9 watt-hours, about ten times a web search (MIT Technology Review, 2025). Estimates differ by an order of magnitude, they usually leave out the training run and the manufacture of the hardware, and the companies that could settle the question mostly do not publish.
US data centers used about 4.4 percent of the country's electricity in 2023, and a Department of Energy laboratory projects between 6.7 and 12 percent by 2028, with AI as the main driver (Lawrence Berkeley National Laboratory, 2024). Your one prompt is a rounding error. The demand curve that many prompts add up to is what gets a power plant built.
A reasoning model that thinks for a minute, a long document pushed through a large model, and an image or a video cost far more than a short question to a light model. Beyond speed and money, this is a third reason to leave the light model as the default and reach for the heavy one deliberately. A small model doing one narrow job is the cheapest arrangement on every axis, including this one.
Data centers go up somewhere, and the somewhere is rarely wealthy. In Memphis, a company powered an AI data center with dozens of gas turbines next to a historically Black neighborhood that already carried a heavy pollution burden, and it drew a Clean Air Act suit and organized community opposition (TIME, 2025). In Santiago, an environmental court sent a data center permit back for revision after residents challenged a plan to draw about 7.6 million litres of drinking water a day from a strained aquifer (Municipality of Cerrillos v. Evaluation Commission, 2024). The benefit is global and the water is local, and the people who live beside the turbines are the ones who should decide whether they get built.
Not much alone, and that is no reason to look away. Use the tool when it earns its place and skip it when a template would do. Keep the light model as the default. When your agency buys a tool, put the question into the procurement conversation and ask the vendor for numbers. And if a data center is proposed near the communities you serve, the residents having a say in it is the whole point, not a formality.
Guilt over one prompt changes nothing, and neither does ignoring the buildout. Ask what the tool is for, keep it in proportion, and notice that the people who carry the local cost of this infrastructure look a lot like the people you serve.
- Deskilling is not a personal failing. It is what happens by default when a tool does the part of the job you used to practice, so it has to be designed against.
- A vendor's published footprint number is a floor, not a total. It usually leaves out the training run and the making of the chips.
- Water figures and energy figures are not the same claim. Some count only the cooling water at the building, others also count the water used to generate the electricity.
- An open-weight model does not undo any of this. The weights were still trained on the same data by the same labor.
- Your clients may raise this before you do. "AI stole from artists" and "AI runs on cheap labor" are close enough to true that a flat denial will cost you credibility.
Say it in two sentences
Put the group in pairs. One person plays a client who asks, "Isn't that thing built by stealing people's work?" The other answers in two sentences, honestly, without defending the industry and without pretending the tool is not being used. Then swap, and try it again with "Doesn't using that make you worse at your job?" Nobody is looking for a script. You want to hear yourself say something true about the tool you are handing someone, so that the first time you say it is not in front of a client. Then go back to the worries you listed at the start and mark which ones this module answered.
Sources for this page
- Bastani, H., Bastani, O., Sungu, A., Ge, H., Kabakci, O., & Mariman, R. (2025). Generative AI without guardrails can harm learning: Evidence from high school mathematics. Proceedings of the National Academy of Sciences, 122(26). https://doi.org/10.1073/pnas.2422633122
- Budzyn, K., et al. (2025). Endoscopist deskilling risk after exposure to artificial intelligence in colonoscopy: A multicentre, observational study. The Lancet Gastroenterology & Hepatology. https://www.thelancet.com/journals/langas/article/PIIS2468-1253(25)00133-5/abstract
- Google. (2025). Measuring the environmental impact of delivering AI at Google scale. arXiv:2508.15734. https://arxiv.org/abs/2508.15734
- Joshi, P., Santy, S., Budhiraja, A., Bali, K., & Choudhury, M. (2020). The state and fate of linguistic diversity and inclusion in the NLP world. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 6282-6293. https://doi.org/10.18653/v1/2020.acl-main.560
- Karya. Case studies: speech and text data collection in Indian languages. https://www.karya.in/
- Kreutzer, J., Caswell, I., Wang, L., Wahab, A., van Esch, D., Ulzii-Orshikh, N., et al. (2022). Quality at a glance: An audit of web-crawled multilingual datasets. Transactions of the Association for Computational Linguistics, 10, 50-72. https://doi.org/10.1162/tacl_a_00447
- Lawrence Berkeley National Laboratory. (2024). 2024 United States data center energy usage report. https://eta-publications.lbl.gov/sites/default/files/2024-12/lbnl-2024-united-states-data-center-energy-usage-report_1.pdf
- Lee, H.-P., Sarkar, A., Tankelevitch, L., Drosos, I., Rintel, S., Banks, R., & Wilson, N. (2025). The impact of generative AI on critical thinking: Self-reported reductions in cognitive effort and confidence effects from a survey of knowledge workers. Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3706598.3713778
- Meta AI. No Language Left Behind: Machine translation for 200 languages. https://ai.meta.com/research/no-language-left-behind/
- Miceli, M., & Posada, J. (2022). The data-production dispositif. Proceedings of the ACM on Human-Computer Interaction, 6(CSCW2), Article 460. https://doi.org/10.1145/3555561
- MIT Technology Review. (2025, August 21). In a first, Google has released data on how much energy an AI prompt uses. https://www.technologyreview.com/2025/08/21/1122288/google-gemini-ai-energy/
- Municipality of Cerrillos (Google Data Center) v. Evaluation Commission of the Metropolitan Region (2024). Climate Change Litigation Databases, Sabin Center for Climate Change Law. https://www.climatecasechart.com/document/municipality-of-cerrillos-google-data-center-v-evaluation-commission-of-the-metropolitan-region_7d3a
- Perrigo, B. (2023, January 18). Exclusive: OpenAI used Kenyan workers on less than $2 per hour to make ChatGPT less toxic. TIME. https://time.com/6247678/openai-chatgpt-kenya-workers/
- Reuters. (2026, July 9). New York Times-led group asks court to sanction OpenAI in US copyright dispute. https://www.reuters.com/legal/litigation/new-york-times-led-group-asks-court-sanction-openai-us-copyright-dispute-2026-07-09/
- TIME. (2025). Inside Memphis' battle against Elon Musk's xAI data center. https://time.com/7308925/elon-musk-memphis-ai-data-center/
- The Washington Post. (2026, January 27). Anthropic "destructively" scanned millions of books to build Claude. https://www.washingtonpost.com/technology/2026/01/27/anthropic-ai-scan-destroy-books/