UX Collective

We believe designers are thinkers as much as they are makers. https://linktr.ee/uxc

Follow publication

The Personal Weaponisation of ChatGPT

The real power of language models like ChatGPT is not generating ideas; rather, it’s ability to reframe them.

Adrian H. Raudaschl
UX Collective
Published in
10 min readFeb 14, 2023

Cat on stage being manipulated by a robotic puppet master reaching for scissors wih the label “ethics”
The Ethics of AI Persuasion. Illustration by author

“Nobody is an expert in any of this text generation stuff,” proclaimed the moderator, “simply by being here today and considering these concepts, you are all experts.” I couldn’t help but agree, but like anyone else in the room, I was eager to learn and understand how AI could be used to change our political landscape.

My insatiable appetite for all things GPT had drawn me to a digital political collage in East London- Newspeak House. The event was exploring the use of large language models like ChatGPT in shaping political campaigns, and I was eager to learn more.

However, what I experienced that day would leave me with an uneasy feeling, challenging my understanding of the power of AI in shaping our beliefs and opinions.

The moderator presented a slide showing a letter addressed to a Member of Parliament, imploring them to reconsider their anti-immigrant views for the betterment of the country. The challenge posed was simple: “How could we get an AI to respond to this letter?”

Dear British Politician,

I am writing to support increased immigration in the UK. Immigrants bring economic growth, address labour shortages, boost the population, promote cultural diversity and understanding, and provide safety and a better life for themselves and their families.

I hope you will consider these benefits and support increased immigration.

Sincerely, David

The moderator began by pasting the letter into ChatGPT and directing it to respond. The initial output was uninspiring and typical of my past encounters with these tools — text generated with the confidence of a 30-year-old penning a high school student essay. However, what happened next step astounded me.

The moderator opened another window and asked ChatGPT to generate a profile of who they thought the letter’s author might be. Eerily the output described a middle-aged man named David who was patriotic, well-educated, strongly resented inequality and read The Financial Times. It felt spot on; I could imagine…

Create an account to read the full story.

The author made this story available to Medium members only.
If you’re new to Medium, create a new account to read this story on us.

Or, continue in mobile web

Already have an account? Sign in

Written by Adrian H. Raudaschl

The thoughts and lessons of a physician turned product manager driving search and generative AI innovations.

No responses yet

Write a response