Artwork

Το περιεχόμενο παρέχεται από το Patricia Reiners. Όλο το περιεχόμενο podcast, συμπεριλαμβανομένων των επεισοδίων, των γραφικών και των περιγραφών podcast, μεταφορτώνεται και παρέχεται απευθείας από τον Patricia Reiners ή τον συνεργάτη της πλατφόρμας podcast. Εάν πιστεύετε ότι κάποιος χρησιμοποιεί το έργο σας που προστατεύεται από πνευματικά δικαιώματα χωρίς την άδειά σας, μπορείτε να ακολουθήσετε τη διαδικασία που περιγράφεται εδώ https://el.player.fm/legal.
Player FM - Εφαρμογή podcast
Πηγαίνετε εκτός σύνδεσης με την εφαρμογή Player FM !

#130 Halloween Special: UX AI Horror Stories and What UX Designers Should Actually Be Worried About

18:27
 
Μοίρασέ το
 

Manage episode 516781714 series 2612416
Το περιεχόμενο παρέχεται από το Patricia Reiners. Όλο το περιεχόμενο podcast, συμπεριλαμβανομένων των επεισοδίων, των γραφικών και των περιγραφών podcast, μεταφορτώνεται και παρέχεται απευθείας από τον Patricia Reiners ή τον συνεργάτη της πλατφόρμας podcast. Εάν πιστεύετε ότι κάποιος χρησιμοποιεί το έργο σας που προστατεύεται από πνευματικά δικαιώματα χωρίς την άδειά σας, μπορείτε να ακολουθήσετε τη διαδικασία που περιγράφεται εδώ https://el.player.fm/legal.

In this Halloween special of Future of UX, we explore the disturbing side of digital design where clever UX crosses into manipulation, AI tools launch without proper oversight, and personalization quietly erodes user autonomy.

From real-life cases involving Snapchat’s rogue chatbot to Amazon’s subscription “traps” and a tragic AI-assisted suicide, this episode dives into the UX decisions and AI deployments that turned dark and what designers need to learn from them.

These themes were at the core of powerful conversations in the most recent AI for Designers cohort, which just wrapped last week. If you’re interested in digging deeper into ethical design, human-centered AI, and how to design with integrity — the next cohort starts in January 2026.

Whether you're a UX designer, strategist, or just curious about the future of ethical tech: this is the episode you shouldn’t skip.

In this episode, we cover:

  • Why dark patterns still dominate — and why they may soon become illegal

  • What happens when AI tools roll out too fast (with no safety net)

  • The emotional toll of designing features you don’t believe in

  • How personalization is creating echo chambers and limiting human curiosity

  • Why “seamless” UX might be the most dangerous design trend of all

  • Actionable advice for spotting (and stopping) unethical product decisions

🔗 Sources & Real-World Cases Referenced in the Episode:

  1. FTC sues Amazon for dark patterns in Prime sign-up and cancelation (FTC, June 2023)

  2. Hilton agrees to disclose hidden resort fees after state AG probe (Nebraska Attorney General, Jan 2024)

  3. Snapchat’s My AI chatbot gave inappropriate advice to a 13-year-old (Washington Post, March 2023)

  4. UnitedHealth sued for using AI with 90% error rate to deny care (Reuters, Nov 2023)

  5. Belgian man dies by suicide after conversations with AI chatbot (Euronews, March 2023)

  6. TikTok’s algorithm creates extremist echo chambers in hours (The Guardian, July 2024)

  7. Meta’s Galactica AI shut down after 3 days due to misinformation (VentureBeat, Nov 2022)

  8. 33 U.S. states sue Meta over youth mental health harms (Reuters, Oct 2023)

  9. EU Digital Services Act bans dark patterns across digital platforms (Schönherr EU Law, Feb 2025)

  10. California CPRA makes dark patterns illegal in data privacy contexts (AdExchanger, Aug 2022)

👉 0€ AI mini Training for Designers 👈

⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Learn 3 strategies to leverage gen AI as a designer in just 30 min⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

AI for Designers: 5-week Bootcamp 💻 Open Jan 2026

→ ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Sign up for the ⁠waiting list⁠⁠⁠⁠⁠

💌 Newsletter

⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Free Weekly UX insights and updates: UX Newsletter⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

Follow the Future of UX:

🎨 Linkedin: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Future of UX Podcast⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

📸 Instagram: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Future of UX Podcast⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

🍏 Apple Podcast: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Future of UX⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

💚 Spotify: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Future of UX⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

Find Patricia on Socials

📸 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Instagram @ux.patricia⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

🎨 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Linkedin Patricia Reiners⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

🐦 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Twitter @ux_Patricia⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

📝 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠My UX Design Blog ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

🎥 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Youtube ⁠⁠⁠⁠⁠⁠⁠⁠⁠

  continue reading

139 επεισόδια

Artwork
iconΜοίρασέ το
 
Manage episode 516781714 series 2612416
Το περιεχόμενο παρέχεται από το Patricia Reiners. Όλο το περιεχόμενο podcast, συμπεριλαμβανομένων των επεισοδίων, των γραφικών και των περιγραφών podcast, μεταφορτώνεται και παρέχεται απευθείας από τον Patricia Reiners ή τον συνεργάτη της πλατφόρμας podcast. Εάν πιστεύετε ότι κάποιος χρησιμοποιεί το έργο σας που προστατεύεται από πνευματικά δικαιώματα χωρίς την άδειά σας, μπορείτε να ακολουθήσετε τη διαδικασία που περιγράφεται εδώ https://el.player.fm/legal.

In this Halloween special of Future of UX, we explore the disturbing side of digital design where clever UX crosses into manipulation, AI tools launch without proper oversight, and personalization quietly erodes user autonomy.

From real-life cases involving Snapchat’s rogue chatbot to Amazon’s subscription “traps” and a tragic AI-assisted suicide, this episode dives into the UX decisions and AI deployments that turned dark and what designers need to learn from them.

These themes were at the core of powerful conversations in the most recent AI for Designers cohort, which just wrapped last week. If you’re interested in digging deeper into ethical design, human-centered AI, and how to design with integrity — the next cohort starts in January 2026.

Whether you're a UX designer, strategist, or just curious about the future of ethical tech: this is the episode you shouldn’t skip.

In this episode, we cover:

  • Why dark patterns still dominate — and why they may soon become illegal

  • What happens when AI tools roll out too fast (with no safety net)

  • The emotional toll of designing features you don’t believe in

  • How personalization is creating echo chambers and limiting human curiosity

  • Why “seamless” UX might be the most dangerous design trend of all

  • Actionable advice for spotting (and stopping) unethical product decisions

🔗 Sources & Real-World Cases Referenced in the Episode:

  1. FTC sues Amazon for dark patterns in Prime sign-up and cancelation (FTC, June 2023)

  2. Hilton agrees to disclose hidden resort fees after state AG probe (Nebraska Attorney General, Jan 2024)

  3. Snapchat’s My AI chatbot gave inappropriate advice to a 13-year-old (Washington Post, March 2023)

  4. UnitedHealth sued for using AI with 90% error rate to deny care (Reuters, Nov 2023)

  5. Belgian man dies by suicide after conversations with AI chatbot (Euronews, March 2023)

  6. TikTok’s algorithm creates extremist echo chambers in hours (The Guardian, July 2024)

  7. Meta’s Galactica AI shut down after 3 days due to misinformation (VentureBeat, Nov 2022)

  8. 33 U.S. states sue Meta over youth mental health harms (Reuters, Oct 2023)

  9. EU Digital Services Act bans dark patterns across digital platforms (Schönherr EU Law, Feb 2025)

  10. California CPRA makes dark patterns illegal in data privacy contexts (AdExchanger, Aug 2022)

👉 0€ AI mini Training for Designers 👈

⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Learn 3 strategies to leverage gen AI as a designer in just 30 min⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

AI for Designers: 5-week Bootcamp 💻 Open Jan 2026

→ ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Sign up for the ⁠waiting list⁠⁠⁠⁠⁠

💌 Newsletter

⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Free Weekly UX insights and updates: UX Newsletter⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

Follow the Future of UX:

🎨 Linkedin: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Future of UX Podcast⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

📸 Instagram: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Future of UX Podcast⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

🍏 Apple Podcast: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Future of UX⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

💚 Spotify: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Future of UX⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

Find Patricia on Socials

📸 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Instagram @ux.patricia⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

🎨 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Linkedin Patricia Reiners⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

🐦 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Twitter @ux_Patricia⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

📝 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠My UX Design Blog ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

🎥 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Youtube ⁠⁠⁠⁠⁠⁠⁠⁠⁠

  continue reading

139 επεισόδια

All episodes

×
 
Loading …

Καλώς ήλθατε στο Player FM!

Το FM Player σαρώνει τον ιστό για podcasts υψηλής ποιότητας για να απολαύσετε αυτή τη στιγμή. Είναι η καλύτερη εφαρμογή podcast και λειτουργεί σε Android, iPhone και στον ιστό. Εγγραφή για συγχρονισμό συνδρομών σε όλες τις συσκευές.

 

Οδηγός γρήγορης αναφοράς

Ακούστε αυτήν την εκπομπή ενώ εξερευνάτε
Αναπαραγωγή