Original Post — Direct link

Title explains everything basically. I submitted a ticket to Riot after encountering someone being homophobic and transphobic in champ select, typing slurs in 2 different lines to avoid the auto-mute system.

I checked my email this morning and I saw that they'd accidentally left "Character.AI" in the reply body: https://imgur.com/ILJVJ44

About an hour or so later, the ticket was edited to cover this up: https://imgur.com/a/gNhKgWe

(Support agent's name and picture have been censored to protect their privacy)

For context, Character.AI is an AI chatbot website where users can configure the chatbot to behave like any character that they define. In this case, it seems as if the support ticket response was generated through a Character.AI chatbot designed specifically to respond to support tickets. It is unclear whether Riot is allowing AI chatbots to be used for support tickets, or if this specific support agent took advantage of AI chatbots to make their job a bit easier.

I understand that support tickets are typically very repetitive and justify this sort of automation to an extent, but it feels very disingenuous to use AI as a means of replying to a support ticket without disclosing it.

EDIT: I responded to the ticket mentioning that I noticed the edit and asked if the replies were being written by AI. A different Rioter responded:

I’m Riot Castmoore and I oversee some of our work on Player Support. ChatGPT and similar AI emergent tech is evolving rapidly and we haven’t had this issue come up before so I wanted to look into it personally.

We’re still looking into exactly what happened here, but the short answer is no. Individual agents often use personalized macros to help respond to players more quickly, but we do not write responses using AI, or submit any player information into any AI platform. When we do use AI in the player support process, we’re up front about it. It looks like, as part of prepping their ‘macro’ response for questions like this, this agent used some AI-generated language. This is not part of our best practices or protocol, and should not have happened.

You may have seen some automated responses from Blitzcrank Bot and our online chat widget which identifies and discloses that it is AI. This is about 15% of all ticket responses.

We do not use Character.AI or have any relationship with them, nor do we use other AI’s like ChatGPT to generate responses to players. And just to be super clear, we don’t allow player requests to go through any tool outside of our secure network. This was an individual agent error and shouldn’t have happened. That being said, we’re all adapting to the emergent AI landscape and there’s a lot of takeaways and learnings from this interaction.

Thank you for reaching out about this.

TL;DR Riot themselves is not encouraging or allowing the use of AI to respond to tickets, and they also pointed out the risks of a private ticket communication being passed through an external network. They've assured me that this was an individual agent error.

External link →
11 months ago - /u/RiotSmileyjoe - Direct link

Hey all,

Confirmed with Player Support that they’ve responded to OP on this (think OP is offline for the night) but wanted to respond here too since people have some questions and concerns.

To answer the big questions here: we don’t write responses using AI and if you’re talking to AI when you’re communicating with Riot Support then we’ll tell you.

The team is still sorting through what happened here, but here's some context. We maintain pre-saved phrases and responses that we encourage agents to use as the baseline in responses for common issues. This helps ensure that there’s consistency plus it speeds things up. Agents can adapt these to their own voice and save them in their accounts to respond to players when there's language that works for them. In this case, this individual agent used some AI-generated language as part of their saved response. Writing any part of a response with AI isn't part of our protocol and shouldn't have happened.

Couple points about how we use AI: - we do use chat bots and automated responses in some cases (~15% of tickets) - we're honest about it every time we’re using automated responses (like BlitzBot and our online chat widget) - we don’t use character.ai or have any relationship with them - we don’t use other AI’s like chatgpt to generate responses to players - we don’t allow player tickets to go through any tool outside of our secure network

Hope that helps clear some of this up. There’s a lot of discussion happening inside the team coming out of this and we appreciate OP letting us know.

11 months ago - /u/RiotSmileyjoe - Direct link

Originally posted by IZCH12

Just a more efficient way to copy/paste the messages you'd receive anyway.

Yes and no. Easy copy/paste responses are part of our approach to player support but AI-written ones (at least like this) aren’t.

The team is still sorting through what happened here, but to answer the big questions here: we don’t write responses using AI and if you’re talking to AI when you’re communicating with Riot Support then we’ll tell you.

We do maintain pre-saved responses for agents to use as the baseline for their response for common issues. This helps ensure that there’s consistency plus it speeds things up. Agents can adapt these to their own voice and save them in their accounts to respond to players. In this case, this individual agent used some AI-generated language as part of their saved response. Writing any part of a response with AI isn't part of our protocol and shouldn't have happened.

Couple points about how we use AI: - we do use chat bots and automated responses in some cases (~15% of tickets) - we're honest about it every time we’re using automated responses (like BlitzBot and our online chat widget) - we don’t use character.ai or have any relationship with them - we don’t use other AI’s like chatgpt to generate responses to players - we don’t allow player tickets to go through any tool outside of our secure network

Hope that helps clear some of this up. There’s a lot of discussion happening inside the team coming out of this and we appreciate OP letting us know.

11 months ago - /u/RiotSmileyjoe - Direct link

Originally posted by TheGreatWalk

Not gonna lie, this reads exactly like ChatGP response

I was here first so i like to think chat gpt sounds like me, not the other way around

11 months ago - /u/RiotSmileyjoe - Direct link

Originally posted by Morkinis

Prompt: write a reddit apology comment denying use of AI in ticket responses. /s

I gave it a try:

Me: Can you help me write a response to a thread on reddit? I need to respond to questions about whether a video game company is using artificial intelligence as part of its customer support program. The company does use AI for some things, but not in the way the thread suggests.

ChatGPT: Sure! I can help you write a response. Could you provide me with the questions and the suggested way in which the company's AI is being used for customer support, so that I can assist you in crafting an appropriate response?

Me: Sure! The company uses AI to respond to routine inquiries that can be easily addressed (I lost my password, etc.). But most (85% or more) of responses are provided by real human agents, often using previously written statements. The thread alleges that these previously written statements were written using AI, which isn't the case.

ChatGPT: Here's a response you can use for the thread:

"Hey everyone, I wanted to chime in and clarify some information regarding the use of artificial intelligence (AI) in our customer support program at [Company Name]. While it's true that we do incorporate AI into certain aspects of our customer support, it's not used in the way that some have suggested in this thread. To provide efficient and timely responses to routine inquiries, such as password resets and common troubleshooting steps, we employ AI technology. These inquiries can often be addressed with standardized solutions, and AI helps us handle them swiftly. However, it's important to note that the majority of responses, approximately 85% or more, are provided by real human agents. Our team of dedicated support representatives takes pride in personally assisting our customers and ensuring their issues are addressed with care and attention to detail. There seems to be a misconception that the previously written statements used by our human agents were generated by AI. I want to clarify that this is not the case. These statements are crafted by our support team members based on their expertise and experience, allowing them to provide consistent and accurate responses to frequently encountered issues. At [Company Name], we value the human touch in customer support, and our primary focus is to deliver exceptional service to our community. AI is employed to complement our efforts by handling routine inquiries, while our talented human agents handle more complex and specialized customer needs. If you have any specific concerns or questions about our customer support program, please feel free to ask. We're here to address any inquiries you may have. Thank you!"