Archive

Posts Tagged ‘tribunal 2.0’

 

Red Post Collection May 23 Banner

 

Official Announcements

Red Post Collection

Single Posts

Too Long, Didn’t Read

 

Recent News

 

PBE-May-22-Banner

Riotrepertoir-Continued-Nidalee-Rework-QA-Banner

RiotSeb-Upcoming-Champion-Updates-Banner2

 

 

Rune Page Sale Banner

Enjoy a 2-for-1 deal for two weeks during the Rune Page Sale!

 

Here at Riot Games we know the value of a good book – especially if that book happens to be loaded with powerful arcane runes. So to help you get the most out of your seals, marks, glyphs and quintessences, we’re holding a sale on Rune Pages.

Between May 23rdand June 6th at 11:59 PM PST you’ll receive two rune pages for the price of one on purchases made with either RP or IP.

You’ll find the 2 for 1 Rune Pages item in the Bundles tab of the League of Legends store, so don’t miss this chance to bolster your book while they’re on sale.

Please note: this is a pre-announced promotion, meaning that we won’t be offering partial refunds on rune pages bought between now and the sale. Please mark your calendars!

 

 


Lyte Chat Restrictions Banner


 

 Following the recent wave of chat restrictions, Lyte steps on the forums to explain this new automated system, its accuracy and benefits over banning players.

 

 

Q: Can you allow safe chatting for muted players, like “Let’s go fight the Dragon/Baron!”, so they aren’t completely incapable of communicating with teammates?

 

Lyte Button Rioter Lyte: This is certainly a possibility, and something we’ve discussed; however, we have a lot of initial experiments in mind that we want to test out first and see what works best. If we end up needing a way for negative players to communicate with their team that isn’t sufficient with the current chat restriction design, we can figure out a better solution.


I think many players forget that this isn’t a full mute. A lot of studies went into restricted chat design to determine what is the right amount of chat ‘resources’ to give a player, and if players used their chat resources only for team play, they actually can manage pretty well. The current design forces negative players to consider whether they value teamplay (and winning!) more than being verbally abusive.. and we find that most players opt to use their chat resources for positive communication and end up winning more games than they did before.

 

 

Q: Isn’t chat restricting an inaccurate punishment system?

 

Lyte Button Rioter Lyte: Happy to discuss the accuracy because after reviewing a large sampling of the initial chat restrictions, the accuracy is greater than 99.9%–meaning, we didn’t need to overturn or remove any chat restrictions.

 

 

 

Q: Are “wtf are you doing” and “noob” really grounds for punishing a player?

 

Lyte Button Rioter Lyte: There were other examples that I just didn’t feel like displaying. Calling someone noob or spamming report or throwing “wtf u doing” everywhere might not deserve a ban, but that’s why the player received a few games of restricted chat and can still enjoy the game. If a person was throwing death threats out, the penalty would be different.

 

 

 

Q: Are we able to see if we’re on restricted chat?

 

Lyte Button Rioter Lyte: Yes, you’ll get an in-game notification and see a progress update after each game.

 

 

 

 

Q: Is there a way to see where I stand as a player on the bar of toxicity?

 

Lyte Button Rioter Lyte: No, unfortunately progress like this makes it very easy for players to “skirt the line,” and be negative until the point they are close to the line then drop their act until they are further from the line.

 

 

 

 

Q: Do you monitor Champ Select chat?

 

Lyte Button Rioter Lyte: Yes, Champion Select chat is monitored and there’s definitely a correlation between level of communication in Champ Select and in-game performance of a team.

 

 

 

 

Q: How did you reach a 99.99% number in terms of restriction accuracy?

 

Lyte Button Rioter Lyte: Happy to go into detail about the numerous sampling methods that are used to determine the accuracy of a system. We often use methods that are far more stringent than scientists use in academia because every action we take impacts a player’s experience.

For the early experiments (even way back when Tribunal first started), we reviewed and used multi-party reviews for 100% of cases. We even had numerous test-runs where multiple people had to review cases independently, then debate the cases where there were disagreements.

Why assume that we ‘only reviewed a few cases?’

 

 

Q: Is it true the system is almost 100% accurate?

 

Lyte Button Rioter Lyte: There’s a lot of reasons why something might be close to 100% accurate. I didn’t say 100% because it’s impossible for a system to have no errors unless we hand-checked every single case.

However, let’s say that the system only hands out penalties to 100 people at a time, and 99 of those cases are reviewed by at least 1 Player Support staff each time. In that case, if there are no false positives, we can say that the system was almost 100% accurate… or 99.9% accurate.

Or, let’s say that we’re using a language analysis model that is highly sophisticated and analyzes millions of chat logs and determines the worst 1% of players that exhibited the most verbal abuse. If we then handed out chat game restrictions to the worst half (so the worst 0.5%) of the players, we can safely say that we probably did not have many false positives. 

There’s many, many ways you can have a system that’s close to 100% accuracy. It all depends on the methodology and the context.

 

 

Q: Are Rioters also liable to banning if their in-game behavior is inappropriate?

 

Lyte Button Rioter Lyte: Rioters are judged at an even higher standard, so if you see negative behavior in-game please report it. There’s been a few times we’ve had to penalize a Rioter but thankfully it’s been extremely rare.

 

 

 

Q: If you are so confident in the accuracy of chat bans, shouldn’t you then be banning players?

 

Lyte Button Rioter Lyte: I think you’re suggesting that if we were confident with our systems, we’d just ban players instead?

We actually use restricted chat bans because they are more effective than game bans. We find that game bans nudge a lot of players to create smurf accounts and simply shift their negative behaviors to low levels and overall, that’s a worst experience for the community.

During restricted chat design testing, we tested several variants to ensure that the typical player had enough chat resources to communicate effectively with their team. The current setup (with smart pings) is decent for team communication for most players, although we acknowledge that junglers have a bit more difficulty in the current setup. 

What’s interesting to note is that many restricted chat players are actually winning more games than they were before being in restricted chat; so, I’m not as convinced as you are that the mode is hurting the rest of the team as much as you might believe.

 

 

Q: Is this automated system the “new Tribunal”?

 

Lyte Button Rioter Lyte: New Tribunal is a ways out, we’re working on some experiments (like the ones mentioned here) in the mean time to test several ideas that may end up being incorporated into the new system.

 

 

 

Q: What exact penalties would a Rioter incur? 

 

Lyte Button Rioter Lyte: The penalties are more severe and there have been real-world consequences, but this isn’t the place to discuss these issues.

 

 

 

 

Q: When I was using the Tribunal before it was taken down, I was getting fewer and fewer cases where I could justify pardoning the accused. Was this the result of continued refinement of the algorithms that are now taking its place?

 

Lyte Button Rioter Lyte: Yes, and this is part of a design issue we’d like to address. If we kept improving the algorithms and who we funnel into the system, it became harder and harder for players to be diligent and review every choice meaningfully because they knew intuitively that most cases should be punished.

In the future, because you can review positive, neutral and negative behaviors, it’ll always force players to review carefully because who knows, they could be rewarding someone and making someone’s day.

 

 

Q: How would the new Tribunal be communicated with players?

 

Lyte Button Rioter Lyte: It’s a little too early to tell what we should do, but as you know, we love to have these discussions directly with the community so they can give feedback, have discussions of their own, and share the information with others.

So, I don’t know exactly what kind of Q&As or discussions we’ll have, but we’ll do our best to have some when the time comes 

 

 

Q: Have we come to a point where any offensive language is punished?

 

Lyte Button Rioter Lyte: It’s a great question, and one that I think needs more context. As others have mentioned, there’s a difference between “wtf” once in a game, and:

“wtf what are you doing”
“wtf this yasuo noob”
“report him pls”
“****, do you even know how to play”
“what the fuk, uninstall”

Secondly, those examples were just a very small (1%) of the things that were flagged. As much as possible and especially in recent months, we’ve tried not to copy-paste a player’s chat logs or their worst offenses because it creates a witch-hunt mentality. So, when I responded to the player with some general trends, they were an average chat log–players don’t need to see copy-pastes of the player’s entire list of offenses.

To the original point, what do we expect out of players? Well, 95% of players were not affected by Tribunal bans, and about 95% were not affected by chat restriction experiments so far–clearly, most players are perfectly fine in matches and have no problem staying within bounds.

We’re not out to get offensive language, and we don’t expect players to tip-toe around or offensive language. Many players say “****, missed that skill shot!” or “****, close fight, we almost had that!” and no one gets punished for such language. 

Everyone that got hit by restricted chat bans recently clearly crossed the line. Whether it was the repeated nature of the language or the severity of the language, something triggered the system way beyond the norm of what your typical “teen” game should have.

 

 

Q: How are these chat restrictions handed out?

 

Lyte Button Rioter Lyte: We’ll look into revealing some context and information around some of the experiments in the future. We’re trying a lot of different things while Tribunal is being upgraded, and “automated” was probably the wrong word to use.

By “automated,” we simply meant that it is possible for a penalty to be handed out more quickly after a negative action. Sometimes in the Tribunal a negative action would happen and it’d be a month before the player received a notification or feedback about it. 

To give you brief glimpse into what one experiment is testing, first, we have to understand that the Reporting system is different than the Tribunal system. The Reporting system’s sole job is to calculate a player’s report accuracy, and a lot of fancy math has gone into the system to make sure that a report is only taken into account when it is accurate. So, if a player is a consistently negative player themselves, their reports might be worth less because the system may consider them a bad judge of others’ behaviors. If a player troll reports and gets their 3 friends to troll report, the system will completely toss the reports out. All of the experiments that use reports benefit from the above system to make sure that players aren’t able to just abuse someone with random reports. 

Secondly, we have a system that’s been analyzing millions of chat logs, and become quite good at detecting whether a conversation in a game is negative or positive. I presented some of this work at the previous Game Developer’s Conference. It’s an interesting system because the more chat logs you feed the system, the more accurate it becomes at determining whether a player communicates more positively or negatively than the average player in League of Legends. 

As you can imagine, by combining reports, Player Support reviews, the chat log analysis and in-game metrics in different forms, we can do some pretty interesting (and accurate) experiments. In addition, when it comes to the player experience, we’re always quite conservative with penalties. Let’s say (for today’s example) that a player can have a score between 1 and 100, where 100 is super awesome and 1 is super not awesome. Even though we might all agree that players 25 and below deserve a penalty, we’ve set all our experiments to be very conservative initially and penalize players 5 and below (as an example) so that we can slowly gauge the accuracy of the systems before we expand the thresholds.

Anyways, happy to figure out with the team which experiments would be cool to talk to players about in the future but for now, we’re hoping that players are seeing an improved in-game experience.

 

 

Q: Is what you’re hinting at here an AI System?

 

Lyte Button Rioter Lyte: Machine learning, predictive modeling, sentiment analysis, etc.

That’s the most I can reveal without being kidnapped by our researchers.

 

 

 

Q: Will you publish these findings about controlling player behavior?

 

Lyte Button Rioter Lyte: This is something we’re debating a lot internally. We’d love to give back to the academic community and have done some collaborations, but we have to balance spending time contributing back to academics and making sure we’re always focused on making cool stuff for players.

 

 

 

Morello Upcoming Soraka Rework Banner

 

Soraka is slated for a complete rework this year, following her rising issues with solo-lane dominance and support role irrelevance. 

 

 

Q: What do you hope to solve with Soraka’s rework?

 

morellovatar  Button Rioter Morello: Valid feedback – I think the rework needs to solve “how does Soraka become healthy”, which is prioritized for this year unless all Hell breaks loose. These nerfs should be targeted at unfightable mid-lane, and hitting the things that make her particularly oppressive there.

One approach on these “busted” characters is the Kass/Grags approach we like. Nerf in the short term while we get the rework out as soon as it makes sense. Since we’re actively working on a shipping plan for Soraka, this would be part of that.

 

 

Follow-up

 

morellovatar  Button Rioter Morello: I’m excited to get this done. I feel this is getting to Evelynn levels of “oops”. I’ll be relieved to get this done, and intellectually I’m excited to look at the healing paradigm under a fresh lens.

 

 

 

Q: Why wasn’t Soraka left unchanged until her rework, like Kassadin?

 

morellovatar  Button Rioter Morello: Because this was something we really realized when working on Kassadin of how problematic it tends to be. There’s more here, LeBlanc, Talon, etc, but we’re trying to address them AS they become problems so we don’t have these “wait, wtf, why are you nerfing Talon?” issues.

Since we learn as we work on stuff, we tend to evolve our understanding of root causes on these issues over time – especially as player skill improves, and exposes things that were more manageable before.

As for the damage changes, I’ll have to ask Statikk – I only was really involved in the conversation around E. That might be to lower burst and increase total damage, but I do get that it risks TankRaka being insane.

 

 

Q: So, everything about Soraka should be changed?

 

morellovatar  Button Rioter Morello: In this, we agree 🙂

 

 

 

 

Q: Could you at least preserve her healer archetype?

 

morellovatar  Button Rioter Morello: We’d like to try to make healing work – this is extraordinarily difficult to make rich or interesting to anyone but Soraka. My stance on this is still really unhopeful, but we’re exploring that first.

I know of non-caster models in which healing can work, but feel that violates Soraka too.

 

 

Q: Did you intend to slowly make Soraka irrelevant in the meta?

 

morellovatar  Button Rioter Morello: It’s kind of hilarious to see what the “intent” argument is. There is a thing to call us out on here, and it’s that we’ve been chicken-shits (me included) about doing this rework because we know it’s not going to be “here’s a Soraka buff!” We’ve remedied that 🙂

 

 

Suggestion: Make Soraka use her own health to heal allies

 

morellovatar  Button Rioter Morello: “Infuse healer” is one of my favorite models (in GW1, this was the most interesting healer strategically). It creates windows and big moments while still feeling very “healer.”

 

 

 

Single Posts banner


 

 

Q: Is Urgot still on the line for a rework?

 

RiotScruffy  Button Rioter RiotScruffy: Just because Urgot isn’t currently in progress doesn’t mean we’ve forgotten about him. It’s really the hardest thing having so many champs that need love, but we would rather do them one at a time and focus on quality rather than rush them all out too fast.

We will definitely get to him in time, keep reminding us.

 

 

Q: Are 3rd Party Skin website illegal?

 

Button Rioter SquidmoX: Hi everyone – just wanted to chime in here.

I work in Player Support and we see these skin sites all the time. I urge everyone here to be EXTREMELY CAREFUL before interacting with any of these sites.

Very often they are scammer sites and have acquired their skin codes through illegitimate means. We see cases all the time where players give sites like this their money and then never see the skin, or worse, provide their account to the scammers and lose it forever.

Use common sense, and think twice before giving your personal information to someone you don’t know. 😀

 

 

Q: Do you plan on bringing limited skins back on sale?

 

Button Rioter SquidmoX: With regards to bringing the old skins out of the vault, this happens periodically. For example, with the recent launch of the SKT skins, we brought back the TPA skins from Season 2. Ditto for Harrowing, we brought out the older skins to join Haunted Zyra.

We want these skins to feel exclusive and limited, that’s why they may only be available for a limited time. They celebrate a specific point and time in League’s history. Snowstorm Sivir or Lunar Goddess Diana wouldn’t feel as special if you could purchase them year round. Sure we may make more money by making them more available, but we aren’t about what makes the most money. We’re about what creates the best experience for the players.

 

 

Q: Will you make the VO for when Karthus ults globally heard?

 

Button Rioter C3Sound: Global dialog is something we don’t do very often, outside of say, Nocturn’s Ult. If he had a one word Iconic line like DARKNESS, then it may be different. However, he has many lines for the ult, and most are much longer than just 1 word. One thing to consider is that by allowing global VO, it would be subjecting other players to hear someone else’s full length VO lines whether they wanted to hear them or not. We definitely hear the feedback, and will give it a round of deliberation! Thanks for the feedback everyone!

 

 

May 23 TLDR Banner


 

1. Lyte has elaborated on the current system to restrict chat over banning players for toxic behavior.

  • The system is close to 100% accurate, meaning almost every case is reviewed and approved by Player Support for punishment.
  • Offensive language in general isn’t restricted and isn’t a cause for banning. Directed hate-speech, however, is.
  • Tribunal 2.0 will be communicated with players, regarding its features & improvements over the existing Tribunal.

2. Morello has shared his plans for a Soraka rework this year.

  • Soraka is too problematic, currently, and the nerf on her E in Patch 4.8 is a band-aid until her Rework comes.
  • The team would like to preserve her healer archetype, but it’s a difficult mechanic to implement in League.
  • Everything about Soraka will likely be changed.

3. 3rd Party Sites that sell Skins are illegal and will most likely scam a potential user.
 

 

If you have any questions, feel free to ask me at @NoL_Chefo.