Reliability Rating Scale with Time

Post a reply

Confirmation code
Enter the code exactly as it appears. All letters are case insensitive.
Smilies
:points: :-D :eyeroll: :neutral: :nmr: :razz: :raging: :-) ;) :( :sick: :o :? 8-) :x :shock: :lol: :cry: :evil: :?: :smirk: :!:
View more smilies

BBCode is ON
[img] is ON
[flash] is OFF
[url] is OFF
Smilies are ON

Topic review
   

If you wish to attach one or more files enter the details below.

Expand view Topic review: Reliability Rating Scale with Time

Re: Reliability Rating Scale with Time

by jmo1121109 » Wed Apr 24, 2019 1:44 am

RR is both too strict and not strict enough currently. It's too strict long term and not strict enough short term.

There isn't a good way for people to gain forgiveness if they were habitual nmr'ers in the past and they aren't punished quickly for beginning to become one.

So the new system which won't be for a little while now will limit to a year's worth of history and add an extra 10-30% RR penalty if you've had an NMR in the last 2-4 weeks. I'll be basing the time frames and % off of the game data we have and frequency of nmr's.

Re: Reliability Rating Scale with Time

by Claesar » Tue Apr 23, 2019 11:10 pm

ChippeRock wrote:
Tue Apr 23, 2019 9:06 pm
Not strict enough? Are you kidding? I CDed a bunch up to 2018. And my RR is still in the low 70s!

I haven't CDed in over a year and a half, played maybe a hundred or so games, and my RR got brought up from high 50s/low 60s to the low 70s.

This needs to be a feature, because people like me who were super unreliable early in their webDip careers shouldn't be punished as severely in their RR if they've cleaned up their act.
That's because you're not counting your NMRs. They hurt your RR as well, as they should. You had about 10 NMRs in 2019, I would estimate. I count 10 NMRs in the 2018 GBT alone last year, and there's many more.

I mean, you haven't entered order in over 6% of your turns. People who set a high RR to their game are exactly trying to prevent that from happening.

In my personal opinion, your RR should be lower than 71%.

Re: Reliability Rating Scale with Time

by ChippeRock » Tue Apr 23, 2019 9:06 pm

Claesar wrote:
Tue Apr 23, 2019 4:08 pm
We are currently thinking about a new method for determining Realibility Rating.

I am personally of the opinion that it isn't harsh enough. It's easy to get your RR back up by playing games. Especially (live) 1v1 games are perfect for this, as they have a lot of turns in small timeframe.
Not strict enough? Are you kidding? I CDed a bunch up to 2018. And my RR is still in the low 70s!

I haven't CDed in over a year and a half, played maybe a hundred or so games, and my RR got brought up from high 50s/low 60s to the low 70s.

This needs to be a feature, because people like me who were super unreliable early in their webDip careers shouldn't be punished as severely in their RR if they've cleaned up their act.

Re: Reliability Rating Scale with Time

by jmo1121109 » Tue Apr 23, 2019 9:04 pm

Yeah that's intended design, not a bug. Mods can refund points if they feel the need, but it isn't automatic for force cd.

Re: Reliability Rating Scale with Time

by Carl Tuckerson » Tue Apr 23, 2019 8:24 pm

I for one see this as a feature not a bug ;)
Mod bounties!! Lol

And yes, the buy-in was 10, so the pot should have been worth 70, so if two people were banned or otherwise kicked and their bet remained, that accounts for the extra 20.

Re: Reliability Rating Scale with Time

by New England Fire Squad » Tue Apr 23, 2019 7:52 pm

Claesar wrote:
Tue Apr 23, 2019 7:45 pm
Carl Tuckerson wrote:
Tue Apr 23, 2019 5:19 pm
New England Fire Squad wrote:
Tue Apr 23, 2019 4:14 pm
http://webdiplomacy.net/board.php?gameID=240363 Just think how high your RR could go if you join this game!
That game had a buy-in of 10 but the pot is 90, how?
Super interesting! If I remember correctly, I noticed two metagamers in the line-up and kicked both out. Apparently their bet remained? I'll discuss this with the team.
It must have- it was 10 buy in and the pot was 90.

Re: Reliability Rating Scale with Time

by Magnetic24 » Tue Apr 23, 2019 7:48 pm

Claesar wrote:
Tue Apr 23, 2019 7:45 pm
Carl Tuckerson wrote:
Tue Apr 23, 2019 5:19 pm
New England Fire Squad wrote:
Tue Apr 23, 2019 4:14 pm
http://webdiplomacy.net/board.php?gameID=240363 Just think how high your RR could go if you join this game!
That game had a buy-in of 10 but the pot is 90, how?
Super interesting! If I remember correctly, I noticed two metagamers in the line-up and kicked both out. Apparently their bet remained? I'll discuss this with the team.
Yes, this happens from time to time. If you'd like I can pull up some games of mine where the same happened. It has to do with banned players, though. I'm sure of it

Re: Reliability Rating Scale with Time

by Claesar » Tue Apr 23, 2019 7:45 pm

Carl Tuckerson wrote:
Tue Apr 23, 2019 5:19 pm
New England Fire Squad wrote:
Tue Apr 23, 2019 4:14 pm
http://webdiplomacy.net/board.php?gameID=240363 Just think how high your RR could go if you join this game!
That game had a buy-in of 10 but the pot is 90, how?
Super interesting! If I remember correctly, I noticed two metagamers in the line-up and kicked both out. Apparently their bet remained? I'll discuss this with the team.

Re: Reliability Rating Scale with Time

by Magnetic24 » Tue Apr 23, 2019 7:45 pm

So long as you don't remove the phases from live games from the equation, like vdip, I am welcome to any change, as I feel as if that would be letting CD's in live games slide.

Re: Reliability Rating Scale with Time

by Magnetic24 » Tue Apr 23, 2019 7:23 pm

New England Fire Squad wrote:
Tue Apr 23, 2019 7:22 pm
Magnetic24 wrote:
Tue Apr 23, 2019 7:21 pm
New England Fire Squad wrote:
Tue Apr 23, 2019 5:33 pm


Maybe Claesar was feeling the generosity of the Easter season?
It usually has to do with banned people who join and then quit. The pot was 40 when there were two players...

Too bad I missed it though. Next time!
There's two more live gunboats starting now. If you aren't in them, there probably will be at least one cd... ;)
good to know!

Re: Reliability Rating Scale with Time

by New England Fire Squad » Tue Apr 23, 2019 7:22 pm

Magnetic24 wrote:
Tue Apr 23, 2019 7:21 pm
New England Fire Squad wrote:
Tue Apr 23, 2019 5:33 pm
Carl Tuckerson wrote:
Tue Apr 23, 2019 5:19 pm

That game had a buy-in of 10 but the pot is 90, how?
Maybe Claesar was feeling the generosity of the Easter season?
It usually has to do with banned people who join and then quit. The pot was 40 when there were two players...

Too bad I missed it though. Next time!
There's two more live gunboats starting now. If you aren't in them, there probably will be at least one cd... ;)

Re: Reliability Rating Scale with Time

by Magnetic24 » Tue Apr 23, 2019 7:21 pm

New England Fire Squad wrote:
Tue Apr 23, 2019 5:33 pm
Carl Tuckerson wrote:
Tue Apr 23, 2019 5:19 pm
New England Fire Squad wrote:
Tue Apr 23, 2019 4:14 pm


http://webdiplomacy.net/board.php?gameID=240363 Just think how high your RR could go if you join this game!
That game had a buy-in of 10 but the pot is 90, how?
Maybe Claesar was feeling the generosity of the Easter season?
It usually has to do with banned people who join and then quit. The pot was 40 when there were two players...

Too bad I missed it though. Next time!

Re: Reliability Rating Scale with Time

by Carl Tuckerson » Tue Apr 23, 2019 6:05 pm

I'm down! Thanks Cleasar

Re: Reliability Rating Scale with Time

by New England Fire Squad » Tue Apr 23, 2019 5:33 pm

Carl Tuckerson wrote:
Tue Apr 23, 2019 5:19 pm
New England Fire Squad wrote:
Tue Apr 23, 2019 4:14 pm
Magnetic24 wrote:
Tue Apr 23, 2019 4:06 pm
Although this is not the direct answer to your question, live games are usually made without RR restrictions and are a great way to improve your RR fast. For instance, before last week, my friend had a few CDs and his RR fell to 79... by the end of the week, after a few live games, his RR is up to 87. Just a thought!
http://webdiplomacy.net/board.php?gameID=240363 Just think how high your RR could go if you join this game!
That game had a buy-in of 10 but the pot is 90, how?
Maybe Claesar was feeling the generosity of the Easter season?

Re: Reliability Rating Scale with Time

by Carl Tuckerson » Tue Apr 23, 2019 5:19 pm

New England Fire Squad wrote:
Tue Apr 23, 2019 4:14 pm
Magnetic24 wrote:
Tue Apr 23, 2019 4:06 pm
Although this is not the direct answer to your question, live games are usually made without RR restrictions and are a great way to improve your RR fast. For instance, before last week, my friend had a few CDs and his RR fell to 79... by the end of the week, after a few live games, his RR is up to 87. Just a thought!
http://webdiplomacy.net/board.php?gameID=240363 Just think how high your RR could go if you join this game!
That game had a buy-in of 10 but the pot is 90, how?

Re: Reliability Rating Scale with Time

by Restitution » Tue Apr 23, 2019 5:00 pm

Claesar wrote:
Tue Apr 23, 2019 4:08 pm
We are currently thinking about a new method for determining Realibility Rating.

I am personally of the opinion that it isn't harsh enough. It's easy to get your RR back up by playing games. Especially (live) 1v1 games are perfect for this, as they have a lot of turns in small timeframe.
Probably the best thing to do is have both a Live and Normal RR, and have both decay.

If the point of RR is to predict reliability, it's pointless to have a ditched game from years ago count.

Re: Reliability Rating Scale with Time

by Darth Baum » Tue Apr 23, 2019 4:26 pm

I will consider doing some live games Haha but I still think my reliability shouldn't be based on my games back in 2014. That is where most of my civil disorders happened and why I am knocked down to 75% :/

Re: Reliability Rating Scale with Time

by New England Fire Squad » Tue Apr 23, 2019 4:14 pm

Magnetic24 wrote:
Tue Apr 23, 2019 4:06 pm
Although this is not the direct answer to your question, live games are usually made without RR restrictions and are a great way to improve your RR fast. For instance, before last week, my friend had a few CDs and his RR fell to 79... by the end of the week, after a few live games, his RR is up to 87. Just a thought!
http://webdiplomacy.net/board.php?gameID=240363 Just think how high your RR could go if you join this game!

Re: Reliability Rating Scale with Time

by Claesar » Tue Apr 23, 2019 4:08 pm

We are currently thinking about a new method for determining Realibility Rating.

I am personally of the opinion that it isn't harsh enough. It's easy to get your RR back up by playing games. Especially (live) 1v1 games are perfect for this, as they have a lot of turns in small timeframe.

Re: Reliability Rating Scale with Time

by Magnetic24 » Tue Apr 23, 2019 4:06 pm

Although this is not the direct answer to your question, live games are usually made without RR restrictions and are a great way to improve your RR fast. For instance, before last week, my friend had a few CDs and his RR fell to 79... by the end of the week, after a few live games, his RR is up to 87. Just a thought!

Top