Difference between revisions of "Rating reliability"
Superlol103 (talk | contribs) (Replaced content with "god") |
(Revert major vandalism) |
||
| Line 1: | Line 1: | ||
| − | + | Many times people associate a user level, as represented by their [[Activity scores|activity score]], with a user's reputation, also known as their ''rating reliability''. | |
| + | |||
| + | The rating reliability is a [http://en.wikipedia.org/wiki/Statistical_hypothesis_testing computed estimate] based upon demonstrated talent and [http://en.wikipedia.org/wiki/Ability ability], aka: [http://en.wiktionary.org/wiki/merit merit]. | ||
| + | |||
| + | Basically, the system analyzes each user's rating behavior from several aspects in order to determine their reliability. When you start using WOT, your ratings have little [http://en.wikipedia.org/wiki/Weight_function weight], but if you keep rating sites consistently, your ratings will be considered more reliable over time, re: [[FAQ#Ratings aren't equally reliable|ratings aren't equally reliable]]. | ||
| + | |||
| + | For a simple explanation, read the blog post: [http://www.mywot.com/en/blog/differing-opinions Differing opinions] paying attention to ''Personal reputation''. | ||
| + | |||
| + | * I can see my activity score but where is my rating reliability score? | ||
| + | <blockquote>The reliability estimates aren't public to make gaming the system more difficult and to encourage everyone to rate honestly. Also, even though the estimates are automated and perfectly objective, I'm sure some users would take them personally and publishing them would create all kinds of unwanted friction in the community. I don't think anyone wants that. | ||
| + | <br /> | ||
| + | - Sami ''18 January, 2010'' [http://www.mywot.com/forum/5322-an-individuals-rating-rookie-bronze-silver-gold-platnium?comment=26320#comment-26320 forum entry]</blockquote> | ||
| + | |||
| + | Some curious facts about rating reliability: [http://www.mywot.com/forum/21548-wot-is-a-dictatorship?comment=133164#comment-133164 cite]. | ||
| + | * Most users whose ratings are considered highly reliable are not very active. You won't meet them at the forum and they don't rate unusually many sites. | ||
| + | * Since reliability estimates are not revealed to anyone, trying to game the system becomes more difficult. Most trusted users have no idea their ratings are more trusted than someone else's. If you don't know you have power, you also have no incentive to abuse it. | ||
| + | * Reliability estimates are not binary values that are either on or off. They are composed of several components, which are all combined in to a single value from 0-100 separately for each rating component. This means that your child safety rating may have a different weight than the ratings in other components, for example. | ||
Revision as of 15:36, 12 April 2015
Many times people associate a user level, as represented by their activity score, with a user's reputation, also known as their rating reliability.
The rating reliability is a computed estimate based upon demonstrated talent and ability, aka: merit.
Basically, the system analyzes each user's rating behavior from several aspects in order to determine their reliability. When you start using WOT, your ratings have little weight, but if you keep rating sites consistently, your ratings will be considered more reliable over time, re: ratings aren't equally reliable.
For a simple explanation, read the blog post: Differing opinions paying attention to Personal reputation.
- I can see my activity score but where is my rating reliability score?
The reliability estimates aren't public to make gaming the system more difficult and to encourage everyone to rate honestly. Also, even though the estimates are automated and perfectly objective, I'm sure some users would take them personally and publishing them would create all kinds of unwanted friction in the community. I don't think anyone wants that.
- Sami 18 January, 2010 forum entry
Some curious facts about rating reliability: cite.
- Most users whose ratings are considered highly reliable are not very active. You won't meet them at the forum and they don't rate unusually many sites.
- Since reliability estimates are not revealed to anyone, trying to game the system becomes more difficult. Most trusted users have no idea their ratings are more trusted than someone else's. If you don't know you have power, you also have no incentive to abuse it.
- Reliability estimates are not binary values that are either on or off. They are composed of several components, which are all combined in to a single value from 0-100 separately for each rating component. This means that your child safety rating may have a different weight than the ratings in other components, for example.
