Silk Road forums

Discussion => Silk Road discussion => Topic started by: MDUK on May 03, 2013, 10:48 am

Title: How does the feedback percentage work?
Post by: MDUK on May 03, 2013, 10:48 am
So, I'm a bit confused as to how the feedback percentage thing works - I've had 84 5/5 feedbacks and one 3/5 (meh, you can't please some people  ::) ), and that's apparently worked out to 97.5%? How does that work? Is it weighted towards the most recent feedback or something?
Vendor page:
http://silkroadvb5piz3r.onion/silkroad/user/53909a1737
Title: Re: How does the feedback percentage work?
Post by: Libertas on May 03, 2013, 11:22 am
So, I'm a bit confused as to how the feedback percentage thing works - I've had 84 5/5 feedbacks and one 3/5 (meh, you can't please some people  ::) ), and that's apparently worked out to 97.5%? How does that work? Is it weighted towards the most recent feedback or something?
Vendor page:
http://silkroadvb5piz3r.onion/silkroad/user/53909a1737

Hi MDUK,

You can read more about the feedback score, including the formula used to calculate it, on the SR Wiki:
http://dkn255hz262ypmii.onion/wiki/index.php?title=Feedback_Score

I have quoted it here for your convenience.

Quote from: SR Wiki
Feedback Score

What is Feedback Scoring?

You may have noticed the (100) next some vendors names, this is their Feedback Score. This is a quick way of finding out how reputable a vendor is, a step to take before reading some of their actual feedback. This score is a weighted average, based on many aspect of their transactions. The weights are determined by a few factors, and here they are, in order of importance:

    How active a buyer is in rating other vendors
    The age of the rating
    The price of the transaction

In order for a vendor's rating to appear next to their name, they must be reviewed enough for it to be a meaningful average. This requires roughly 10 reviews per month, but can be more or less depending of the weights of the reviews.

The Formula

The buyer activity weight is determined by finding the average and standard deviation of the log of the number of vendors reviewed by buyers who've ever left a review. If the log of the number of vendors reviewed by the buyer who left the feedback is greater than the average, the review has a "buyer activity" weight of the number of standard deviations above the average plus one. If it is below average, then the weight is the inverse of the number of standard deviations below the average minus one.

The age weight is found by raising 1.02337 to the power of the review's age in days and then inverting it. We got 1.02337 by making a review half as valuable after one month as one that's just been posted.

The price weight comes from the following formula: 0.2*log(0.02*($price)+1)+1 where $price is in dollars.

You then multiply the weights together to get the total weight for that review. Add up all of the weighted reviews and divide by the total weight to get the weighted average, then do 25*(1-avg) to get "percent positive reviews" metric.

To get the seller rank, we find the averages and standard deviations of the "percent positive feedback" and the log of the total weight of the reviews for all active sellers. We then average the number of standard deviations a seller has above or below the average with a 4 to 1 weight on their average feedback over their total weight. This is a seller's rating, and we rank everyone according to this rating.

There are a few little details left out for brevity, but that's basically it.

Libertas