Silk Road forums

Support => Customer support => Topic started by: uniwiz on April 18, 2013, 01:15 pm

Title: How does the scoring on reviews work? 2 1/5's in 57 trans = 99%??
Post by: uniwiz on April 18, 2013, 01:15 pm
It appears a vendor can complain to SR Support, and them to adjust your review slightly, without telling you.

I knocked caliconnect for a shortage. He has 57 buys, two are now at 1/5, that isn't 99%

I now suspect he has been reviewing his product under different user names.
I know i bought under a different name, and caught him, and "the system" playing fuck around.

My review stands until vendor changes their attitude. Keep the 6 zips I'm short.

Anybody who starts attacking me,shame on you! You would be just as pissed.
It's my right to review the vendor honestly. Now cut the shit, and adjust his rating to reflect what he did.
Title: Re: Important! SR Suport changes buyers reviews
Post by: scout on April 18, 2013, 05:20 pm
I'm sorry to hear this.  :(

Also, no one should attack you for posting an honest review.
Title: Re: Important! SR Suport changes buyers reviews
Post by: nanpa2001 on April 18, 2013, 05:37 pm
uniwiz, are you claiming that SR admins changed the text of your feedback? If so, what is the original feedback, and what was it changed to? That is what it looks like you wrote.

If on the other hand you are simply saying that the vendor has 57 transactions, and 2 of them are your negative transactions, and his rating remains 99%, that is easily explained.

Each transaction has a 'weight'. The larger the order in dollars, the heavier the weight. In addition, each unique user carries a heavier weight on his first transaction with a particular vendor than his second transaction. Your first negative feedback counts more than second. Finally, feedback is weighted with a bias towards the present. Old feedback counts a lot less than new feedback.

Hope that helps.
Title: Re: Important! SR Suport changes buyers reviews
Post by: uniwiz on April 18, 2013, 07:06 pm
uniwiz, are you claiming that SR admins changed the text of your feedback? If so, what is the original feedback, and what was it changed to? That is what it looks like you wrote.

If on the other hand you are simply saying that the vendor has 57 transactions, and 2 of them are your negative transactions, and his rating remains 99%, that is easily explained.

Each transaction has a 'weight'. The larger the order in dollars, the heavier the weight. In addition, each unique user carries a heavier weight on his first transaction with a particular vendor than his second transaction. Your first negative feedback counts more than second. Finally, feedback is weighted with a bias towards the present. Old feedback counts a lot less than new feedback.

Hope that helps.
Thanks, it does.
Sounds complicated. No they didn't change the text, just the effect on the vendors status. 57 transaction 2at 1/5, puts him at 94% in my book.
It was new feedback for a large order. I know I've knocked scammers, and saw an effect right away. They had more than 57 transactions.
I don' think the vendor is scamming but complaining loudly, I'm wrong. Claims he reported me to SR support.

I guess I need to see the algorithm cause that got my interest.
Title: Re: How does the scoring on reviews work? 2 1/5's in 57 trans = 99%??
Post by: grahamgreene on April 18, 2013, 08:41 pm
[SNIP]
I guess I need to see the algorithm cause that got my interest.

Hi Uni, hope you're well. Sorry to hear about your recent bad experience.

From the SR Wiki (http://dkn255hz262ypmii.onion/wiki/index.php?title=Feedback_Score):

Quote from: Silk Road Wiki, Feedback Score entry
Feedback Score

What is Feedback Scoring?

You may have noticed the (100) next some vendors names, this is their Feedback Score. This is a quick way of finding out how reputable a vendor is, a step to take before reading some of their actual feedback. This score is a weighted average, based on many aspect of their transactions. The weights are determined by a few factors, and here they are, in order of importance:

    How active a buyer is in rating other vendors
    The age of the rating
    The price of the transaction

In order for a vendor's rating to appear next to their name, they must be reviewed enough for it to be a meaningful average. This requires roughly 10 reviews per month, but can be more or less depending of the weights of the reviews.


The Formula

The buyer activity weight is determined by finding the average and standard deviation of the log of the number of vendors reviewed by buyers who've ever left a review. If the log of the number of vendors reviewed by the buyer who left the feedback is greater than the average, the review has a "buyer activity" weight of the number of standard deviations above the average plus one. If it is below average, then the weight is the inverse of the number of standard deviations below the average minus one.

The age weight is found by raising 1.02337 to the power of the review's age in days and then inverting it. We got 1.02337 by making a review half as valuable after one month as one that's just been posted.

The price weight comes from the following formula: 0.2*log(0.02*($price)+1)+1 where $price is in dollars.

You then multiply the weights together to get the total weight for that review. Add up all of the weighted reviews and divide by the total weight to get the weighted average, then do 25*(1-avg) to get "percent positive reviews" metric.

To get the seller rank, we find the averages and standard deviations of the "percent positive feedback" and the log of the total weight of the reviews for all active sellers. We then average the number of standard deviations a seller has above or below the average with a 4 to 1 weight on their average feedback over their total weight. This is a seller's rating, and we rank everyone according to this rating.

There are a few little details left out for brevity, but that's basically it.

- grahamgreene
Title: Re: How does the scoring on reviews work? 2 1/5's in 57 trans = 99%??
Post by: uniwiz on April 18, 2013, 11:18 pm
Thanks guys, greatly appreciated. I'm trying hard not to troll the threads, and post too much.

Never spend more than you can afford to lose. I survived Tony76. Just sucks.
I still don't understand the rating system. I use this on the Farmacy, and it worked. This time had no effect on 57 vendor transactions, WTF?
Got a feeling user history affects rating, or he really did get SR Support to believe him. I highly doubt that.
If they did so without contacting me, then there's some explaining to do.

Don't appreciate being outed, and being called a scammer. Luckily I have plenty of vendors to choose from. I'm pretty much done with new ones, unless I can afford it.
Once again the prices were too good to be true :-[
Title: Re: How does the scoring on reviews work? 2 1/5's in 57 trans = 99%??
Post by: uniwiz on April 18, 2013, 11:21 pm
The buyer activity weight is determined by finding the average and standard deviation of the log of the number of vendors reviewed by buyers who've ever left a review. If the log of the number of vendors reviewed by the buyer who left the feedback is greater than the average, the review has a "buyer activity" weight of the number of standard deviations above the average plus one. If it is below average, then the weight is the inverse of the number of standard deviations below the average minus one.

+1


Read the wiki? Who would have thought?

Thanks
Title: Re: How does the scoring on reviews work? 2 1/5's in 57 trans = 99%??
Post by: samesamebutdifferent on April 19, 2013, 07:26 am
Glad you got the answers you needed, thread locked as resolved.