Percentile Score Changes?


#21

We continue to evaluate the percentile score, and we will keep your feedback in mind.


#22

A few days ago, I was blocked from a contest, after getting a “Like it” on one of my entries… So I was unable to “submit further entries along those lines”.
To me, this serves to show the negative impact a contest block has on our percentile should be quite lower than it currently is and relatively lower than the positive impact the good ratings have.


#23

I was also blocked a week ago then recieved a like. Actually three times.
I would love if there was a counter on each contest that let you know how many people have been blocked from a contest.
Most of the time I was blocked, then there was a contest update immediately after expressing not to do what I did. Which to me seems unfair. There’s not even a second chance to redeem yourself. Then moving forward everyone knows not to do that and you never got a warning.
Sorry a lot of ranting but yeah. To be blocked before a CH even makes up his or her mind on the direction is a bit unfair.


#24

I agree with you! There should be some possibility of redemption.


#25

Also 98 percent of the time throwing one or two wild card names in works wonders. Sometimes that is the turning point for a CH. Showing them something they didn’t originally consider.
Then there’s the 2 percent that will block you the minute you get creative.


#26

By now, I’m starting to sound like those old folks that can’t leave a subject to it’s due rest… but here I go again, on the percentile! :smiley:
Yesterday my percentile was 46,8%. During this last night I received 3 “Love it” ratings (no contest block that I know of - we DO need to receive info about contest blocks). And my percentile increased to an astouding 46,9%! :smile:
If on the other hand I had been blocked from a contest the percentile would have gone down to around 40% or so.
I feel the percentile algorithm needs to be reviewed.


#27

There is something weird going on with my percentiles. They have been on a decline for reasons i cannot understand. Today i won a contest and my percentiles dropped even further. Unfathomable!


#28

I am not sure if these rules still hold true, but, I had this saved. It was @grant response to the same topic.

Percentile Ranking is based on the number of like it and love it rating (high ratings) you’ve received within the last 180 days, relative to the number of entries you submit, in relation to your fellow Creatives. (Wow…that’s a mouth full.)

The first thing to keep in mind is that a string of like it and love it ratings in your Activity Feed, does not necessarily directly correlation to the changes to your Percentile Score.

Here are three of many situations that explain this:

(1) High Ratings Relative to Number of Entries - You’re particularly fast and inspired and submit double your usual entries. You typically submit 50 entries a day and receive 10 high ratings, but for two days, you’ve averaged 150 submissions and receive 30 high ratings. In this situation, while your number of high ratings increased, your percent of high ratings is the same (20%).

(2) High Ratings in Relation to Your Fellow Creatives - There are one or two active contests where CHs are rating using a non-standard curve. They’ve given 75 love it ratings and 150 like it ratings. You receive an influx of high ratings, but so has everyone else. So, again, your number of high ratings increases, but everyone has been graced with this influx, so your high ratings in relation to your fellow creatives does not change.

(3) High Ratings Recently Received - You’ve had a good day with several high ratings. One of your better days, but certainly not your best. Your Percentile Score is based on your last 180 days of participation, so each day your high-rating-over-number-of-entries is calculated and considered; but, each day, an old high-rating-over-number-of-entries is dropped off. Therefore, it is possible to add a good day but lose a better day and see a small drop.

Also note that like it and love it ratings are indeed weighted differently, so this is another factor.

To summarize, your Percentile Score is based on 180 days of participation, number of like its, number of love it, number of total entries, performance of your peers, rating strategy of individual CHs, and more. Therefore, you should not expect to see a day-to-day shift that is related to the number of high ratings you received within the last 24 hours. There’s simply much more too it.

Finally, as I’ve said before, your Percentile Score is a productive measure that we find helpful for the platform’s success. It is not an objective measure of your skill or worth–and we love you all equally :slight_smile:[quote=“Marvon7, post:1, topic:3516, full:true”]
Hey Everyone. I’m still pretty new to SH, and am trying to figure things out. One question for all of you is how often does your percentile score change? A few times a day? Once a day? I’ve been having issues with my score since I joined on Oct. 31. I didn’t even have a score at all until early in January (very frustrating). Then when I finally got a score (83%) it dropped like a rock over 2 weeks from 83% to 52% (Even after winning 5 contests)…Dropping me from Tier A totally. I was told it’s because of a few blocks from CH, but I think there’s more to it because my score has been stuck at EXACTLY 52.1% for 3 days!!! And this was after 2-3 love its and many like its. I’ve been having a percentile issue from the beginning and insist that my account is “broken” somehow. But because I’ve been having all these technical issues I feel like I’m annoying the SH staff. HELP!!! I feel so stuck and frustrated and I don’t want to be a pain for them, I just truly think all of this is NOT NORMAL. So, again, the question is how often does you percentile score change? Daily? Multiple times a day? Feeling stuck, Marvon
[/quote]


#29

I have had this happen as well. I have also been blocked from a contest that was only up for a few hours and after submitting only a few entries, which followed the brief. I was blocked without receiving any feedback or ratings. Eventually the brief was updated to reflect the CH’s new preferences.
I have also been blocked and then received the “i like your direction, please submit more like this” comment and “like its” on previously submitted entries.
I love the counter idea. Since they make such a large impact on our score, we should be able to see this. We should at least be able to see our personal stats related to blocks.


#30

I’m already so used to the “jumping” of my percentile that I began to relate to this philosophically)


#31

ALSO, the reasons for getting banned from a contest aren’t always the Creative’s fault! In some cases, the CH will decide to shift direction or to use criteria he did not specify in his brief and simply exclude some creatives that failed to read his mind :grinning:. In these cases, the creative is penalized and has no fault. Also in these cases (and not only) being banned is not necessarily synonymous to “failing to meet the brief’s requirements” or “low quality submissions”.
So the true REASON for being banned is relevant to the impact such an action should have on the percentile, right? And not only the reason but the FAIRNESS of said reason.


#32

Absolutely agree with DNFront. I believe that the percentile should depend only on the customer’s estimates.I also had contests where the CH first blocked me, and then suddenly began to love my entries, demanding more. Locks from the customer must be excluded from the percentile calculation algorithm.


#33

Though I haven’t yet experienced much of what’s being discussed it’s clearly a serious problem. I feel your suggestion makes a lot of sense @Edukar - that is, the contest block should only mean that the CH doesn’t want to receive similar entries or has a different direction where some creatives are already doing a good job at. It’s like them saying I have too many cooks let me just go with these 5 who are doing great. It could also mean “I don’t want to waste more time all around” or “I’m almost at what I want and want to focus on a few”. That doesn’t mean the other cooks aren’t amazing themselves :)) Or maybe they just wanted to make pies today not pasta lol :slight_smile: