Percentile Score Update

Well thank you then :slight_smile:
I don’t really care about the percent- it’s more so what it influences.

I understand. You just stated you didn’t agree with the high percent due to all the sad faces (or that’s how I understood it) so I was trying to explain why that’s possible :slightly_smiling_face:

Exactly- this may ruin the ability to reach their perfect name… Especially when they alter the brief 80 times (which I am okay with- if I get the wiggle room we once had)

You are rare gem @rareworthy!! Thank you for your encouraging words!!!

1 Like

CH- Hello, I love this idea- can you submit more ideas using xxx?
Creative- Sorry, but no… I have hit my cap of 25 entries.

Sorry I am just spazzing and I know you resonate here…
:blush::zipper_mouth_face::sweat:

1 Like

Thanks all for sharing your feedback. I would like to address few things here.

In an ideal world, everyone should have zero limits, and we should be able to continue to brainstorm with CH until they find a name. Unfortunately, we have learnt from many years of experience that things are not that simple. We have thousands of creatives on the platform and everyone has a different submission style.

The percentile scoring mechanism combined with the amazing creativity of the community has allowed us to deliver a large number of successful contests, which is reflected in the highly positive customer reviews. However we are at a point where we are getting hundreds of new creatives every day and we must build some additional checks and balances to ensure that the CH’s do not getting overwhelmed with high number of entries that are not hitting the mark.

The percentile score will never be perfect, and there will always be few creatives who do all the right things but still do not achieve a high enough percentile score. There is subjectivity in naming, and no mathematical formula can truly capture the unique potential of all individual creatives. Having said that, with over 75,000 creatives in the platform, we need some sort of measure to ensure that the limits in platform are determined based upon the creative’s ability to submit names that resonate with the CH.

This is in no way meant to stifle creativity. Even if your percentile score is 70%, you get a total of 15 submission in a contest (including withdrawn entries). If even one of your entries are liked in that contest, you will get 10 more entries. If more than one entries are liked in that contest, you will now get UNLIMITED submissions in that contest.

These changes have been made based upon a very thorough analysis of feedback from contest holders, submission patterns as well as abandonment rates. If we find that these changes are resulting in a negative impact, we will be the first to acknowledge the mistake and correct it. In the meantime, I hope that everyone gives it some time for things to settle down.

Cheers!

9 Likes

Ha…you should’ve said that a long time ago :wink:

1 Like

I just want to start by saying thank you- and sorry for freaking out :slight_smile:
After a long talk with one of the lovely humans behind the Blue Button (Mae) I feel a lot better.
I wasn’t aware that being over 90% meant unlimited entries, period. So my mind is settled.

Thank you so much for taking the time out of your day to settle some of our minds, it is truly appreciated @Darpan :slight_smile:

@Darpan, I am grateful that you piped in. Just remember, while considering all the thousands of new creatives joining, you have thousands of creatives who have been very loyal to SH and to your customers. We work for no pay with a chance of winning. We dedicate hours of our day to CHs and your platform. We provide endless ideas to make SH better. We may not all be the “most” successful, but we have created enough great winning names and logos to keep coming back and to keep your customers coming back. We’ve been devoted to you and SH’s success. We continue to be.

Maybe you could consider other more positive things for your loyal creatives. We understand the customer comes first. And we understand that we help to create customers. We have proven that, while new people have not.

I am glad you are reading what we are writing. You listened to some creatives who advocated for this. Now I hope you listen to the rest of us, too.

Edit to add:
Positive reinforcement changes behavior for the better, while criticism stabilizes negative behaviors and blocks change. - Virginia H. Pearce

7 Likes

I’ve decided to delete my original post. If you read it, I stand by my opinion, but I’ve decided to keep my opinions to myself. Which is extremely hard.

I feel aligned to what @Commulinks has already posted. Wondering if too many rules will eat up SH’s crowdsource spirit!
Yet ready to give it a go as @Darpan says “If we find that these changes are resulting in a negative impact, we will be the first to acknowledge the mistake and correct it.” (I believe this is the true spirit of SH).
But one particular thing is bugging me→ as put by @grant in another post "It also takes into account how often a CH removed your access from their contest due to not following the brief."→ I have earlier said this too, this goes against the grain of crowdsourcing spirit. More so when CH changes direction/brief many a times or a name wins which is very different from what has been asked in the brief. At least there should be a big bold ‘CAVEAT’(strictly follow brief) in case of those CH’s who think their brief is perfect!

6 Likes

I agree. There is often no rhyme or reason to why CHs remove Contestant access and usually they do it without providing any helpful specific feedback at all which would have greatly helped provide entries they want (At least from seasoned creatives).

7 Likes

Probably, the automatic calculation of the level of quality of the creative work is beyond the understanding of my skull :slight_smile: Having a stable victory and the love of customers, she suddenly lost her rating from 76 to 58. There was an opportunity to submit only five options; well, I decided to draw conclusions and approach the work more carefully. Two successive victories in one day made me happy - but here a new blow: now I can only submit two ideas. Such a tough approach not only makes it impossible for me to “catch the mood” of the customer and choose the right direction, but also literally “shoots hands”, completely depriving the incentive to be creative …

7 Likes

I am so sorry you are going through this @Kasinsky. You are a wonderful namer and I agree wholeheartedly that 2 or even 5 entries is completely insufficient. This is incredibly frustrating and I know I will be joining you soon. The changes have been so very hard on really good people who have stuck by SH.

5 Likes

I too am confused how you could have those two back to back wins and drop to 58%. That’s definitely a head scratcher to me. Also, while I agree with limiting entries, I do think two is too limiting.

4 Likes

The recent changes are hard on everybody equally as we all are held to the same standard. A creative’s loyalty to SH is irrelevant to their performance based privileges.

3 Likes

My score went up even though I don’t participate as much (or win as much) as in the past. Naturally I’m not complaining that mine went up, but it seems like there’s something wrong with the system if people are winning contests and getting less entries or if proven namers have their scores reduced. SH needs to check the algorithm and tweak it so it would be fair and reward deserving creatives.

6 Likes

What I think about this is that it won’t make it possible to maintain the 100% transparency of the site.
My opinion is on the split contest, if a contest is abandoned without any ratings, then after 30 days, SH will select four random winner based on

  1. Having at least 5 love it in the following month
  2. Haven submitted at least 5 entries in the abandoned contest
    Now that I can only submit 2 entries, does that mean I can no longer receive abandon contest without any ratings? Since I’m only privilege to submit 2 entries, even though it has not happened to me, someone who introduced me to the site has won a contest with his single entry in the contest, now that I can only submit 2 does not mean that within the 2, I can’t win a contest. Now that I’m not able to submit 5, does it mean that only those who can submit 5 are the only one eligible for the split? If that is the case, then I don’t think SH is transparent enough on this matter.
    If I’m to suggest anything, I’ll rather say SH should allow at least 5 entries, then maybe 3 with withdrawn entries which will make it total of 8 in minimum, at least with that, people will be able to submit his or her idea perfectly and will be able to partake in the unrated abandon split.
4 Likes

My Percentile Rank just went from 90% the past months to 74% today! Good luck to me!:slightly_frowning_face:

8 Likes

Hi All,

Thank you for your feedback. We will take your thoughts into consideration, and the Percentile Ranking algorithm will continue to evolve.

Percentile Ranking is based on several factors including number of high ratings relative to total submissions, wins, contest removals, etc. This ranking is based upon your last 6 months of performance - the number of years you’ve participated with Squadhelp does not play a role in this metric. Also, in some cases we conduct account reviews and set entry limits based upon the submission pattern of the creative.

All changes are designed to reduce the number of abandoned contests and increase customer satisfaction. One of the major focuses of this update is to encourage Creatives to thoroughly read contest briefs and submit just a few highly relevant ideas initially.

@beloved - Your entry limits will not prevent you from winning contests or receiving award distributions when a contest has no high ratings. For contests with only No thank you and unrated entries, you must have 5 Love it ratings during the previous month to be qualified for inclusion in the pool. For this purpose, Love it ratings can be received from multiple contests. So your entry limit will not bar you from this pool.

2 Likes