Assigning scores to trees is one thing – selecting a winner based on these scores is another matter altogether. By publishing the judges’ scores from the 2015 Artisans Cup, Ryan Neil shed light on a process that doesn’t get as much notice as it deserves – the process by which exhibited trees are recognized as prize-winners.
As this is one of the first times numbers have been associated with bonsai in such a high-profile event, the scores have received a lot of attention. Taken individually, they offer a glimpse of how the judges regarded the bonsai on display. Taken as a whole, the scores provide data that can help us address judging-related topics in our own exhibits.
The scores have also raised a lot of questions. How can one best tabulate the results? How can one compare scores across judges? What are the relationships between different judges’ scores? Which judges had the biggest overall effect on the results?
One visitor to the Artisans Cup, bonsai enthusiast Dan Yamins, set about answering these questions. Dan analyzed the scores and produced a report with his findings (see below).
I find the report fascinating. It does a great job of describing the approach taken by the Cup and makes a strong case for enhancements. It also takes a close look at each judges’ scores and their relationships to other judges’ scores.
Figure 4: Distribution of judges’ scores.
Read the report now – here are the links:
- Analysis of Results from the 2015 Artisans Cup by Dan Yamins
- Normalized scores: tab delimited (csv, Excel)
Related:
- Analyzing the Artisans Cup: Evolving Methodologies for Judging Bonsai from the Artisans Cup
- The results are in! Official scores from the Artisans Cup
- Artisans Cup Event program (PDF)
Subscribe to Bonsai Tonight
New Posts Delivered Every Tuesday and Friday
Todd says
excellent analysis! Great suggestion to normalize each judge’s scores, makes perfect sense..
Do you know if there is going to be any follow-up to show the winning trees in really good lighting (less dramatic), so those of us who could not attend could really see how great they are. Maybe put up the submittal pictures on their website?
Todd
Jonas Dupuich says
Hi Todd – all trees were photographed like this before the exhibit opened though I am not sure of the context in which the photos will be made available. I expect an update from the Cup website when the time comes.
Ross Clark says
Two takeaway cautions from this year’s event seem to be: (1) don’t bother submitting deciduous trees; and (2) don’t bother submitting smaller trees. The Artisan’s Cup does not yet appear to be a venue inclusive of the range of bonsai artistry.
Lance says
Interesting post Jonas!! I don’t know anything about proper scoring of bonsai, but I have 17 years of professional experience in various data analysis roles and now managing a team of financial & sales analysts, and this paper was both informative and revealing. I was doing contract work for a large consulting firm a few years ago and was floored when a large employee labour union hired us to review and supervise a lengthy board member selection process, albeit after the fact. Same type issue, 20+ candidates with the top maybe 5 being ‘elected’ and depending on how the voting was interpreted the winners varied. My point being there are inherent flaws in voting procedures regardless of the procedure used and/or the subject being judged. It looks as though if they’d have included everyone’s vote there would have been accusations of ‘preferred scoring’, so you’re darned if you do, and darned if you don’t. I will say that professional data analysts don’t round ANYTHING. 99.9999 is just that, it isn’t 100.
Thanks again for your wonderful reading material and site!!!