Who won the SEA Games?
Now that the 2017 edition of the SEA Games is in the books it may be interesting to take a look at how the various teams really performed. We're going to do this in several ways comparing team results based on medals, points, population, and team size. We're also going to propose a different and better way to determine the winner of multi-sport events like the SEA Games so that final standings are more inline with how sport contests are actually scored.
There is no 'official' way to determine the winner of a multi-sport competition like the SEA Games, the Olympics, the Commonwealth Games, or SUKMA. The accepted method, the ubiquitous medal count reported by the press, seems to have been adopted by governments, national sport bodies, and the public without giving it much thought. Additionally, when we talk about medal counts we really mean gold medal counts because silver and bronze medals have no real value in determining the final standings.
The gold medal count
Though traditional and widely accepted as the one and only way to rank teams in multi-sport contests, the gold medal count is a poor gauge of performance. It presents a limited view of overall performance because silver and bronze medals have no significance in the final standings other than to help rank teams that did not win any golds.
Table 1 shows the official results of the SEA Games as reported by the KL2017 official website.
If a team won any gold medals then that becomes the significant ranking factor. This can be seen by comparing the total medal count for Vietnam, Singapore, and Indonesia. Indonesia won more total medals but fewer gold medals than both Vietnam and Singapore so is ranked lower (5th) than both Vietnam (3rd) and Singapore (4th). This same situation occurred between Lao and Cambodia.
Table 2 shows the final standings if total medal count is used to determine overall rankings.
Obviously the total medal count is not really useful because all medals receive the same value; bronze medals are just as good as gold if we just count total medals. This would never be accepted so a proper proportional value must be established for each medal.
A point system makes every medal count
The purpose of a point system is to apply proportional value to each color medal. A simple 5-3-1 system awards five points for a gold medal, three points for a silver, and one point for a bronze. Table 3 shows what happens to the final standings of the 2017 SEA Games result if we score the event using a 5-3-1 scoring system.
Malaysia is still the clear winner but notice that Singapore is now in 3rd place over Vietnam, and Lao and Cambodia have flipped their 'official' 8th and 9th positions. Vietnam won more golds but Singapore performed better overall with many more second and third place finishes. Likewise Lao had more third place finishes and thus managed to outscore Cambodia using the point system.
A point system makes every medal matter to the overall result and is a much better indication of team performance than simply counting gold medals. It's a direct evaluation of performance and it's transparent and easily understood by sport associations, athletes, fans, and the media.
Establishing any type of scoring system will affect how countries decide which sports to contest and how their teams are selected. Doing a point analysis after the fact, as we're doing here, is interesting but has no motivational effect on teams or athletes unless it is implemented before teams are selected. If countries attending the Games know that final standings will be established based on points then the makeup of the various teams and overall strategies might change.
Scoring sports rather than events
Multi-sport games are nothing more than a collection of separate sporting contests held at the same time and in the same place, and the overall medal count is an artificial way of keeping track of event winners; tracking the performances of athletes rather than teams.
A good argument can be made that scoring sports rather than the events within those sports make more sense in large, multi-sport competitions. Sports with many events -- swimming or athletics, for example -- add disproportionate weight to overall results while team sports contest for only one medal.
Scoring the various sport tournaments rather than the events within those tournaments would remove this disparity. Countries could contest for one medal in swimming by winning the swimming meet and for one medal in football by winning the football tournament thus giving both sports equal weight in the overall results. In multi-event sports, medals would still be awarded to the event winners just as they are now but the overall results of the sport competition would be reduced to the top three teams in each sport. This is a unique way of determining the results of a multi-sport event that has never been done to our knowledge.
Other ways to evaluate team performance are population and team size
Comparing point production based on population and team size uncovers some surprising insights but it's only significant in a sociological or developmental sense. It has no application to actual competition but should be part of any post-event analysis by sport associations.
Table 4 compares point production relative to a country's population. This indicates the overall nature of sport participation and training within a country and neutralizes the direct competitive advantage that large countries usually have over smaller ones in sport competition.
Fourth ranked Singapore now moves into first place based on their powerhouse performance of almost 92 points per million population. Likewise Brunei, with less than half a million in population, does well in this ranking moving from tenth place into second with 55 points per million population.
This kind of comparison has to be considered in context though. Brunei's performance may not have raised any eyebrows during the Games but look at what they accomplished. Five silver medals and nine bronze which means they were in the battle at least in a few events beating out both Lao and Cambodia with 7 and 16 million people respectively in the silver medal count. This metric is also associated with economic strength with countries scoring low generally having weaker economies relative to those scoring higher.
By comparing point production to team size we're able to calculate the average number of points contributed by each athlete to their team's final point tally (Table 5). This gives an indication of the overall strength and quality of each national contingent relative to other teams.
Malaysia leads the way in this metric with each Malaysian athlete contributing 1.24 points on average to the team total. Vietnam and Singapore fill out the top 3 spots with 1.08 and 0.92 points per athlete respectively.
Since the competition was at 'home' travel and housing costs were lower so it's reasonable to expect that Malaysia would pad their contingent with some younger, less experienced athletes just to get them exposure to international competition, and their total team size indicates that this is probably what they did. Younger athletes tend to be less productive than experienced performers so it's unusual for Malaysia to top this particular metric and represents a truly remarkable performance by the team overall.
Other analyses that could be done include comparisons based on sex and sport. If the athlete list were broken down by sex then the same kind of comparisons as those above could be made based on male and female performance. Unfortunately this data was not available on the official 2017 SEA Games website.
Also, as noted earlier, scoring sports rather than events is an alternative method for gauging success in multi-sport competitions. If hosts are able to provide the results of the various sports events in ways that lend themself to analysis it would be interesting to see how the final team standings might change.
In summary, simple gold medal counts offer a shallow and incomplete evaluation of how well a team performs in multi-sport competition. A far better way to evaluate performance is by scoring these events using a point system that recognizes the value of each medal, not just the gold ones.
--------
Bill Price (price@ussa-my.com) is the Chief Information Officer for USSA Malaysia in Kuala Lumpur.