- Open Access
Adequacy of setting standards for kick impact in the Taekwondo electronic scoring system: comparison of a reference group model based on empirical data
BMC Sports Science, Medicine and Rehabilitation volume 13, Article number: 110 (2021)
In Taekwondo competitions, the rule is that points are scored when the impact of the kick reaches a predetermined threshold of strength. This study aimed to explore the adequacy of the protector and scoring system (PSS) designed to determine taekwondo body scoring based on a reference group model (RGM). Specifically, the kicking impact of the PSS was calculated using data from 188 matches fought during of 2018 Jakarta Asian Games. The RGM was designed based on empirical data by classifying the victory and defeat groups by gender and weight class, and the scoring method was set according to these criteria.
The result of this study are as follows. First, there was no difference in the average impact of kicks of taekwondo players by weight class. Second, result of setting up the kick scoring impact standards of taekwondo PSS by classifying the winning and non-winning groups, the kick scoring impact set by the WT was found to be high in all weight classes except 58 kg. Lastly, result of comparing the settings of impact to score according to weight classes, the kick scoring impact standard set by the WT was higher in heavyweight (men's: under 80 kg, + 80 kg, women's: under 67 kg, over 67 kg) than in the lightweight (men's: under 58 kg, under 63 kg, under 68 kg, women's: under 49 kg, under 53 kg, under 57 kg).
The kick scoring impact set by the WT was found to be high in all weight classes except for the under 58 kg class defining kick scoring impact based on the standards of WT-certified PSS by classifying the matches into winning and non-winning groups. Finally, as a result of comparing the scoring impact settings according to weight class, the kick scoring impact standard set by the WT was higher for the heavier weight classes than for the lighter weight classes.
Taekwondo is a sport that attracts many people and it is becoming a popular sport practiced worldwide. Furthermore, taekwondo was adopted as an Olympic sport where only the best athletes participate. In this regard, the World Taekwondo (WT) is making various efforts to improve the sport of taekwondo, for example by assessing the fairness of the scoring system which is a currently an issue in taekwondo competitions.
Changes in the scoring method are being implemented to ensure fairness in taekwondo matches. In the past, the scores were determined based on the subjective judgment of the referees . However, the protector and scoring system (PSS) was developed and introduced in order to address problems with the scoring method encountered in the past. PSS sets scoring criteria according to the kick impact determined in advance for male and female weight classes, and automatically calculates the score when the scoring area is hit harder than the set kick impact threshold . The benefit of setting a kick impact scoring threshold is that the higher the weight class, the higher the kick impact standard. In this regard, taekwondo is applying a more objective and consistent scoring tool than in the past , contributing to its becoming a global sport.
However, the taekwondo PSS can present several problems despite its advantages. Furthermore, the validity of the kick impact scoring standard remains unclear, even though its objectivity and consistency were improved. Currently, the WT has arbitrarily set the kick impact scoring scale for male and female weight classes under an expert's subjective judgment . Furthermore, it is necessary to establish the basis for different impact settings, according to weight class. For example, in the case of males, the scoring impact of the under 58 kg weight class was set to 18 levels, that of the under 63 kg weight class was set to 20 levels, and that of the under 68 kg weight class was set to 21 levels. Despite the same 5 kg difference, the under-58 kg and under 63 kg weight classes have a difference of two levels, while the under 63 kg and under 68 kg weight classes have a difference of one level . These differences in setting kick impact leads to doubt in both the players and the coaches. In fact, a difference of one level is not great, but due to the nature of taekwondo, where the criteria for judging scores are based on a reference-oriented evaluation, it could lead to skewed results. Moreover, studies on setting kick scoring impact are continuously required because it can be an important factor affecting score, game flow, and player results. Research on taekwondo PSS has been conducted on the score sensor and satisfaction with the PSS [4, 5, 7, 12, 13, 15], and these studies have calculated the difficulty of assessing kick impact by weight class . Thus, studies on setting kick scoring impact are required. This study aimed to confirm the adequacy of setting a kick impact standard for taekwondo PSS. Specifically, we analyzed the difference between the kick impact standard set by the WT and the kick impact standard based on kick impact data from the 2018 Jakarta Asian Games. During this process, weverified whether the kicking standard currently applied was high or low.
In this study, the adequacy of a kick impact standard by weight class was confirmed using 2018 Jakarta Asian Games taekwondo match data. Specifically, there were a total of 104 matches (under 58 kg weight class: 24 matches, under 63 kg weight class: 25 matches, under 68 kg weight class: 21 matches, under 80 kg weight class: 20 matches, and over 87 kg weight class: 14 matches), with a maximum of 26 countries and a minimum of 21 countries. For women's matches, there were a total of 84 matches (under 49 kg weight class: 16 matches, under 53 kg weight class: 17 matches, under 57 kg weight class: 19 matches, under 67 kg weight class: 15 matches, over 67 kg weight class: 17 matches), with a maximum of 26 countries and a minimum of 15 countries (Table 1).
Data acquisition procedure
In this study, data from KP&P PSS obtained in the 2018 Jakarta Asian Games taekwondo matches were provided by the Asian taekwondo Federation and KP&P. The KP&P PSS is an official accreditation body certified by the WT (October 23, 2012) and it is the official scoring system used in world competitions and Asian Games.
Only the scoring impact generated in the trunk area was entered and classified by weight class in order to use the data for the scoring impact calculated by KP&PPSS as research data. Data was input by three taekwondo match analysis experts to minimize error. Several matches were randomly selected and re-recorded to confirm the match with the previous record, after entering the data. The PSS kicking impact calculated through this process was 2,286 times for men (scoring frequency: 814 times, effective hit frequency: 1430), and 1,389 times for women (scoring frequency: 650 times, effective hit frequency: 688 times), and these values were used as research data.
Group classification for establishing kick impact reference points for the protector and scoring system
The criterion groups model, one of the empirical methods, was used in this study to confirm the adequacy of the taekwondo PSS kick impact reference point. The reference group model is divided into the group that meets the criteria and the on that does not. The intersection point of the distribution of scores of the two groups was set as the reference point . Therefore, two methods were used in this study to classify the group to determine the appropriateness of the kick impact reference. First, the winning group (which met the criteria) and the non-winning group (which did not meet the criteria), according to weight category, were divided and compared with the reference point shown at the intersection point of the 2-group score distributions with the kick impact reference point currently applied by WT. Then, after classifying the groups according to weight class, the score distribution intersection point was identified. For example, for men's weight classes, the current kick impact reference point is determined by checking and comparing the intersection of the score distributions for the two groups in the following order: under 58 kg, and under 63 kg, under 63 kg and under 68 kg, under 68 kg and under 80 kg, under 80 kg, and over 80 kg weight classes.
Data processing method
The descriptive statistics for the PSS kick scoring impact were calculated by weight class. Cutoff scores were calculated to establish scoring criteria according to the reference group. The cutoff score was calculated based on the standard normal distribution using the mean and standard deviation of the kicking intensities of the winning and non-winning groups according to gender and weight. Furthermore, the intersection of the kicking intensity distributions of the winning and non-winning groups was selected as the cutoff score . The accuracy of the classification was calculated to verify the validity of the scoring criteria through the cutoff score . R program (ver 3.6.1) and MS-Excel were used for data analysis.
Basic information on kick force of top taekwondo athletes
Figures 1 and 2 show the graph so the kick scoring impact by gender and weight class. As a result, the incidence of kick impact was high, between 10 to 20 levels, in both the men's and women's divisions. Also, regardless of weight class, the form of kick impact was shown as static distribution. Specifically, as shown in Table 2, for the men's under 58 kg weight class, the average kicking impact was 18.4 levels, and 18.7 levels for the over 80 kg weight class. In the women's division, the average kick impact for the under 49 kg weight class was 16.1 levels, and 17.3 levels for the over 67 kg weight class.
The following graph shows the impact force of kicks in different weight classes. The y-axis represents kick frequency and the x-axis represents impact force.
Setting and conducting validity tests for the reference points of kick scoring impact for top taekwondo players in the protector and scoring system
Setting kick impact reference points by gender and weight classes (classified according to the winning and non-winning groups)
Table 3 shows the criteria for kick impacts in the PSS by gender and weight classes. The groups are divided into winning and non-winning groups in order to set the kick scoring impact criteria. As a result, for males, the under 58 kg weight class was 18 levels (acc: 0.365), the under 63 kg weight class was 19 levels (acc: 0.482), the under 68 kg weight class was 19 levels (acc: 0.494), the under 80 kg weight class was 19 levels (acc: 0.445), and the over 80 kg weight class was 20 levels (acc: 0.496). In the case of the over 80 kg weight class, the classification accuracy was equal to.496 at 19 and 20 levels, but it was determined that it is more reasonable to set the impact to 20 levels when looking at the sensitivity index for validity, where 19 levels: 0.674 and 20 levels: 0.689. In women, the classification accuracy was as follows: under 46 kg at 15 levels (acc: 0.489), under 53 kg at 15 levels (acc: 0.525), under 57 kg at 17 levels (acc: 0.498), under 67 kg at 16 levels (acc: 0.443), and over 67 kg at 18 levels (acc: 0.473). Kick scoring impact, which is divided into the winning and non-winning groups, was set lower than that set by the WT.
Setting men's and women's kick impact reference points (by weight classes)
Table 4 shows the kick impact criteria of the PSS according to men's and women's weight classes. Weight class was divided based on weight class in order to set the kick scoring impact. As a result, for men under 58 kg and under 63 kg, 21 levels (acc: 0.622), under 63 kg and under 68 kg, 21 levels (acc: 0.492), under 68 kg and under 80 kg, 22 levels, and under 80 kg and over 80 kg, 21 levels (acc: 0.502). For women, under 49 kg and under 53 kg, 15 levels (acc: 0.468), under 53 kg and under 57 kg, 19 levels (acc: 0.610), under 57 kg and under 67 kg, 17 levels (acc: 0.448), and under 67 kg and over 67 kg, 18 levels (acc: 0.572). When dividing the kick scoring impact into weight classes, it was found to be higher than the kick scoring impact currently applied in most heavyweight classes.
The introduction of PSS to taekwondo was attractive to many coaches, athletes, and researchers. PSS is a measuring tool that determines whether a player scores during a match. Research on the validity and adequacy of the tool has been conducted continuously . However, the criteria for determining the score in PSS, that is, research on the setting of the kick score impact is insufficient. Currently, the kick score impact setting is set by subjective judgment, thus leaving doubts. Therefore, this study was performed to confirm the adequacy of the setting of the impact of the kick protector for PSS.
First, as a result of confirming the form of impact of the PSS kick according to men's and women's weight class, it was confirmed that both men and women have similar patterns regardless of weight class. Especially, when comparing the average kick impact by weight class, it was determined that the difference in kick impact was not significant. In the current WT guidelines, the scoring impact for kicks is set higher for higher weight classes. Previous studies also reported that scoring frequency was relatively low in higher weight classes than in lower weight classes, pointing to the same problem of setting the scoring strength for kicks .
Furthermore, this study utilizes survey data to calculate and compare the PSS kick scoring impact reference point. As a result, it was confirmed that in both methods of calculating the reference point, the weighted kick score setting was set higher than the currently set kick score. The difference was 0.8 in the male lightweight division (under 58 kg) and 6 in the male heavyweight division (+ 80 kg). This indicates that the difference is greater in the heave weight division than in lightweight division. In fact, it is generally more logical to set a higher kick scoring impact for a higher weight class. However, considering that there is movement of the opponent player when being kicked and the kicks are defended by hand, setting a graded kick scoring impact is a matter of concern. In a taekwondo match, lower scoring may lead to lower interest, so further discussion will need to be made about the reference impact force used in scoring .
On the other hand, the kick scoring impact criteria suggested in the study results and the kick scoring impact set by the WT differs by 4 levels to 1 level. In fact, although a 1-level difference might seem small, it can still affect the score, and accordingly change the result. Since taekwondo has such characteristics, it is inevitable to emphasize the importance of setting the kick scoring impact of PSS.
Finally, the kick scoring impact setting in men's and women's different weight classes is dependent on the method and, thus, the limitations were that there are no clear standard of setting kick scoring impact (e.g. the kick scoring impact standard was under 53 kg: 15 levels, under 57 kg: 17 levels, and under 67 kg: 16 levels, showing that higher weight classes have a lower standard of kick scoring impact). In addition, only the Asian Games data were used, which can be interpreted as results for specific regions. Nevertheless, it is certain that this study provides basic data that could solve the problem of setting the kick scoring impact suggested by the WT. Also, this study attempted to identify the problem and solve it by using non-subjective data in setting the kick scoring impact, which may be used as important information in the future. Subsequent studies should focus on experts setting kick scoring impact according to the data results, which could be used as a more valid measure of athletic performance.
This study confirmed the adequacy of setting the scoring impact of taekwondo kicks. The conclusions of this study are as follows. First, there was no difference in the average impact of kicks of taekwondo players by weight class. Second, setting up the kick scoring impact standards of taekwondo PSS by classifying the winning and non-winning groups, the kick scoring impact set by the WT was found to be high in all weight classes except under 58 kg. Lastly, comparing the settings of impact to score according to weight classes, the kick scoring impact standard set by the WT was higher in heavyweight (men's: under 80 kg, over 80 kg, women's: under 67 kg, over 67 kg) than in the lightweight (men's: under 58 kg, under 63 kg, under 68 kg, women's: under 49 kg, under 53 kg, under 57 kg).
Availability of data and materials
The datasets generated and/or analysed during the current study are not publicly available due to limitations of ethical approval involving the player data and anonymit but are available from the corresponding author on reasonable request.
Cho EH, Eom HJ. Validity of electronic-protector scoring system in Taekwondo Games. Korean J Meas Eval Phys Educ Sports Sci. 2007;9:93–104.
Cho EH, Jung MM, Kang SK, Kim JH, Kwak TY. Data analysis of Taekwondo games decision by Intraclass correlation coefficient: electronic protector vs judgement score. J Korean Alliance Martial Arts. 2009;11:165–76.
Choi C, Jeon M. Appropriateness of setting kick scoring impact by taekwondo certified Protector and Scoring Systems: comparison of difficulty of male and female weight class applying Rash model. Arch Budo. 2019;15:290.
Del Vecchio FB, Franchini E, Del Vecchio AHM, Pieter W. Energy absorbed by electronic body protectors from kicks in a taekwondo competition. Biol Sport. 2011;28(1):75.
Hausen M, Soares PP, Araújo MP, Porto F, Franchini E, Bridge CA, Gurgel J. Physiological responses and external validity of a new setting for taekwondo combat simulation. PLoS ONE. 2017;12(2):e0171553.
Kaftandjieva F. Methods for setting cut scores in criterion-referenced achievement tests. Cito Arnhem EALTA. 2010;35:170.
Kin BG, Baek WY. Structural relationship among user experience, flow and satisfaction of electronic hogu system in the Taekwondo game. Korean J Phys Educ. 2015;54:299–312.
Kim WS, Yang DS. Analysis of the Taekwondo competition results based on the players who gained first point. Taekwondo J Kukkiwon. 2018;9(20):237–354.
Lee YR. The difference in force measurements between the electronic chest protectors in Taekwondo. Taekwondo Res Inst Kukkiwon. 2016;7:119–34.
Morrow JR Jr, Mood D, Disch J, Kang M. Measurement and Evaluation in Human Performance. 5th ed. Champaign: Human Kinetics; 2015.
Popham WJ. Modern Educational Measurement: A Practitioner’s Perspective. Atlanta: IOX Assessment Associates; 1990.
Ramazanoglu N. Transmission of impact through the electronic body protector in taekwondo. Int J Appl. 2013;3:1–7.
Tasika N. Reliability & linearity of an electronic body protector employed in taekwondo games: a preliminary study. J Hum Sport Exerc. 2013;8:52.
World Taekwondo (2019). Retrieved March 5, 2018 from http://www.worldtaekwondo.org.
Yang JS. A study on the satisfaction with electronic protector and revised game rules in High School Taekwondo Athletes. J Korean Alliance Martial Arts. 2010;54:299–312.
Ethics approval and consent to participate
Consent for publication
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Choi, CH., Oh, H. & Jeon, M. Adequacy of setting standards for kick impact in the Taekwondo electronic scoring system: comparison of a reference group model based on empirical data. BMC Sports Sci Med Rehabil 13, 110 (2021). https://doi.org/10.1186/s13102-021-00340-x
- Kick impact
- Scoring systems
- Reference group model
- Sports analytics
- Martial arts