Kansai University research: Visual AI in sports
12.03.2020: ...for improving the performance of table tennis players and their coaches
Kansai University’s Isao Hayashi has used so-called Topographic Attentive Mapping (TAM) network, Possibilistic Data Interpolation-Bagging/Boosting (pdi-Bagging/Boosting)
...for improving the performance of table tennis players and their coaches
Kansai University’s Isao Hayashi has used so-called Topographic Attentive Mapping (TAM) network, Possibilistic Data Interpolation-Bagging/Boosting (pdi-Bagging/Boosting) clustering as a machine learning, and neuro-fuzzy logic-based ‘visual AI’ to classify the skill level of table tennis players with the goal of improving player performance as well as enhancing the skills of their coaches.
Caption: "FORPHEUS" table tennis robot developed in a collaboration with OMRON Corporation
Hayashi and colleagues assessed the performance of table tennis players by tracking and analysis of trajectory patterns of forehand strokes of table tennis players with nine sensor markers attached to the right upper arm of players.
“The TAM network enables extraction of the input attributes and technique rules in order to classify the skill level of the players from the sensor data,” explains Hayashi. “In addition, this approach clarified differences between top-class players and those we classified as middle level and beginners. The data analysis was used to evaluate the possibility of improving skills specific to table tennis although this approach could be used for analysis of other sports.”
One of the strengths of the Topographic Attentive Mapping (TAM) network that it has similarities with the human vision system—an important factor in sports where strategies are based on studying the visual movement of players in action. The pdi-Bagging/Boosting is a multi-layer clustering method as a machine learning, and which improves the discriminate accuracy of skill level by adding virtually generated data to learning data. Hayashi and his collaborators extracted input data skill rules based on the forehand stroke of table tennis with the TAM network and the pdi-Bagging/Boosting clustering. The results enabled specific definition of differences between players with different abilities.
Background and proposal for ‘visible AI’
Professor Isao Hayashi has studied what he calls the "fuzzy if-then" rule, since his student days. This is an artificial intelligence (AI) model that "visualizes" knowledge by connecting conditions and execution, for example, "if speed is VERY HIGH...then execute this command STRONGLY". The "VERY HIGH" and "STRONGLY" are fuzzy sets.
In order to “visualize” this complex and multidimensional so-called “invisible knowledge” derived from the “if-then” approach, Hayashi developed a "neural network" that executes the operations, collects data, and automatically creates an easy to handle format from the data. Specifically, Hayashi proposed "neuro-fuzzy" logic that combines neural networks with the same learning functions as the human brain and fuzzy inference of visible knowledge.
Caption: Personalized coaching FORPHEUS AI senses a player’s movement and analyses the data to compare the player’s form and skill to that of a professional player to provide personalized coaching
Hayashi observes that ‘deep learning’ and other such analytical models, for example technology used for controlling autonomous cars, are machine-black boxes, where raw data is inserted and left there until results are output. “The process is not visible but convenient,” says Hayashi. “But there are social concerns that machines will run away. On the other hand, neuro fuzzy is ‘visible AI’ that incorporates ‘if-then rules’ into the decision-making process, and you can track down problems and stop the machine if necessary. Ultimately, a mixed model that also learns using visible knowledge is the ideal goal.”
Artificial intelligence (AI) to train the coaches in table tennis
Hayashi is the president to the table tennis club at Kansai University, tested the validity of AI model in sports informatics, specifically in table tennis.
Table tennis players go through three main motions: ‘recognition’ of the ball’s trajectory; ‘decision’ how to hit the ball back; and ‘control’ to repeat the technique. Notably, highly skilled, world class table tennis players are able to instantly judge which of their attacking patterns their opponents are not good at responding.
Hayashi is using ‘bagging/boosting inference’ in the decision process. Data such as where the opponent hit the spinning ball and the locations on the table where it won or lost is input to the AI model in advance and classified into patterns. Analyzing the actual game data based on this allows coaches to infer the best strategy on the spot, namely, in real time.
To test his ideas of using AI coaches in sports, Hayashi has developed the table tennis robot "FORPHEUS" in a collaboration with OMRON Corporation since March 2018.
The robot is not playing to win but to extract the ability of its opponent. Hayashi says that by inferring the ability of the opponent with high-quality rallies, the aim is to be a "human-friendly" robot that naturally improves the ability of players.
Isao Hayashi et al, Extraction of Knowledge from the Topographic Attentive Mapping Network and its Application in Skill Analysis of Table Tennis, Journal of Human Kinetics 55, pp.39-54, (2017)
Further information about this research
Professor Isao Hayashi
Faculty of Informatics, Kansai University
Kansai University- also photos
|BMW Group Plant Munich builds on artificial intelligence and smart use of data
|- Artificial intelligence supports quality assurance - Smart data analytics saves maintenance time - Innovations take the strain off production workers and enhance efficiencyBMW Group Plant M more >>
|Shaping Europe's digital future: Commission presents strategies for data and Artificial Intelligence
|Today, the Commission unveils its ideas and actions for a digital transformation that works for all, reflecting the best of Europe: open, fair, diverse, democratic and confident. It presents a European society powered by digital solutions that pu more >>
|BMW Group wins "Connected Car Award" for use of artificial intelligence in production
|- Artificial intelligence supports workforce- Fast and straightforward integration of new applications via BMW Group’s IoT platformOn 7 January, the magazines Auto Bild and Computer Bild presented the BMW Group Prod more >>
|BMW Group shares AI algorithms used in production
- Company publishes algorithms on open source platform- Global access for software developers- Artificial intelligence frees up workforceThe BMW Group uses a growing number of artificial intelligence (A more >>
|Takumi - A 60,000-Hour Story on the Survival of Human Craft
|Could you become a Takumi? In Japan it takes 60,000 hours to reach the highest level of craftsmanship – new documentary revealsLexus to distribute a new documentary on Amazon Prime Video that pose more >>
|Lexus launches the all-new ES
|... with the world's first advert written by artificial intelligence and shot by Oscar-winning directorLexus commissions the world’s first film written by AI and shot by Oscar-winning director to launch the new ES executive sedan in Europe more >>
|Audi - “AI4People” forum presents a 20-point plan at summit at EU parliament
|Audi and beyond initiative speak out for responsible use of AI at global forum Association of leading companies, scientists, governments, EU institutions and civil-society organizations Audi CSO more >>