Department of Computer Science at North Carolina State University

CSC News

August 14, 2013

Research Shows Precisely Which Strategies Help Players Win Team-oriented Video Games

For Immediate Release

Matt Shipman | News Services | 919.515.6386

Computer science researchers from NC State University have developed a technique to determine which strategies give players an edge at winning in multi-player (action) real-time strategy (ARTS) games, such as Defense of the Ancients (DotA), Warcraft III and Starcraft II. The technique offers extremely precise information about how a player’s actions affect a team’s chances of winning, and could be used to develop technology for use by players and developers to improve gameplay experiences.

Researchers used the technique, which makes use of various analytic tools, to evaluate logs of player actions from thousands of ARTS games. They then used that information to develop a set of rules governing team gameplay strategies, in order to identify which approaches give teams the best chance of winning.

“Our goal is to use these data to develop tools that could train game players to play more successfully,” says Dr. David L. Roberts, an assistant professor of computer science at NC State and co-author of two papers on the research. “These tools could be incorporated into games by game developers, or could be developed into stand-alone training modules.

“The tools could also be used by game developers to help them understand whether the game mechanics they are putting in their games are having the desired effect, and to fine-tune their games accordingly.”

The researchers evaluated the attributes of individual team characters – such as a hero’s strength in DotA – and the aggregate attributes of each team – such as the combined total strength of a team of heroes in DotA. These attributes change over the course of a game, and the researchers also looked at how and when these attributes changed for each team.

In looking at the aggregate attributes, the researchers found that the timing of attribute improvement is linked to the likelihood of team success – sometimes in unintuitive ways.

For example, in DotA, each character has “damage points,” indicating how much damage the character can deal out before “dying.” If Team A has amassed 59.7 more damage points than Team B by the second quarter of the game, Team A has a more than 80 percent chance of winning. However, if Team A has 54 more damage points than Team B, Team A has a less than 10 percent chance of winning – but only if Team B hasn’t gotten too strong, smart or rich.

Why? Because players in DotA amass “gold” and “experience” during the game, and spend it to improve their damage and other attributes. And while amassing a huge advantage in a single attribute, like damage, can help a team win, it is usually more important to find a balanced approach.

“And finding that balance is incredibly complex, which is what makes gaming so fascinating,” Roberts says.

The researchers also found that the importance of an individual character’s attributes varies widely, depending on the makeup of each multi-player team.

In Starcraft II, for example, players can play as any of several alien races, each of which has its own characteristics. If a team is made up of Terrans (humans) and the Zerg (alien arthropods), its odds of winning are more than 70 percent if the Zerg population has a high growth rate and the Terran population has a low one. But the Zerg population growth rate can be unimportant in other team combinations.

“We’re currently working to use these findings to develop visualization tools that let players know how they are doing in real-time, relative to the strategies we know are predictive of success,” Roberts says.

The research papers are being presented at two conferences. The paper on individual character attributes, “Knowledge Discovery for Characterizing Team Success or Failure in (A)RTS Games,” was presented Aug. 13 at the IEEE 2013 Conference on Computational Intelligence in Games, which was held in Niagara Falls, Ontario. The paper on aggregated data, “Extracting Human-readable Knowledge Rules in Complex Time-evolving Environments,” was presented at the 2013 International Conference on Information and Knowledge Engineering, held July 22-25 in Las Vegas, Nev. Lead author of both papers is Pu Yang, a Ph.D. student at NC State.

-shipman-

Note to Editors: The study abstracts follow.

“Extracting Human-readable Knowledge Rules in Complex Time-evolving Environments”

Authors: Pu Yang and David L. Roberts, North Carolina State University

Presented: July 22-25, 2013 International Conference on Information and Knowledge Engineering, Las Vegas, Nev.

Abstract: A production rule system is a reasoning system that uses rules for knowledge representation. Manual rule acquisition requires a great amount of effort and time from humans. In this paper, we present a data-driven technique for autonomously extracting human-readable rules from complex, time-evolving environments that makes rule acquisition for production rule systems efficient. Complex, time-evolving environments are often highly dynamic and hard to predict. We represent these environments using sets of attributes, and transform those attributes to the frequency domain which enables analysis to extract important features. We extract human-readable knowledge rules from these features using rule-based classification techniques and translating the decision rules back to the time domain. We present an evaluation of our methodology on three environments: hurricane data, a real-time strategy game, and a currency exchange. Experiments show extracted rules are human-readable and achieve good prediction accuracy.

“Knowledge Discovery for Characterizing Team Success or Failure in (A)RTS Games”

Authors: Pu Yang and David L. Roberts, North Carolina State University

Presented: Aug. 11-13, IEEE 2013 Conference on Computational Intelligence in Games, Niagara Falls, Ontario

Abstract: When doing post-competition analysis in team games, it can be hard to figure out if a team members’ character attribute development has been successful directly from game logs. Additionally, it can also be hard to figure out how the performance of one team member affects the performance of another. In this paper, we present a data-driven method for automatically discovering patterns in successful team members’ character attribute development in team games. We first represent team members’ character attribute development using time series of informative attributes. We then find the thresholds to separate fast and slow attribute growth rates using clustering and linear regression. We create a set of categorical attribute growth rates by comparing against the thresholds. If the growth rate is greater than the threshold it is categorized as fast growth rate; if the growth rate is less than the threshold it is categorized as slow growth rate. After obtaining the set of categorical attribute growth rates, we build a decision tree on the set. Finally, we characterize the patterns of team success in terms of rules which describe team members’ character attribute growth rates. We present an evaluation of our methodology on three real games: DotA, Warcraft III, and Starcraft II. A standard machine-learning-style evaluation of the experimental results shows the discovered patterns are highly related to successful team strategies and achieve an average 86% prediction accuracy when testing on new game logs.

Return To News Homepage