Action Values - Knowing When Your Model Doesn't Have A Clue
February 10, 2021
-
Attempting to quantify the value of a wide range of player actions using only event data has gained traction recently, with VAEP, xT, g+, and PV some of the most well known models.
-
All of these models return a single point estimate of “value” which seems sub-optimal given we know so much vital information hasn’t been considered by the model.
-
We also have no way of knowing how much trust we can place on any conclusions we are drawing without making an attempt to quantify the uncertainty inherent in our models.
-
We can define two types of uncertainty, esoteric and aleatoric, and explore some techniques to add this information to our models. Established and new metrics can both advance from a solid theoretical grounding to something that can actually be used as part of a real-life decision making process.