Media & Publications

Improved Feature Importance Computations for Tree Models: Shapley vs. Banzhaf

Time of publication: 2 years ago

Share this:

Improved Feature Importance Computations for Tree Models: Shapley vs. Banzhaf

Shapley values are one of the main tools used to explain predictions of tree ensemble models. The main alternative to Shapley values are Banzhaf values that have not been understood equally well. In this paper we make a step towards filling this gap, providing both experimental and theoretical comparison of these model explanation methods. Surprisingly, we show that Banzhaf values offer several advantages over Shapley values while providing essentially the same explanations. We verify that Banzhaf values: (1) have a more intuitive interpretation, (2) allow for more efficient algorithms, and (3) are much more numerically robust. We provide an experimental evaluation of these theses. In particular, we show that on real world instances. Additionally, from a theoretical perspective we provide new and improved algorithm computing the same Shapley value based explanations as the algorithm of Lundberg et al. [Nat. Mach. Intell. 2020]. Our algorithm runs in O(TLD+n) time, whereas the previous algorithm had O(TLD2+n) running time bound. Here, T is the number of trees, L is the maximum number of leaves in a tree, and D denotes the maximum depth of a tree in the ensemble. Using the computational techniques developed for Shapley values we deliver an optimal O(TL+n) time algorithm for computing Banzhaf values based explanations. In our experiments these algorithms give running times smaller even by an order of magnitude. Read more

Other posts

Breaking news from MIM Solutions

Follow us

Events

AI Fertility conference in Dubrovnik

On September 15-18, 2022, the first world conference AIFertility devoted to the use of artificial intelligence in the treatment of infertility took place in Dubrovnik. Dr. Nikica

Events

IVF Worldwide Online Congress 2022

Upcoming Friday, April 8th, we are spreading the word about FOLLISCAN and EMBRYOAID at the IVF Worldwide Online Congress! MIM Solutions is among 18 startups from around the world (including

News

In Vitro Ex Machina

Piotr Sankowski was quoted in an article from Polityka magazine about IVF procedure. For all our followers who do not speak Polish, we translated the

Get in touch

We work closely with you to understand your goals and build a solution tailored to your needs. Our experts will walk you through AI technologies implementation in your organisation.

Choose the purpose

Request a demo

What are you interested in: