It would be very difficult for humans to understand how the alien sees the world, and for the alien to explain it to us.”12 The Importance of Context While the black box problem is formidable, it is not, in many cases, insurmountable.
The AI research community has made notable strides in explaining complex machine learning models—indeed, some of our symposium panelists have made major contributions to that effort. One important conclusion of that work is that there need not be a single principle or one-sizefits-all approach for explaining machine learning models.