Home  /  Entropy  /  Vol: 20 Núm: 4 Par: April (2018)  /  Article
ARTICLE
TITLE

Information Decomposition of Target Effects from Multi-Source Interactions: Perspectives on Previous, Current and Future Work

SUMMARY

The formulation of the Partial Information Decomposition (PID) framework by Williams and Beer in 2010 attracted a significant amount of attention to the problem of defining redundant (or shared), unique and synergistic (or complementary) components of mutual information that a set of source variables provides about a target. This attention resulted in a number of measures proposed to capture these concepts, theoretical investigations into such measures, and applications to empirical data (in particular to datasets from neuroscience). In this Special Issue on “Information Decomposition of Target Effects from Multi-Source Interactions” at Entropy, we have gathered current work on such information decomposition approaches from many of the leading research groups in the field. We begin our editorial by providing the reader with a review of previous information decomposition research, including an overview of the variety of measures proposed, how they have been interpreted and applied to empirical investigations. We then introduce the articles included in the special issue one by one, providing a similar categorisation of these articles into: i. proposals of new measures; ii. theoretical investigations into properties and interpretations of such approaches, and iii. applications of these measures in empirical studies. We finish by providing an outlook on the future of the field.

 Articles related

Conor Finn and Joseph T. Lizier    

What are the distinct ways in which a set of predictor variables can provide information about a target variable? When does a variable provide unique information, when do variables share redundant information, and when do variables combine synergisticall... see more

Revista: Entropy

Zhipeng Wang, Limin Jia and Yong Qin    

Rotating machineries often work under severe and variable operation conditions, which brings challenges to fault diagnosis. To deal with this challenge, this paper discusses the concept of adaptive diagnosis, which means to diagnose faults under variable... see more

Revista: Entropy

Shujian Yu and José C. Príncipe    

Feature selection aims to select the smallest feature subset that yields the minimum generalization error. In the rich literature in feature selection, information theory-based approaches seek a subset of features such that the mutual information between... see more

Revista: Entropy

Zhe Wu, Qiang Zhang, Lixin Wang, Lifeng Cheng and Jingbo Zhou    

It is a difficult task to analyze the coupling characteristics of rotating machinery fault signals under the influence of complex and nonlinear interference signals. This difficulty is due to the strong noise background of rotating machinery fault featur... see more

Revista: Entropy

Fernando Rosas, Pedro A.M. Mediano, Martín Ugarte and Henrik J. Jensen    

Self-organisation lies at the core of fundamental but still unresolved scientific questions, and holds the promise of de-centralised paradigms crucial for future technological developments. While self-organising processes have been traditionally explaine... see more

Revista: Entropy