Entropy  

Ricardo T. Paéz-Hernández, Norma Sánchez-Salas, Juan C. Chimal-Eguía and Delfino Ladino-Luna

This paper presents an analysis of a Curzon and Alhborn thermal engine model where both internal irreversibilities and non-instantaneous adiabatic branches are considered, operating with maximum ecological function and maximum power output regimes. Its th... see more

Tarald O. Kvålseth

Starting with a new formulation for the mutual information (MI) between a pair of events, this paper derives alternative upper bounds and extends those to the case of two discrete random variables. Normalized mutual information (NMI) measures are then obt... see more

Piotr Boltuc

-

Naoki Kawamura, Tatsuya Yokota, Hidekata Hontani, Muneyuki Sakata and Yuichi Kimura

It is known that the process of reconstruction of a Positron Emission Tomography (PET) image from sinogram data is very sensitive to measurement noises; it is still an important research topic to reconstruct PET images with high signal-to-noise ratios. In... see more

Jian Jiao, Sha Wang, Bowen Feng, Shushi Gu, Shaohua Wu and Qinyu Zhang

In this paper, we propose a rate-compatible (RC) parallel concatenated punctured polar (PCPP) codes for incremental redundancy hybrid automatic repeat request (IR-HARQ) transmission schemes, which can transmit multiple data blocks over a time-varying chan... see more

Carsten Hartmann, Lorenz Richter, Christof Schütte and Wei Zhang

The article surveys and extends variational formulations of the thermodynamic free energy and discusses their information-theoretic content from the perspective of mathematical statistics. We revisit the well-known Jarzynski equality for nonequilibrium fr... see more

Chunming Zhang and Zhengjun Zhang

The classical quadratic loss for the partially linear model (PLM) and the likelihood function for the generalized PLM are not resistant to outliers. This inspires us to propose a class of “robust-Bregman divergence (BD)” estimators of both the parametric ... see more

Xiaofei Zhu, Xu Zhang, Xiao Tang, Xiaoping Gao and Xiang Chen

The objective of this study is to re-evaluate the relation between surface electromyogram (EMG) and muscle contraction torque in biceps brachii (BB) muscles of healthy subjects using two different complexity measures. Ten healthy subjects were recruited a... see more

Duo Hao, Qiuming Li and Chengwei Li

Cameras mounted on vehicles frequently suffer from image shake due to the vehicles’ motions. To remove jitter motions and preserve intentional motions, a hybrid digital image stabilization method is proposed that uses variational mode decomposition (VMD) ... see more

H. R. Noel Van Erp, Ronald O. Linger and Pieter H. A. J. M. Van Gelder

In this paper, we will give the derivation of an inquiry calculus, or, equivalently, a Bayesian information theory. From simple ordering follow lattices, or, equivalently, algebras. Lattices admit a quantification, or, equivalently, algebras may be extend... see more

Tiefeng Peng, Qibin Li, Longhua Xu, Chao He and Liqun Luo

Foam systems have been attracting extensive attention due to their importance in a variety of applications, e.g., in the cleaning industry, and in bubble flotation. In the context of flotation chemistry, flotation performance is strongly affected by bubbl... see more

Amanda Oliveira, Adrião D. Dória Neto and Allan Martins

Information Theory is a branch of mathematics, more specifically probability theory, that studies information quantification. Recently, several researches have been successful with the use of Information Theoretic Learning (ITL) as a new technique of unsu... see more

Min Lei, Guang Meng and Guangming Dong

Bearing vibration response studies are crucial for the condition monitoring of bearings and the quality inspection of rotating machinery systems. However, it is still very difficult to diagnose bearing faults, especially rolling element faults, due to the... see more

Wassim M. Haddad

-

Viviana Meruane, Matias Lasen, Enrique López Droguett and Alejandro Ortiz-Bernardin

Sandwich structures are very attractive due to their high strength at a minimum weight, and, therefore, there has been a rapid increase in their applications. Nevertheless, these structures may present imperfect bonding or debonding between the skins and ... see more

Yunna Wu, Xiaokun Sun, Hu Xu, Chuanbo Xu and Ruhang Xu

Traditional stochastic dominance rules are so strict and qualitative conditions that generally a stochastic dominance relation between two alternatives does not exist. To solve the problem, we firstly supplement the definitions of almost stochastic domina... see more

Mengmeng Li and Xiaoyan Zhang

As we move into the information age, the amount of data in various fields has increased dramatically, and data sources have become increasingly widely distributed. The corresponding phenomenon of missing data is increasingly common, and it leads to the ge... see more

Takayuki Koyama, Takeru Matsuda and Fumiyasu Komaki

We develop priors for Bayes estimation of quantum states that provide minimax state estimation. The relative entropy from the true density operator to a predictive density operator is adopted as a loss function. The proposed prior maximizes the conditiona... see more

Po-Ling Loh

In recent years, tools from information theory have played an increasingly prevalent role in statistical machine learning. In addition to developing efficient, computationally feasible algorithms for analyzing complex datasets, it is of theoretical import... see more

Zhiliang Pan, Ping Li, Jinxing Li and Yanping Li

-

Daryl DeFord and Katherine Moore

Permutation entropy has become a standard tool for time series analysis that exploits the temporal and ordinal relationships within data. Motivated by a Kullback–Leibler divergence interpretation of permutation entropy as divergence from white noise, we e... see more

Tong Qiao, Wei Shan and Chang Zhou

Centrality is one of the most studied concepts in network analysis. Despite an abundance of methods for measuring centrality in social networks has been proposed, each approach exclusively characterizes limited parts of what it implies for an actor to be ... see more

Jongho Keum, Kurt C. Kornelsen, James M. Leach and Paulin Coulibaly

Having reliable water monitoring networks is an essential component of water resources and environmental management. A standardized process for the design of water monitoring networks does not exist with the exception of the World Meteorological Organizat... see more

Aijun Guo, Jianxia Chang, Yimin Wang, Qiang Huang and Zhihui Guo

Copula functions have been extensively used to describe the joint behaviors of extreme hydrological events and to analyze hydrological risk. Advanced marginal distribution inference, for example, the maximum entropy theory, is particularly beneficial for ... see more

Ahmed Attia Abotabl and Aria Nosratinia

The Decode-Compress-Forward (DCF) is a generalization of Decode-Forward (DF) and Compress-Forward (CF). This paper investigates conditions under which DCF offers gains over DF and CF, addresses the problem of coded modulation for DCF, and evaluates the pe... see more

Shirin Saeedi Bidokhti, Gerhard Kramer and Shlomo Shamai

The downlink of symmetric Cloud Radio Access Networks (C-RANs) with multiple relays and a single receiver is studied. Lower and upper bounds are derived on the capacity. The lower bound is achieved by Marton’s coding, which facilitates dependence among th... see more

Takayuki Kawashima and Hironori Fujisawa

In high-dimensional data, many sparse regression methods have been proposed. However, they may not be robust against outliers. Recently, the use of density power weight has been studied for robust parameter estimation, and the corresponding divergences ha... see more

Petr Jizba and Jan Korbel

-

Jerry Gibson

Although Shannon introduced the concept of a rate distortion function in 1948, only in the last decade has the methodology for developing rate distortion function lower bounds for real-world sources been established. However, these recent results have not... see more

Robert H. Swendsen

-