for Journals by Title or ISSN
for Articles by Keywords
  Subjects -> MATHEMATICS (Total: 867 journals)
    - APPLIED MATHEMATICS (69 journals)
    - GEOMETRY AND TOPOLOGY (19 journals)
    - MATHEMATICS (645 journals)
    - MATHEMATICS (GENERAL) (40 journals)
    - NUMERICAL ANALYSIS (19 journals)

MATHEMATICS (645 journals)                  1 2 3 4 | Last

Showing 1 - 200 of 538 Journals sorted alphabetically
Abakós     Open Access   (Followers: 3)
Abhandlungen aus dem Mathematischen Seminar der Universitat Hamburg     Hybrid Journal   (Followers: 2)
Academic Voices : A Multidisciplinary Journal     Open Access   (Followers: 2)
Accounting Perspectives     Full-text available via subscription   (Followers: 6)
ACM Transactions on Algorithms (TALG)     Hybrid Journal   (Followers: 16)
ACM Transactions on Computational Logic (TOCL)     Hybrid Journal   (Followers: 4)
ACM Transactions on Mathematical Software (TOMS)     Hybrid Journal   (Followers: 6)
ACS Applied Materials & Interfaces     Full-text available via subscription   (Followers: 21)
Acta Applicandae Mathematicae     Hybrid Journal   (Followers: 1)
Acta Mathematica     Hybrid Journal   (Followers: 10)
Acta Mathematica Hungarica     Hybrid Journal   (Followers: 2)
Acta Mathematica Scientia     Full-text available via subscription   (Followers: 5)
Acta Mathematica Sinica, English Series     Hybrid Journal   (Followers: 5)
Acta Mathematica Vietnamica     Hybrid Journal  
Acta Mathematicae Applicatae Sinica, English Series     Hybrid Journal  
Advanced Science Letters     Full-text available via subscription   (Followers: 5)
Advances in Applied Clifford Algebras     Hybrid Journal   (Followers: 3)
Advances in Calculus of Variations     Hybrid Journal   (Followers: 2)
Advances in Catalysis     Full-text available via subscription   (Followers: 5)
Advances in Complex Systems     Hybrid Journal   (Followers: 7)
Advances in Computational Mathematics     Hybrid Journal   (Followers: 15)
Advances in Decision Sciences     Open Access   (Followers: 4)
Advances in Difference Equations     Open Access   (Followers: 1)
Advances in Fixed Point Theory     Open Access   (Followers: 5)
Advances in Geosciences (ADGEO)     Open Access   (Followers: 9)
Advances in Linear Algebra & Matrix Theory     Open Access   (Followers: 1)
Advances in Materials Sciences     Open Access   (Followers: 16)
Advances in Mathematical Physics     Open Access   (Followers: 6)
Advances in Mathematics     Full-text available via subscription   (Followers: 10)
Advances in Numerical Analysis     Open Access   (Followers: 4)
Advances in Operations Research     Open Access   (Followers: 11)
Advances in Porous Media     Full-text available via subscription   (Followers: 4)
Advances in Pure and Applied Mathematics     Hybrid Journal   (Followers: 5)
Advances in Pure Mathematics     Open Access   (Followers: 4)
Advances in Science and Research (ASR)     Open Access   (Followers: 6)
Aequationes Mathematicae     Hybrid Journal   (Followers: 2)
African Journal of Educational Studies in Mathematics and Sciences     Full-text available via subscription   (Followers: 5)
African Journal of Mathematics and Computer Science Research     Open Access   (Followers: 4)
Afrika Matematika     Hybrid Journal   (Followers: 1)
Air, Soil & Water Research     Open Access   (Followers: 7)
AKSIOMA Journal of Mathematics Education     Open Access   (Followers: 1)
Algebra and Logic     Hybrid Journal   (Followers: 2)
Algebra Colloquium     Hybrid Journal   (Followers: 4)
Algebra Universalis     Hybrid Journal   (Followers: 2)
Algorithmic Operations Research     Full-text available via subscription   (Followers: 5)
Algorithms     Open Access   (Followers: 9)
Algorithms Research     Open Access   (Followers: 1)
American Journal of Biostatistics     Open Access   (Followers: 9)
American Journal of Computational and Applied Mathematics     Open Access   (Followers: 3)
American Journal of Mathematical Analysis     Open Access  
American Journal of Mathematics     Full-text available via subscription   (Followers: 7)
American Journal of Operations Research     Open Access   (Followers: 5)
American Mathematical Monthly     Full-text available via subscription   (Followers: 6)
An International Journal of Optimization and Control: Theories & Applications     Open Access   (Followers: 7)
Analele Universitatii Ovidius Constanta - Seria Matematica     Open Access   (Followers: 1)
Analysis     Hybrid Journal   (Followers: 2)
Analysis and Applications     Hybrid Journal   (Followers: 1)
Analysis and Mathematical Physics     Hybrid Journal   (Followers: 4)
Analysis Mathematica     Full-text available via subscription  
Annales Mathematicae Silesianae     Open Access  
Annales mathématiques du Québec     Hybrid Journal   (Followers: 4)
Annales UMCS, Mathematica     Open Access   (Followers: 1)
Annales Universitatis Paedagogicae Cracoviensis. Studia Mathematica     Open Access  
Annali di Matematica Pura ed Applicata     Hybrid Journal   (Followers: 1)
Annals of Combinatorics     Hybrid Journal   (Followers: 3)
Annals of Data Science     Hybrid Journal   (Followers: 8)
Annals of Discrete Mathematics     Full-text available via subscription   (Followers: 6)
Annals of Mathematics     Full-text available via subscription  
Annals of Mathematics and Artificial Intelligence     Hybrid Journal   (Followers: 6)
Annals of Pure and Applied Logic     Open Access   (Followers: 2)
Annals of the Alexandru Ioan Cuza University - Mathematics     Open Access  
Annals of the Institute of Statistical Mathematics     Hybrid Journal   (Followers: 1)
Annals of West University of Timisoara - Mathematics     Open Access  
Annuaire du Collège de France     Open Access   (Followers: 5)
Applicable Algebra in Engineering, Communication and Computing     Hybrid Journal   (Followers: 2)
Applications of Mathematics     Hybrid Journal   (Followers: 1)
Applied Categorical Structures     Hybrid Journal   (Followers: 2)
Applied Computational Intelligence and Soft Computing     Open Access   (Followers: 12)
Applied Mathematics     Open Access   (Followers: 3)
Applied Mathematics     Open Access   (Followers: 4)
Applied Mathematics & Optimization     Hybrid Journal   (Followers: 4)
Applied Mathematics - A Journal of Chinese Universities     Hybrid Journal  
Applied Mathematics Letters     Full-text available via subscription   (Followers: 1)
Applied Mathematics Research eXpress     Hybrid Journal   (Followers: 1)
Applied Network Science     Open Access  
Applied Numerical Mathematics     Hybrid Journal   (Followers: 5)
Applied Spatial Analysis and Policy     Hybrid Journal   (Followers: 4)
Arab Journal of Mathematical Sciences     Open Access   (Followers: 2)
Arabian Journal of Mathematics     Open Access   (Followers: 2)
Archive for Mathematical Logic     Hybrid Journal   (Followers: 1)
Archive of Applied Mechanics     Hybrid Journal   (Followers: 4)
Archive of Numerical Software     Open Access  
Archives of Computational Methods in Engineering     Hybrid Journal   (Followers: 4)
Arkiv för Matematik     Hybrid Journal   (Followers: 1)
Arnold Mathematical Journal     Hybrid Journal   (Followers: 1)
Artificial Satellites : The Journal of Space Research Centre of Polish Academy of Sciences     Open Access   (Followers: 17)
Asia-Pacific Journal of Operational Research     Hybrid Journal   (Followers: 3)
Asian Journal of Algebra     Open Access   (Followers: 1)
Asian Journal of Current Engineering & Maths     Open Access  
Asian-European Journal of Mathematics     Hybrid Journal   (Followers: 2)
Australian Mathematics Teacher, The     Full-text available via subscription   (Followers: 7)
Australian Primary Mathematics Classroom     Full-text available via subscription   (Followers: 2)
Australian Senior Mathematics Journal     Full-text available via subscription   (Followers: 1)
Automatic Documentation and Mathematical Linguistics     Hybrid Journal   (Followers: 5)
Axioms     Open Access  
Baltic International Yearbook of Cognition, Logic and Communication     Open Access  
Basin Research     Hybrid Journal   (Followers: 3)
BIBECHANA     Open Access  
BIT Numerical Mathematics     Hybrid Journal  
BoEM - Boletim online de Educação Matemática     Open Access  
Boletim Cearense de Educação e História da Matemática     Open Access  
Boletim de Educação Matemática     Open Access  
Boletín de la Sociedad Matemática Mexicana     Hybrid Journal  
Bollettino dell'Unione Matematica Italiana     Full-text available via subscription   (Followers: 1)
British Journal of Mathematical and Statistical Psychology     Full-text available via subscription   (Followers: 21)
Bruno Pini Mathematical Analysis Seminar     Open Access  
Buletinul Academiei de Stiinte a Republicii Moldova. Matematica     Open Access   (Followers: 7)
Bulletin des Sciences Mathamatiques     Full-text available via subscription   (Followers: 4)
Bulletin of Dnipropetrovsk University. Series : Communications in Mathematical Modeling and Differential Equations Theory     Open Access   (Followers: 1)
Bulletin of Mathematical Sciences     Open Access   (Followers: 1)
Bulletin of the Brazilian Mathematical Society, New Series     Hybrid Journal  
Bulletin of the London Mathematical Society     Hybrid Journal   (Followers: 3)
Bulletin of the Malaysian Mathematical Sciences Society     Hybrid Journal  
Calculus of Variations and Partial Differential Equations     Hybrid Journal  
Canadian Journal of Science, Mathematics and Technology Education     Hybrid Journal   (Followers: 17)
Carpathian Mathematical Publications     Open Access   (Followers: 1)
Catalysis in Industry     Hybrid Journal   (Followers: 1)
CEAS Space Journal     Hybrid Journal  
CHANCE     Hybrid Journal   (Followers: 5)
Chaos, Solitons & Fractals     Hybrid Journal   (Followers: 3)
ChemSusChem     Hybrid Journal   (Followers: 7)
Chinese Annals of Mathematics, Series B     Hybrid Journal  
Chinese Journal of Catalysis     Full-text available via subscription   (Followers: 2)
Chinese Journal of Mathematics     Open Access  
Clean Air Journal     Full-text available via subscription   (Followers: 2)
Cogent Mathematics     Open Access   (Followers: 2)
Cognitive Computation     Hybrid Journal   (Followers: 4)
Collectanea Mathematica     Hybrid Journal  
College Mathematics Journal     Full-text available via subscription   (Followers: 1)
COMBINATORICA     Hybrid Journal  
Combustion Theory and Modelling     Hybrid Journal   (Followers: 13)
Commentarii Mathematici Helvetici     Hybrid Journal   (Followers: 1)
Communications in Contemporary Mathematics     Hybrid Journal  
Communications in Mathematical Physics     Hybrid Journal   (Followers: 1)
Communications On Pure & Applied Mathematics     Hybrid Journal   (Followers: 3)
Complex Analysis and its Synergies     Open Access   (Followers: 2)
Complex Variables and Elliptic Equations: An International Journal     Hybrid Journal  
Complexus     Full-text available via subscription  
Composite Materials Series     Full-text available via subscription   (Followers: 9)
Comptes Rendus Mathematique     Full-text available via subscription   (Followers: 1)
Computational and Applied Mathematics     Hybrid Journal   (Followers: 2)
Computational and Mathematical Methods in Medicine     Open Access   (Followers: 2)
Computational and Mathematical Organization Theory     Hybrid Journal   (Followers: 2)
Computational Complexity     Hybrid Journal   (Followers: 4)
Computational Mathematics and Modeling     Hybrid Journal   (Followers: 8)
Computational Mechanics     Hybrid Journal   (Followers: 4)
Computational Methods and Function Theory     Hybrid Journal  
Computational Optimization and Applications     Hybrid Journal   (Followers: 7)
Computers & Mathematics with Applications     Full-text available via subscription   (Followers: 5)
Concrete Operators     Open Access   (Followers: 4)
Confluentes Mathematici     Hybrid Journal  
COSMOS     Hybrid Journal  
Cryptography and Communications     Hybrid Journal   (Followers: 12)
Cuadernos de Investigación y Formación en Educación Matemática     Open Access  
Cubo. A Mathematical Journal     Open Access  
Czechoslovak Mathematical Journal     Hybrid Journal   (Followers: 1)
Demographic Research     Open Access   (Followers: 11)
Demonstratio Mathematica     Open Access  
Dependence Modeling     Open Access  
Design Journal : An International Journal for All Aspects of Design     Hybrid Journal   (Followers: 28)
Developments in Clay Science     Full-text available via subscription   (Followers: 1)
Developments in Mineral Processing     Full-text available via subscription   (Followers: 3)
Dhaka University Journal of Science     Open Access  
Differential Equations and Dynamical Systems     Hybrid Journal   (Followers: 2)
Discrete Mathematics     Hybrid Journal   (Followers: 7)
Discrete Mathematics & Theoretical Computer Science     Open Access  
Discrete Mathematics, Algorithms and Applications     Hybrid Journal   (Followers: 2)
Discussiones Mathematicae Graph Theory     Open Access   (Followers: 1)
Doklady Mathematics     Hybrid Journal  
Duke Mathematical Journal     Full-text available via subscription   (Followers: 1)
Edited Series on Advances in Nonlinear Science and Complexity     Full-text available via subscription  
Electronic Journal of Graph Theory and Applications     Open Access   (Followers: 2)
Electronic Notes in Discrete Mathematics     Full-text available via subscription   (Followers: 2)
Elemente der Mathematik     Full-text available via subscription   (Followers: 3)
Energy for Sustainable Development     Hybrid Journal   (Followers: 9)
Enseñanza de las Ciencias : Revista de Investigación y Experiencias Didácticas     Open Access  
Ensino da Matemática em Debate     Open Access  
Entropy     Open Access   (Followers: 4)
ESAIM: Control Optimisation and Calculus of Variations     Full-text available via subscription   (Followers: 1)
European Journal of Combinatorics     Full-text available via subscription   (Followers: 4)
European Journal of Mathematics     Hybrid Journal   (Followers: 1)
European Scientific Journal     Open Access   (Followers: 2)
Experimental Mathematics     Hybrid Journal   (Followers: 3)
Expositiones Mathematicae     Hybrid Journal   (Followers: 2)
Facta Universitatis, Series : Mathematics and Informatics     Open Access  
Fasciculi Mathematici     Open Access  
Finite Fields and Their Applications     Full-text available via subscription   (Followers: 4)
Fixed Point Theory and Applications     Open Access   (Followers: 1)
Formalized Mathematics     Open Access   (Followers: 2)
Foundations and Trends® in Econometrics     Full-text available via subscription   (Followers: 4)

        1 2 3 4 | Last

Journal Cover Entropy
  [SJR: 0.59]   [H-I: 30]   [4 followers]  Follow
  This is an Open Access Journal Open Access journal
   ISSN (Print) 1099-4300
   Published by MDPI Homepage  [148 journals]
  • Entropy, Vol. 19, Pages 240: Maxwell’s Demon—A Historical

    • Authors: Andrew Rex
      First page: 240
      Abstract: For more than 140 years Maxwell’s demon has intrigued, enlightened, mystified, frustrated, and challenged physicists in unique and interesting ways. Maxwell’s original conception was brilliant and insightful, but over the years numerous different versions of Maxwell’s demon have been presented. Most versions have been answered with reasonable physical arguments, with each of these answers (apparently) keeping the second law of thermodynamics intact. Though the laws of physics did not change in this process of questioning and answering, we have learned a lot along the way about statistical mechanics and thermodynamics. This paper will review a selected history and discuss some of the interesting historical characters who have participated.
      PubDate: 2017-05-23
      DOI: 10.3390/e19060240
      Issue No: Vol. 19, No. 6 (2017)
  • Entropy, Vol. 19, Pages 241: Axiomatic Characterization of the Quantum
           Relative Entropy and Free Energy

    • Authors: Henrik Wilming, Rodrigo Gallego, Jens Eisert
      First page: 241
      Abstract: Building upon work by Matsumoto, we show that the quantum relative entropy with full-rank second argument is determined by four simple axioms: (i) Continuity in the first argument; (ii) the validity of the data-processing inequality; (iii) additivity under tensor products; and (iv) super-additivity. This observation has immediate implications for quantum thermodynamics, which we discuss. Specifically, we demonstrate that, under reasonable restrictions, the free energy is singled out as a measure of athermality. In particular, we consider an extended class of Gibbs-preserving maps as free operations in a resource-theoretic framework, in which a catalyst is allowed to build up correlations with the system at hand. The free energy is the only extensive and continuous function that is monotonic under such free operations.
      PubDate: 2017-05-23
      DOI: 10.3390/e19060241
      Issue No: Vol. 19, No. 6 (2017)
  • Entropy, Vol. 19, Pages 242: A Framework for Designing the Architectures
           of Deep Convolutional Neural Networks

    • Authors: Saleh Albelwi, Ausif Mahmood
      First page: 242
      Abstract: Recent advances in Convolutional Neural Networks (CNNs) have obtained promising results in difficult deep learning tasks. However, the success of a CNN depends on finding an architecture to fit a given problem. A hand-crafted architecture is a challenging, time-consuming process that requires expert knowledge and effort, due to a large number of architectural design choices. In this article, we present an efficient framework that automatically designs a high-performing CNN architecture for a given problem. In this framework, we introduce a new optimization objective function that combines the error rate and the information learnt by a set of feature maps using deconvolutional networks (deconvnet). The new objective function allows the hyperparameters of the CNN architecture to be optimized in a way that enhances the performance by guiding the CNN through better visualization of learnt features via deconvnet. The actual optimization of the objective function is carried out via the Nelder-Mead Method (NMM). Further, our new objective function results in much faster convergence towards a better architecture. The proposed framework has the ability to explore a CNN architecture’s numerous design choices in an efficient way and also allows effective, distributed execution and synchronization via web services. Empirically, we demonstrate that the CNN architecture designed with our approach outperforms several existing approaches in terms of its error rate. Our results are also competitive with state-of-the-art results on the MNIST dataset and perform reasonably against the state-of-the-art results on CIFAR-10 and CIFAR-100 datasets. Our approach has a significant role in increasing the depth, reducing the size of strides, and constraining some convolutional layers not followed by pooling layers in order to find a CNN architecture that produces a high recognition performance.
      PubDate: 2017-05-24
      DOI: 10.3390/e19060242
      Issue No: Vol. 19, No. 6 (2017)
  • Entropy, Vol. 19, Pages 243: On the Energy-Distortion Tradeoff of Gaussian
           Broadcast Channels with Feedback

    • Authors: Yonathan Murin, Yonatan Kaspi, Ron Dabora, Deniz Gündüz
      First page: 243
      Abstract: This work studies the relationship between the energy allocated for transmitting a pair of correlated Gaussian sources over a two-user Gaussian broadcast channel with noiseless channel output feedback (GBCF) and the resulting distortion at the receivers. Our goal is to characterize the minimum transmission energy required for broadcasting a pair of source samples, such that each source can be reconstructed at its respective receiver to within a target distortion, when the source-channel bandwidth ratio is not restricted. This minimum transmission energy is defined as the energy-distortion tradeoff (EDT). We derive a lower bound and three upper bounds on the optimal EDT. For the upper bounds, we analyze the EDT of three transmission schemes: two schemes are based on separate source-channel coding and apply encoding over multiple samples of source pairs, and the third scheme is a joint source-channel coding scheme that applies uncoded linear transmission on a single source-sample pair and is obtained by extending the Ozarow–Leung (OL) scheme. Numerical simulations show that the EDT of the OL-based scheme is close to that of the better of the two separation-based schemes, which makes the OL scheme attractive for energy-efficient, low-latency and low-complexity source transmission over GBCFs.
      PubDate: 2017-05-24
      DOI: 10.3390/e19060243
      Issue No: Vol. 19, No. 6 (2017)
  • Entropy, Vol. 19, Pages 244: The Tale of Two Financial Crises: An Entropic

    • Authors: Ramazan Gençay, Nikola Gradojevic
      First page: 244
      Abstract: This paper provides a comparative analysis of stock market dynamics of the 1987 and 2008 financial crises and discusses the extent to which risk management measures based on entropy can be successful in predicting aggregate market expectations. We find that the Tsallis entropy is more appropriate for the short and sudden market crash of 1987, while the approximate entropy is the dominant predictor of the prolonged, fundamental crisis of 2008. We conclude by suggesting the use of entropy as a market sentiment indicator in technical analysis.
      PubDate: 2017-05-24
      DOI: 10.3390/e19060244
      Issue No: Vol. 19, No. 6 (2017)
  • Entropy, Vol. 19, Pages 245: Entropy Analysis of Monetary Unions

    • Authors: Maria Mata, Jose Machado
      First page: 245
      Abstract: This paper is an exercise of quantitative dynamic analysis applied to bilateral relationships among partners within two monetary union case studies: the Portuguese escudo zone monetary union (EZMU) and the European euro zone monetary union (EMU). Real world data are tackled and measures that are usual in complex system analysis, such as entropy, mutual information, Canberra distance, and Jensen–Shannon divergence, are adopted. The emerging relationships are visualized by means of the multidimensional scaling and hierarchical clustering computational techniques. Results bring evidence on long-run stochastic dynamics that lead to asymmetric indebtedness mechanisms among the partners of a monetary union and sustainability difficulties. The consequences of unsustainability and disruption of monetary unions have high importance for the discussion on optimal currency areas from a geopolitical perspective.
      PubDate: 2017-05-24
      DOI: 10.3390/e19060245
      Issue No: Vol. 19, No. 6 (2017)
  • Entropy, Vol. 19, Pages 114: The Solution of Modified Fractional
           Bergman’s Minimal Blood Glucose-Insulin Model

    • Authors: Badr Alkahtani, Obaid Algahtani, Ravi Dubey, Pranay Goswami
      First page: 114
      Abstract: In the present paper, we use analytical techniques to solve fractional nonlinear differential equations systems that arise in Bergman’s minimal model, used to describe blood glucose and insulin metabolism, after intravenous tolerance testing. We also discuss the stability and uniqueness of the solution.
      PubDate: 2017-05-02
      DOI: 10.3390/e19050114
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 147: Assessing Catchment Resilience Using Entropy
           Associated with Mean Annual Runoff for the Upper Vaal Catchment in South

    • Authors: Masengo Ilunga
      First page: 147
      Abstract: The importance of the mean annual runoff (MAR)-hydrological variable is paramount for catchment planning, development and management. MAR depicts the amount of uncertainty or chaos (implicitly information content) of the catchment. The uncertainty associated with MAR of quaternary catchments (QCs) in the Upper Vaal catchment of South Africa has been quantified through Shannon entropy. As a result of chaos over a period of time, the hydrological catchment behavior/response in terms of MAR could be characterized by its resilience. Uncertainty (chaos) in QCs was used as a surrogate measure of catchment resilience. MAR data on surface water resources (WR) of South Africa of 1990 (i.e., WR90), 2005 (WR2005) and 2012 (W2012) were used in this study. A linear zoning for catchment resilience in terms of water resources sustainability was defined. Regression models (with high correlation) between the relative changes/variations in MAR data sets and relative changes in entropy were established, for WR2005 and WR2012. These models were compared with similar relationships for WR90 and WR2005, previously reported. The MAR pseudo-elasticity of the uncertainty associated with MAR was derived from regression models to characterize the resilience state of QCs. The MAR pseudo-elasticity values were relatively small to have an acceptable level of catchment resilience in the Upper Vaal catchment. Within the resilience zone, it was also shown that the effect of mean annual evaporation (MAE) was negatively significant on MAR pseudo-elasticity, compared to the effect of mean annual precipitation (MAP), which was positively insignificant.
      PubDate: 2017-04-27
      DOI: 10.3390/e19050147
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 173: En-LDA: An Novel Approach to Automatic Bug
           Report Assignment with Entropy Optimized Latent Dirichlet Allocation

    • Authors: Wen Zhang, Yangbo Cui, Taketoshi Yoshida
      First page: 173
      Abstract: With the increasing number of bug reports coming into the open bug repository, it is impossible to triage bug reports manually by software managers. This paper proposes a novel approach called En-LDA (Entropy optimized Latent Dirichlet Allocation (LDA)) for automatic bug report assignment. Specifically, we propose entropy to optimize the number of topics of the LDA model and further use the entropy optimized LDA to capture the expertise and interest of developers in bug resolution. A developer’s interest in a topic is modeled by the number of the developer’s comments on bug reports of the topic divided by the number of all the developer’s comments. A developer’s expertise in a topic is modeled by the number of the developer’s comments on bug reports of the topic divided by the number of all developers’ comments on the topic. Given a new bug report, En-LDA recommends a ranked list of developers who are potentially adequate to resolve the new bug. Experiments on Eclipse JDT and Mozilla Firefox projects show that En-LDA can achieve high recall up to 84% and 58%, and precision up to 28% and 41%, respectively, which indicates promising aspects of the proposed approach.
      PubDate: 2017-04-25
      DOI: 10.3390/e19050173
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 184: Recognition of Traveling Surges in HVDC with
           Wavelet Entropy

    • Authors: Guomin Luo, Qizhi Lin, Lin Zhou, Jinghan He
      First page: 184
      Abstract: Traveling surges are commonly adopted in protection devices of high-voltage direct current (HVDC) transmission systems. Lightning strikes also can produce large-amplitude traveling surges which lead to the malfunction of relays. To ensure the reliable operation of protection devices, recognition of traveling surges must be considered. Wavelet entropy, which can reveal time-frequency distribution features, is a potential tool for traveling surge recognition. In this paper, the effectiveness of wavelet entropy in characterizing traveling surges is demonstrated by comparing its representations of different kinds of surges and discussing its stability with the effects of propagation distance and fault resistance. A wavelet entropy-based recognition method is proposed and tested by simulated traveling surges. The results show wavelet entropy can discriminate fault traveling surges with a good recognition rate.
      PubDate: 2017-04-26
      DOI: 10.3390/e19050184
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 186: A Quantum Description of the
           Stern–Gerlach Experiment

    • Authors: Håkan Wennerström, Per-Olof Westlund
      First page: 186
      Abstract: A detailed analysis of the classic Stern–Gerlach experiment is presented. An analytical simple solution is presented for the quantum description of the translational and spin dynamics of a silver atom in a magnetic field with a gradient along a single z-direction. This description is then used to obtain an approximate quantum description of the more realistic case with a magnetic field gradient also in a second y-direction. An explicit relation is derived for how an initial off center deviation in the y-direction affects the final result observed at the detector. This shows that the “mouth shape” pattern at the detector observed in the original Stern–Gerlach experiment is a generic consequence of the gradient in the y-direction. This is followed by a discussion of the spin dynamics during the entry of the silver atom into the magnet. An analytical relation is derived for a simplified case of a field only along the z-direction. A central question for the conceptual understanding of the Stern–Gerlach experiment has been how an initially unpolarized spin ends up in a polarized state at the detector. It is argued that this can be understood with the use of the adiabatic approximation. When the atoms first experience the magnetic field outside the magnet, there is in general a change in the spin state, which transforms from a degenerate eigenstate in the absence of a field into one of two possible non-degenerate states in the field. If the direction of the field changes during the passage through the device, there is a corresponding adiabatic change of the spin state. It is shown that an application of the adiabatic approximation in this way is consistent with the previously derived exact relations.
      PubDate: 2017-04-25
      DOI: 10.3390/e19050186
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 187: Multicomponent and Longitudinal Imaging Seen
           as a Communication Channel—An Application to Stroke

    • Authors: Mathilde Giacalone, Carole Frindel, Emmanuel Grenier, David Rousseau
      First page: 187
      Abstract: In longitudinal medical studies, multicomponent images of the tissues, acquired at a given stage of a disease, are used to provide information on the fate of the tissues. We propose a quantification of the predictive value of multicomponent images using information theory. To this end, we revisit the predictive information introduced for monodimensional time series and extend it to multicomponent images. The interest of this theoretical approach is illustrated on multicomponent magnetic resonance images acquired on stroke patients at acute and late stages, for which we propose an original and realistic model of noise together with a spatial encoding for the images. We address therefrom very practical questions such as the impact of noise on the predictability, the optimal choice of an observation scale and the predictability gain brought by the addition of imaging components.
      PubDate: 2017-04-26
      DOI: 10.3390/e19050187
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 188: When the Map Is Better Than the Territory

    • Authors: Erik Hoel
      First page: 188
      Abstract: The causal structure of any system can be analyzed at a multitude of spatial and temporal scales. It has long been thought that while higher scale (macro) descriptions may be useful to observers, they are at best a compressed description and at worse leave out critical information and causal relationships. However, recent research applying information theory to causal analysis has shown that the causal structure of some systems can actually come into focus and be more informative at a macroscale. That is, a macroscale description of a system (a map) can be more informative than a fully detailed microscale description of the system (the territory). This has been called “causal emergence.” While causal emergence may at first seem counterintuitive, this paper grounds the phenomenon in a classic concept from information theory: Shannon’s discovery of the channel capacity. I argue that systems have a particular causal capacity, and that different descriptions of those systems take advantage of that capacity to various degrees. For some systems, only macroscale descriptions use the full causal capacity. These macroscales can either be coarse-grains, or may leave variables and states out of the model (exogenous, or “black boxed”) in various ways, which can improve the efficacy and informativeness via the same mathematical principles of how error-correcting codes take advantage of an information channel’s capacity. The causal capacity of a system can approach the channel capacity as more and different kinds of macroscales are considered. Ultimately, this provides a general framework for understanding how the causal structure of some systems cannot be fully captured by even the most detailed microscale description.
      PubDate: 2017-04-26
      DOI: 10.3390/e19050188
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 189: Entropy-Based Parameter Estimation for the
           Four-Parameter Exponential Gamma Distribution

    • Authors: Songbai Song, Xiaoyan Song, Yan Kang
      First page: 189
      Abstract: Two methods based on the principle of maximum entropy (POME), the ordinary entropy method (ENT) and the parameter space expansion method (PSEM), are developed for estimating the parameters of a four-parameter exponential gamma distribution. Using six data sets for annual precipitation at the Weihe River basin in China, the PSEM was applied for estimating parameters for the four-parameter exponential gamma distribution and was compared to the methods of moments (MOM) and of maximum likelihood estimation (MLE). It is shown that PSEM enables the four-parameter exponential distribution to fit the data well, and can further improve the estimation.
      PubDate: 2017-04-26
      DOI: 10.3390/e19050189
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 190: On the Anonymity Risk of Time-Varying User

    • Authors: Silvia Puglisi, David Rebollo-Monedero, Jordi Forné
      First page: 190
      Abstract: Websites and applications use personalisation services to profile their users, collect their patterns and activities and eventually use this data to provide tailored suggestions. User preferences and social interactions are therefore aggregated and analysed. Every time a user publishes a new post or creates a link with another entity, either another user, or some online resource, new information is added to the user profile. Exposing private data does not only reveal information about single users’ preferences, increasing their privacy risk, but can expose more about their network that single actors intended. This mechanism is self-evident in social networks where users receive suggestions based on their friends’ activities. We propose an information-theoretic approach to measure the differential update of the anonymity risk of time-varying user profiles. This expresses how privacy is affected when new content is posted and how much third-party services get to know about the users when a new activity is shared. We use actual Facebook data to show how our model can be applied to a real-world scenario.
      PubDate: 2017-04-26
      DOI: 10.3390/e19050190
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 191: Image Bi-Level Thresholding Based on Gray
           Level-Local Variance Histogram

    • Authors: Xiulian Zheng, Hong Ye, Yinggan Tang
      First page: 191
      Abstract: Thresholding is a popular method of image segmentation. Many thresholding methods utilize only the gray level information of pixels in the image, which may lead to poor segmentation performance because the spatial correlation information between pixels is ignored. To improve the performance of thresolding methods, a novel two-dimensional histogram—called gray level-local variance (GLLV) histogram—is proposed in this paper as an entropic thresholding method to segment images with bimodal histograms. The GLLV histogram is constructed by using the gray level information of pixels and its local variance in a neighborhood. Local variance measures the dispersion of gray level distribution of pixels in a neighborhood. If a pixel’s gray level is close to its neighboring pixels, its local variance is small, and vice versa. Therefore, local variance can reflect the spatial information between pixels. The GLLV histogram takes not only the gray level, but also the spatial information into consideration. Experimental results show that an entropic thresholding method based on the GLLV histogram can achieve better segmentation performance.
      PubDate: 2017-04-26
      DOI: 10.3390/e19050191
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 192: Entropy in the Tangled Nature Model of

    • Authors: Ty Roach, James Nulton, Paolo Sibani, Forest Rohwer, Peter Salamon
      First page: 192
      Abstract: Applications of entropy principles to evolution and ecology are of tantamount importance given the central role spatiotemporal structuring plays in both evolution and ecological succession. We obtain here a qualitative interpretation of the role of entropy in evolving ecological systems. Our interpretation is supported by mathematical arguments using simulation data generated by the Tangled Nature Model (TNM), a stochastic model of evolving ecologies. We define two types of configurational entropy and study their empirical time dependence obtained from the data. Both entropy measures increase logarithmically with time, while the entropy per individual decreases in time, in parallel with the growth of emergent structures visible from other aspects of the simulation. We discuss the biological relevance of these entropies to describe niche space and functional space of ecosystems, as well as their use in characterizing the number of taxonomic configurations compatible with different niche partitioning and functionality. The TNM serves as an illustrative example of how to calculate and interpret these entropies, which are, however, also relevant to real ecosystems, where they can be used to calculate the number of functional and taxonomic configurations that an ecosystem can realize.
      PubDate: 2017-04-27
      DOI: 10.3390/e19050192
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 193: Stochastic Stirling Engine Operating in
           Contact with Active Baths

    • Authors: Ruben Zakine, Alexandre Solon, Todd Gingrich, Frédéric van Wijland
      First page: 193
      Abstract: A Stirling engine made of a colloidal particle in contact with a nonequilibrium bath is considered and analyzed with the tools of stochastic energetics. We model the bath by non Gaussian persistent noise acting on the colloidal particle. Depending on the chosen definition of an isothermal transformation in this nonequilibrium setting, we find that either the energetics of the engine parallels that of its equilibrium counterpart or, in the simplest case, that it ends up being less efficient. Persistence, more than non-Gaussian effects, are responsible for this result.
      PubDate: 2017-04-27
      DOI: 10.3390/e19050193
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 194: Criticality and Information Dynamics in
           Epidemiological Models

    • Authors: E. Erten, Joseph Lizier, Mahendra Piraveenan, Mikhail Prokopenko
      First page: 194
      Abstract: Understanding epidemic dynamics has always been a challenge. As witnessed from the ongoing Zika or the seasonal Influenza epidemics, we still need to improve our analytical methods to better understand and control epidemics. While the emergence of complex sciences in the turn of the millennium have resulted in their implementation in modelling epidemics, there is still a need for improving our understanding of critical dynamics in epidemics. In this study, using agent-based modelling, we simulate a Susceptible-Infected-Susceptible (SIS) epidemic on a homogeneous network. We use transfer entropy and active information storage from information dynamics framework to characterise the critical transition in epidemiological models. Our study shows that both (bias-corrected) transfer entropy and active information storage maximise after the critical threshold ( R 0 = 1). This is the first step toward an information dynamics approach to epidemics. Understanding the dynamics around the criticality in epidemiological models can provide us insights about emergent diseases and disease control.
      PubDate: 2017-04-27
      DOI: 10.3390/e19050194
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 196: Symbolic Analysis of Brain Dynamics Detects
           Negative Stress

    • Authors: Beatriz García-Martínez, Arturo Martínez-Rodrigo, Roberto Zangróniz, José Pastor, Raúl Alcaraz
      First page: 196
      Abstract: The electroencephalogram (EEG) is the most common tool used to study mental disorders. In the last years, the use of this recording for recognition of negative stress has been receiving growing attention. However, precise identification of this emotional state is still an interesting unsolved challenge. Nowadays, stress presents a high prevalence in developed countries and, moreover, its chronic condition often leads to concomitant physical and mental health problems. Recently, a measure of time series irregularity, such as quadratic sample entropy (QSEn), has been suggested as a promising single index for discerning between emotions of calm and stress. Unfortunately, this index only considers repetitiveness of similar patterns and, hence, it is unable to quantify successfully dynamics associated with the data temporal structure. With the aim of extending QSEn ability for identification of stress from the EEG signal, permutation entropy (PEn) and its modification to be amplitude-aware (AAPEn) have been analyzed in the present work. These metrics assess repetitiveness of ordinal patterns, thus considering causal information within each one of them and obtaining improved estimates of predictability. Results have shown that PEn and AAPEn present a discriminant power between emotional states of calm and stress similar to QSEn, i.e., around 65%. Additionally, they have also revealed complementary dynamics to those quantified by QSEn, thus suggesting a synchronized behavior between frontal and parietal counterparts from both hemispheres of the brain. More precisely, increased stress levels have resulted in activation of the left frontal and right parietal regions and, simultaneously, in relaxing of the right frontal and left parietal areas. Taking advantage of this brain behavior, a discriminant model only based on AAPEn and QSEn computed from the EEG channels P3 and P4 has reached a diagnostic accuracy greater than 80%, which improves slightly the current state of the art. Moreover, because this classification system is notably easier than others previously proposed, it could be used for continuous monitoring of negative stress, as well as for its regulation towards more positive moods in controlled environments.
      PubDate: 2017-04-28
      DOI: 10.3390/e19050196
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 197: A New Kind of Permutation Entropy Used to
           Classify Sleep Stages from Invisible EEG Microstructure

    • Authors: Christoph Bandt
      First page: 197
      Abstract: Permutation entropy and order patterns in an EEG signal have been applied by several authors to study sleep, anesthesia, and epileptic absences. Here, we discuss a new version of permutation entropy, which is interpreted as distance to white noise. It has a scale similar to the well-known χ 2 distributions and can be supported by a statistical model. Critical values for significance are provided. Distance to white noise is used as a parameter which measures depth of sleep, where the vigilant awake state of the human EEG is interpreted as “almost white noise”. Classification of sleep stages from EEG data usually relies on delta waves and graphic elements, which can be seen on a macroscale of several seconds. The distance to white noise can anticipate such emerging waves before they become apparent, evaluating invisible tendencies of variations within 40 milliseconds. Data segments of 30 s of high-resolution EEG provide a reliable classification. Application to the diagnosis of sleep disorders is indicated.
      PubDate: 2017-04-28
      DOI: 10.3390/e19050197
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 198: Discovery of Kolmogorov Scaling in the
           Natural Language

    • Authors: Maurice van Putten
      First page: 198
      Abstract: We consider the rate R and variance σ 2 of Shannon information in snippets of text based on word frequencies in the natural language. We empirically identify Kolmogorov’s scaling law in σ 2 ∝ k - 1 . 66 ± 0 . 12 (95% c.l.) as a function of k = 1 / N measured by word count N. This result highlights a potential association of information flow in snippets, analogous to energy cascade in turbulent eddies in fluids at high Reynolds numbers. We propose R and σ 2 as robust utility functions for objective ranking of concordances in efficient search for maximal information seamlessly across different languages and as a starting point for artificial attention.
      PubDate: 2017-05-02
      DOI: 10.3390/e19050198
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 199: Cooperative Particle Filtering for Tracking
           ERP Subcomponents from Multichannel EEG

    • Authors: Sadaf Monajemi, Delaram Jarchi, Sim-Heng Ong, Saeid Sanei
      First page: 199
      Abstract: In this study, we propose a novel method to investigate P300 variability over different trials. The method incorporates spatial correlation between EEG channels to form a cooperative coupled particle filtering method that tracks the P300 subcomponents, P3a and P3b, over trials. Using state space systems, the amplitude, latency, and width of each subcomponent are modeled as the main underlying parameters. With four electrodes, two coupled Rao-Blackwellised particle filter pairs are used to recursively estimate the system state over trials. A number of physiological constraints are also imposed to avoid generating invalid particles in the estimation process. Motivated by the bilateral symmetry of ERPs over the brain, the channels further share their estimates with their neighbors and combine the received information to obtain a more accurate and robust solution. The proposed algorithm is capable of estimating the P300 subcomponents in single trials and outperforms its non-cooperative counterpart.
      PubDate: 2017-04-29
      DOI: 10.3390/e19050199
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 200: Effects of Movable-Baffle on Heat Transfer
           and Entropy Generation in a Cavity Saturated by CNT Suspensions:
           Three-Dimensional Modeling

    • Authors: Abdullah Al-Rashed, Walid Aich, Lioua Kolsi, Omid Mahian, Ahmed Hussein, Mohamed Borjini
      First page: 200
      Abstract: Convective heat transfer and entropy generation in a 3D closed cavity, equipped with adiabatic-driven baffle and filled with CNT (carbon nanotube)-water nanofluid, are numerically investigated for a range of Rayleigh numbers from 103 to 105. This research is conducted for three configurations; fixed baffle (V = 0), rotating baffle clockwise (V+) and rotating baffle counterclockwise (V−) and a range of CNT concentrations from 0 to 15%. Governing equations are formulated using potential vector vorticity formulation in its three-dimensional form, then solved by the finite volume method. The effects of motion direction of the inserted driven baffle and CNT concentration on heat transfer and entropy generation are studied. It was observed that for low Rayleigh numbers, the motion of the driven baffle enhances heat transfer regardless of its direction and the CNT concentration effect is negligible. However, with an increasing Rayleigh number, adding driven baffle increases the heat transfer only when it moves in the direction of the decreasing temperature gradient; elsewhere, convective heat transfer cannot be enhanced due to flow blockage at the corners of the baffle.
      PubDate: 2017-04-29
      DOI: 10.3390/e19050200
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 201: Utility, Revealed Preferences Theory, and
           Strategic Ambiguity in Iterated Games

    • Authors: Michael Harré
      First page: 201
      Abstract: Iterated games, in which the same economic interaction is repeatedly played between the same agents, are an important framework for understanding the effectiveness of strategic choices over time. To date, very little work has applied information theory to the information sets used by agents in order to decide what action to take next in such strategic situations. This article looks at the mutual information between previous game states and an agent’s next action by introducing two new classes of games: “invertible games” and “cyclical games”. By explicitly expanding out the mutual information between past states and the next action we show under what circumstances the explicit values of the utility are irrelevant for iterated games and this is then related to revealed preferences theory of classical economics. These information measures are then applied to the Traveler’s Dilemma game and the Prisoner’s Dilemma game, the Prisoner’s Dilemma being invertible, to illustrate their use. In the Prisoner’s Dilemma, a novel connection is made between the computational principles of logic gates and both the structure of games and the agents’ decision strategies. This approach is applied to the cyclical game Matching Pennies to analyse the foundations of a behavioural ambiguity between two well studied strategies: “Tit-for-Tat” and “Win-Stay, Lose-Switch”.
      PubDate: 2017-04-29
      DOI: 10.3390/e19050201
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 202: Kinetics of Interactions of Matter,
           Antimatter and Radiation Consistent with Antisymmetric (CPT-Invariant)

    • Authors: A.Y. Klimenko
      First page: 202
      Abstract: This work investigates the influence of directional properties of decoherence on kinetics rate equations. The physical reality is understood as a chain of unitary and decoherence events. The former are quantum-deterministic, while the latter introduce uncertainty and increase entropy. For interactions of matter and antimatter, two approaches are considered: symmetric decoherence, which corresponds to conventional symmetric (CP-invariant) thermodynamics, and antisymmetric decoherence, which corresponds to antisymmetric (CPT-invariant) thermodynamics. Radiation, in its interactions with matter and antimatter, is shown to be decoherence-neutral. The symmetric and antisymmetric assumptions result in different interactions of radiation with matter and antimatter. The theoretical predictions for these differences are testable by comparing absorption (emission) of light by thermodynamic systems made of matter and antimatter. Canonical typicality for quantum mixtures is briefly discussed in Appendix A.
      PubDate: 2017-05-02
      DOI: 10.3390/e19050202
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 203: Fractional Diffusion in a Solid with Mass

    • Authors: Yuriy Povstenko, Tamara Kyrylych, Grażyna Rygał
      First page: 203
      Abstract: The space-time-fractional diffusion equation with the Caputo time-fractional derivative and Riesz fractional Laplacian is considered in the case of axial symmetry. Mass absorption (mass release) is described by a source term proportional to concentration. The integral transform technique is used. Different particular cases of the solution are studied. The numerical results are illustrated graphically.
      PubDate: 2017-05-02
      DOI: 10.3390/e19050203
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 204: Measures of Qualitative Variation in the Case
           of Maximum Entropy

    • Authors: Atif Evren, Erhan Ustaoğlu
      First page: 204
      Abstract: Asymptotic behavior of qualitative variation statistics, including entropy measures, can be modeled well by normal distributions. In this study, we test the normality of various qualitative variation measures in general. We find that almost all indices tend to normality as the sample size increases, and they are highly correlated. However, for all of these qualitative variation statistics, maximum uncertainty is a serious factor that prevents normality. Among these, we study the properties of two qualitative variation statistics; VarNC and StDev statistics in the case of maximum uncertainty, since these two statistics show lower sampling variability and utilize all sample information. We derive probability distribution functions of these statistics and prove that they are consistent. We also discuss the relationship between VarNC and the normalized form of Tsallis (α = 2) entropy in the case of maximum uncertainty.
      PubDate: 2017-05-04
      DOI: 10.3390/e19050204
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 205: About the Concept of Quantum Chaos

    • Authors: Ignacio Gomez, Marcelo Losada, Olimpia Lombardi
      First page: 205
      Abstract: The research on quantum chaos finds its roots in the study of the spectrum of complex nuclei in the 1950s and the pioneering experiments in microwave billiards in the 1970s. Since then, a large number of new results was produced. Nevertheless, the work on the subject is, even at present, a superposition of several approaches expressed in different mathematical formalisms and weakly linked to each other. The purpose of this paper is to supply a unified framework for describing quantum chaos using the quantum ergodic hierarchy. Using the factorization property of this framework, we characterize the dynamical aspects of quantum chaos by obtaining the Ehrenfest time. We also outline a generalization of the quantum mixing level of the kicked rotator in the context of the impulsive differential equations.
      PubDate: 2017-05-03
      DOI: 10.3390/e19050205
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 206: Divergence and Sufficiency for Convex

    • Authors: Peter Harremoës
      First page: 206
      Abstract: Logarithmic score and information divergence appear in information theory, statistics, statistical mechanics, and portfolio theory. We demonstrate that all these topics involve some kind of optimization that leads directly to regret functions and such regret functions are often given by Bregman divergences. If a regret function also fulfills a sufficiency condition it must be proportional to information divergence. We will demonstrate that sufficiency is equivalent to the apparently weaker notion of locality and it is also equivalent to the apparently stronger notion of monotonicity. These sufficiency conditions have quite different relevance in the different areas of application, and often they are not fulfilled. Therefore sufficiency conditions can be used to explain when results from one area can be transferred directly to another and when one will experience differences.
      PubDate: 2017-05-03
      DOI: 10.3390/e19050206
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 207: Coarse Graining Shannon and von Neumann

    • Authors: Ana Alonso-Serrano, Matt Visser
      First page: 207
      Abstract: The nature of coarse graining is intuitively “obvious”, but it is rather difficult to find explicit and calculable models of the coarse graining process (and the resulting entropy flow) discussed in the literature. What we would like to have at hand is some explicit and calculable process that takes an arbitrary system, with specified initial entropy S, and that monotonically and controllably drives the entropy to its maximum value. This does not have to be a physical process, in fact for some purposes it is better to deal with a gedanken-process, since then it is more obvious how the “hidden information” is hiding in the fine-grain correlations that one is simply agreeing not to look at. We shall present several simple mathematically well-defined and easy to work with conceptual models for coarse graining. We shall consider both the classical Shannon and quantum von Neumann entropies, including models based on quantum decoherence, and analyse the entropy flow in some detail. When coarse graining the quantum von Neumann entropy, we find it extremely useful to introduce an adaptation of Hawking’s super-scattering matrix. These explicit models that we shall construct allow us to quantify and keep clear track of the entropy that appears when coarse graining the system and the information that can be hidden in unobserved correlations (while not the focus of the current article, in the long run, these considerations are of interest when addressing the black hole information puzzle).
      PubDate: 2017-05-03
      DOI: 10.3390/e19050207
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 208: Objective Bayesian Entropy Inference for
           Two-Parameter Logistic Distribution Using Upper Record Values

    • Authors: Jung Seo, Yongku Kim
      First page: 208
      Abstract: In this paper, we provide an entropy inference method that is based on an objective Bayesian approach for upper record values having a two-parameter logistic distribution. We derive the entropy that is based on the i-th upper record value and the joint entropy that is based on the upper record values. Moreover, we examine their properties. For objective Bayesian analysis, we obtain objective priors, namely, the Jeffreys and reference priors, for the unknown parameters of the logistic distribution. The priors are based on upper record values. Then, we develop an entropy inference method that is based on these objective priors. In real data analysis, we assess the quality of the proposed models under the objective priors and compare them with the model under the informative prior.
      PubDate: 2017-05-03
      DOI: 10.3390/e19050208
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 209: Ensemble Averages, Soliton Dynamics and
           Influence of Haptotaxis in a Model of Tumor-Induced Angiogenesis

    • Authors: Luis Bonilla, Manuel Carretero, Filippo Terragni
      First page: 209
      Abstract: In this work, we present a numerical study of the influence of matrix degrading enzyme (MDE) dynamics and haptotaxis on the development of vessel networks in tumor-induced angiogenesis. Avascular tumors produce growth factors that induce nearby blood vessels to emit sprouts formed by endothelial cells. These capillary sprouts advance toward the tumor by chemotaxis (gradients of growth factor) and haptotaxis (adhesion to the tissue matrix outside blood vessels). The motion of the capillaries in this constrained space is modelled by stochastic processes (Langevin equations, branching and merging of sprouts) coupled to continuum equations for concentrations of involved substances. There is a complementary deterministic description in terms of the density of actively moving tips of vessel sprouts. The latter forms a stable soliton-like wave whose motion is influenced by the different taxis mechanisms. We show the delaying effect of haptotaxis on the advance of the angiogenic vessel network by direct numerical simulations of the stochastic process and by a study of the soliton motion.
      PubDate: 2017-05-04
      DOI: 10.3390/e19050209
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 210: Information Content Based Optimal Radar
           Waveform Design: LPI’s Purpose

    • Authors: Jun Chen, Fei Wang, Jianjiang Zhou
      First page: 210
      Abstract: This paper presents a low probability of interception (LPI) radar waveform design method with a fixed average power constraint based on information theory. The Kullback–Leibler divergence (KLD) between the intercept signal and background noise is presented as a practical metric to evaluate the performance of the adversary intercept receiver in this paper. Through combining it with the radar performance metric, that is, the mutual information (MI), a multi-objective optimization model of LPI waveform design is developed. It is a trade-off between the performance of radar and enemy intercept receiver. After being transformed into a single-objective optimization problem, it can be solved by using an interior point method and a sequential quadratic programming (SQP) method. Simulation results verify the correctness and effectiveness of the proposed LPI radar waveform design method.
      PubDate: 2017-05-06
      DOI: 10.3390/e19050210
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 211: Meromorphic Non-Integrability of Several 3D
           Dynamical Systems

    • Authors: Kaiyin Huang, Shaoyun Shi, Wenlei Li
      First page: 211
      Abstract: In this paper, we apply the differential Galoisian approach to investigate the meromorphic non-integrability of a class of 3D equations in mathematical physics, including Nosé–Hoover equations, the Lü system, the Rikitake-like system and Rucklidge equations, which are well known in the fields of molecular dynamics, chaotic theory and fluid mechanics, respectively. Our main results show that all these considered systems are, in fact, non-integrable in nearly all parameters.
      PubDate: 2017-05-10
      DOI: 10.3390/e19050211
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 212: Boltzmann Entropy of a Newtonian Universe

    • Authors: D. Cabrera, Pedro Fernández de Córdoba, J.M. Isidro
      First page: 212
      Abstract: A dynamical estimate is given for the Boltzmann entropy of the Universe, under the simplifying assumptions provided by Newtonian cosmology. We first model the cosmological fluid as the probability fluid of a quantum-mechanical system. Next, following current ideas about the emergence of spacetime, we regard gravitational equipotentials as isoentropic surfaces. Therefore, gravitational entropy is proportional to the vacuum expectation value of the gravitational potential in a certain quantum state describing the matter contents of the Universe. The entropy of the matter sector can also be computed. While providing values of the entropy that turn out to be somewhat higher than existing estimates, our results are in perfect compliance with the upper bound set by the holographic principle.
      PubDate: 2017-05-06
      DOI: 10.3390/e19050212
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 213: Cockroach Swarm Optimization Algorithm for
           Travel Planning

    • Authors: Joanna Kwiecień, Marek Pasieka
      First page: 213
      Abstract: In transport planning, one should allow passengers to travel through the complicated transportation scheme with efficient use of different modes of transport. In this paper, we propose the use of a cockroach swarm optimization algorithm for determining paths with the shortest travel time. In our approach, this algorithm has been modified to work with the time-expanded model. Therefore, we present how the algorithm has to be adapted to this model, including correctly creating solutions and defining steps and movement in the search space. By introducing the proposed modifications, we are able to solve journey planning. The results have shown that the performance of our approach, in terms of converging to the best solutions, is satisfactory. Moreover, we have compared our results with Dijkstra’s algorithm and a particle swarm optimization algorithm.
      PubDate: 2017-05-06
      DOI: 10.3390/e19050213
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 214: Anatomy of a Spin: The Information-Theoretic
           Structure of Classical Spin Systems

    • Authors: Vikram Vijayaraghavan, Ryan James, James Crutchfield
      First page: 214
      Abstract: Collective organization in matter plays a significant role in its expressed physical properties. Typically, it is detected via an order parameter, appropriately defined for each given system’s observed emergent patterns. Recent developments in information theory, however, suggest quantifying collective organization in a system- and phenomenon-agnostic way: decomposing the system’s thermodynamic entropy density into a localized entropy, that is solely contained in the dynamics at a single location, and a bound entropy, that is stored in space as domains, clusters, excitations, or other emergent structures. As a concrete demonstration, we compute this decomposition and related quantities explicitly for the nearest-neighbor Ising model on the 1D chain, on the Bethe lattice with coordination number k = 3 , and on the 2D square lattice, illustrating its generality and the functional insights it gives near and away from phase transitions. In particular, we consider the roles that different spin motifs play (in cluster bulk, cluster edges, and the like) and how these affect the dependencies between spins.
      PubDate: 2017-05-08
      DOI: 10.3390/e19050214
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 215: Cauchy Principal Value Contour Integral with

    • Authors: Matilde Legua, Luis Sánchez-Ruiz
      First page: 215
      Abstract: Cauchy principal value is a standard method applied in mathematical applications by which an improper, and possibly divergent, integral is measured in a balanced way around singularities or at infinity. On the other hand, entropy prediction of systems behavior from a thermodynamic perspective commonly involves contour integrals. With the aim of facilitating the calculus of such integrals in this entropic scenario, we revisit the generalization of Cauchy principal value to complex contour integral, formalize its definition and—by using residue theory techniques—provide an useful way to evaluate them.
      PubDate: 2017-05-10
      DOI: 10.3390/e19050215
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 216: Designing Labeled Graph Classifiers by
           Exploiting the Rényi Entropy of the Dissimilarity Representation

    • Authors: Lorenzo Livi
      First page: 216
      Abstract: Representing patterns as labeled graphs is becoming increasingly common in the broad field of computational intelligence. Accordingly, a wide repertoire of pattern recognition tools, such as classifiers and knowledge discovery procedures, are nowadays available and tested for various datasets of labeled graphs. However, the design of effective learning procedures operating in the space of labeled graphs is still a challenging problem, especially from the computational complexity viewpoint. In this paper, we present a major improvement of a general-purpose classifier for graphs, which is conceived on an interplay between dissimilarity representation, clustering, information-theoretic techniques, and evolutionary optimization algorithms. The improvement focuses on a specific key subroutine devised to compress the input data. We prove different theorems which are fundamental to the setting of the parameters controlling such a compression operation. We demonstrate the effectiveness of the resulting classifier by benchmarking the developed variants on well-known datasets of labeled graphs, considering as distinct performance indicators the classification accuracy, computing time, and parsimony in terms of structural complexity of the synthesized classification models. The results show state-of-the-art standards in terms of test set accuracy and a considerable speed-up for what concerns the computing time.
      PubDate: 2017-05-09
      DOI: 10.3390/e19050216
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 217: On the Convergence and Law of Large Numbers
           for the Non-Euclidean Lp -Means

    • Authors: George Livadiotis
      First page: 217
      Abstract: This paper describes and proves two important theorems that compose the Law of Large Numbers for the non-Euclidean L p -means, known to be true for the Euclidean L 2 -means: Let the L p -mean estimator, which constitutes the specific functional that estimates the L p -mean of N independent and identically distributed random variables; then, (i) the expectation value of the L p -mean estimator equals the mean of the distributions of the random variables; and (ii) the limit N → ∞ of the L p -mean estimator also equals the mean of the distributions.
      PubDate: 2017-05-11
      DOI: 10.3390/e19050217
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 218: Minimum Entropy Active Fault Tolerant Control
           of the Non-Gaussian Stochastic Distribution System Subjected to Mean

    • Authors: Haokun Jin, Yacun Guan, Lina Yao
      First page: 218
      Abstract: Stochastic distribution control (SDC) systems are a group of systems where the outputs considered is the measured probability density function (PDF) of the system output whilst subjected to a normal crisp input. The purpose of the active fault tolerant control of such systems is to use the fault estimation information and other measured information to make the output PDF still track the given distribution when the objective PDF is known. However, if the target PDF is unavailable, the PDF tracking operation will be impossible. Minimum entropy control of the system output can be considered as an alternative strategy. The mean represents the center location of the stochastic variable, and it is reasonable that the minimum entropy fault tolerant controller can be designed subjected to mean constraint. In this paper, using the rational square-root B-spline model for the shape control of the system output probability density function (PDF), a nonlinear adaptive observer based fault diagnosis algorithm is proposed to diagnose the fault. Through the controller reconfiguration, the system entropy subjected to mean restriction can still be minimized when fault occurs. An illustrative example is utilized to demonstrate the use of the minimum entropy fault tolerant control algorithms.
      PubDate: 2017-05-11
      DOI: 10.3390/e19050218
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 219: Calculating Iso-Committor Surfaces as Optimal
           Reaction Coordinates with Milestoning

    • Authors: Ron Elber, Juan Bello-Rivas, Piao Ma, Alfredo Cardenas, Arman Fathizadeh
      First page: 219
      Abstract: Reaction coordinates are vital tools for qualitative and quantitative analysis of molecular processes. They provide a simple picture of reaction progress and essential input for calculations of free energies and rates. Iso-committor surfaces are considered the optimal reaction coordinate. We present an algorithm to compute efficiently a sequence of isocommittor surfaces. These surfaces are considered an optimal reaction coordinate. The algorithm analyzes Milestoning results to determine the committor function. It requires only the transition probabilities between the milestones, and not transition times. We discuss the following numerical examples: (i) a transition in the Mueller potential; (ii) a conformational change of a solvated peptide; and (iii) cholesterol aggregation in membranes.
      PubDate: 2017-05-11
      DOI: 10.3390/e19050219
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 220: A Functorial Construction of Quantum

    • Authors: Ivan Contreras, Ali Duman
      First page: 220
      Abstract: We apply the geometric quantization procedure via symplectic groupoids to the setting of epistemically-restricted toy theories formalized by Spekkens (Spekkens, 2016). In the continuous degrees of freedom, this produces the algebraic structure of quadrature quantum subtheories. In the odd-prime finite degrees of freedom, we obtain a functor from the Frobenius algebra of the toy theories to the Frobenius algebra of stabilizer quantum mechanics.
      PubDate: 2017-05-11
      DOI: 10.3390/e19050220
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 221: Muscle Fatigue Analysis of the Deltoid during
           Three Head-Related Static Isometric Contraction Tasks

    • Authors: Wenxiang Cui, Xiang Chen, Shuai Cao, Xu Zhang
      First page: 221
      Abstract: This study aimed to investigate the fatiguing characteristics of muscle-tendon units (MTUs) within skeletal muscles during static isometric contraction tasks. The deltoid was selected as the target muscle and three head-related static isometric contraction tasks were designed to activate three heads of the deltoid in different modes. Nine male subjects participated in this study. Surface electromyography (SEMG) signals were collected synchronously from the three heads of the deltoid. The performances of five SEMG parameters, including root mean square (RMS), mean power frequency (MPF), the first coefficient of autoregressive model (ARC1), sample entropy (SE) and Higuchi’s fractal dimension (HFD), in quantification of fatigue, were evaluated in terms of sensitivity to variability ratio (SVR) and consistency firstly. Then, the HFD parameter was selected as the fatigue index for further muscle fatigue analysis. The experimental results demonstrated that the three deltoid heads presented different activation modes during three head-related fatiguing contractions. The fatiguing characteristics of the three heads were found to be task-dependent, and the heads kept in a relatively high activation level were more prone to fatigue. In addition, the differences in fatiguing rate between heads increased with the increase in load. The findings of this study can be helpful in better understanding the underlying neuromuscular control strategies of the central nervous system (CNS). Based on the results of this study, the CNS was thought to control the contraction of the deltoid by taking the three heads as functional units, but a certain synergy among heads might also exist to accomplish a contraction task.
      PubDate: 2017-05-11
      DOI: 10.3390/e19050221
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 223: Prediction and Evaluation of Zero Order
           Entropy Changes in Grammar-Based Codes

    • Authors: Michal Vasinek, Jan Platos
      First page: 223
      Abstract: The change of zero order entropy is studied over different strategies of grammar production rule selection. The two major rules are distinguished: transformations leaving the message size intact and substitution functions changing the message size. Relations for zero order entropy changes were derived for both cases and conditions under which the entropy decreases were described. In this article, several different greedy strategies reducing zero order entropy, as well as message sizes are summarized, and the new strategy MinEnt is proposed. The resulting evolution of the zero order entropy is compared with a strategy of selecting the most frequent digram used in the Re-Pair algorithm.
      PubDate: 2017-05-13
      DOI: 10.3390/e19050223
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 224: Classification of Fractal Signals Using
           Two-Parameter Non-Extensive Wavelet Entropy

    • Authors: Julio Ramírez-Pacheco, Joel Trejo-Sánchez, Joaquin Cortez-González, Ramón Palacio
      First page: 224
      Abstract: This article proposes a methodology for the classification of fractal signals as stationary or nonstationary. The methodology is based on the theoretical behavior of two-parameter wavelet entropy of fractal signals. The wavelet ( q , q ′ ) -entropy is a wavelet-based extension of the ( q , q ′ ) -entropy of Borges and is based on the entropy planes for various q and q ′ ; it is theoretically shown that it constitutes an efficient and effective technique for fractal signal classification. Moreover, the second parameter q ′ provides further analysis flexibility and robustness in the sense that different ( q , q ′ ) pairs can analyze the same phenomena and increase the range of dispersion of entropies. A comparison study against the standard signal summation conversion technique shows that the proposed methodology is not only comparable in accuracy but also more computationally efficient. The application of the proposed methodology to physiological and financial time series is also presented along with the classification of these as stationary or nonstationary.
      PubDate: 2017-05-15
      DOI: 10.3390/e19050224
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 225: Entropy Information of Cardiorespiratory
           Dynamics in Neonates during Sleep

    • Authors: Maristella Lucchini, Nicolò Pini, William Fifer, Nina Burtchen, Maria Signorini
      First page: 225
      Abstract: Sleep is a central activity in human adults and characterizes most of the newborn infant life. During sleep, autonomic control acts to modulate heart rate variability (HRV) and respiration. Mechanisms underlying cardiorespiratory interactions in different sleep states have been studied but are not yet fully understood. Signal processing approaches have focused on cardiorespiratory analysis to elucidate this co-regulation. This manuscript proposes to analyze heart rate (HR), respiratory variability and their interrelationship in newborn infants to characterize cardiorespiratory interactions in different sleep states (active vs. quiet). We are searching for indices that could detect regulation alteration or malfunction, potentially leading to infant distress. We have analyzed inter-beat (RR) interval series and respiration in a population of 151 newborns, and followed up with 33 at 1 month of age. RR interval series were obtained by recognizing peaks of the QRS complex in the electrocardiogram (ECG), corresponding to the ventricles depolarization. Univariate time domain, frequency domain and entropy measures were applied. In addition, Transfer Entropy was considered as a bivariate approach able to quantify the bidirectional information flow from one signal (respiration) to another (RR series). Results confirm the validity of the proposed approach. Overall, HRV is higher in active sleep, while high frequency (HF) power characterizes more quiet sleep. Entropy analysis provides higher indices for SampEn and Quadratic Sample entropy (QSE) in quiet sleep. Transfer Entropy values were higher in quiet sleep and point to a major influence of respiration on the RR series. At 1 month of age, time domain parameters show an increase in HR and a decrease in variability. No entropy differences were found across ages. The parameters employed in this study help to quantify the potential for infants to adapt their cardiorespiratory responses as they mature. Thus, they could be useful as early markers of risk for infant cardiorespiratory vulnerabilities.
      PubDate: 2017-05-15
      DOI: 10.3390/e19050225
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 226: Information Entropy and Measures of Market

    • Authors: Daniel Pele, Emese Lazar, Alfonso Dufour
      First page: 226
      Abstract: In this paper we investigate the relationship between the information entropy of the distribution of intraday returns and intraday and daily measures of market risk. Using data on the EUR/JPY exchange rate, we find a negative relationship between entropy and intraday Value-at-Risk, and also between entropy and intraday Expected Shortfall. This relationship is then used to forecast daily Value-at-Risk, using the entropy of the distribution of intraday returns as a predictor.
      PubDate: 2017-05-16
      DOI: 10.3390/e19050226
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 227: Ion Hopping and Constrained Li Diffusion
           Pathways in the Superionic State of Antifluorite Li2O

    • Authors: Ajay Annamareddy, Jacob Eapen
      First page: 227
      Abstract: Li2O belongs to the family of antifluorites that show superionic behavior at high temperatures. While some of the superionic characteristics of Li2O are well-known, the mechanistic details of ionic conduction processes are somewhat nebulous. In this work, we first establish an onset of superionic conduction that is emblematic of a gradual disordering process among the Li ions at a characteristic temperature Tα (~1000 K) using reported neutron diffraction data and atomistic simulations. In the superionic state, the Li ions are observed to portray dynamic disorder by hopping between the tetrahedral lattice sites. We then show that string-like ionic diffusion pathways are established among the Li ions in the superionic state. The diffusivity of these dynamical string-like structures, which have a finite lifetime, shows a remarkable correlation to the bulk diffusivity of the system.
      PubDate: 2017-05-18
      DOI: 10.3390/e19050227
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 228: Face Verification with Multi-Task and
           Multi-Scale Feature Fusion

    • Authors: Xiaojun Lu, Yue Yang, Weilin Zhang, Qi Wang, Yang Wang
      First page: 228
      Abstract: Face verification for unrestricted faces in the wild is a challenging task. This paper proposes a method based on two deep convolutional neural networks (CNN) for face verification. In this work, we explore using identification signals to supervise one CNN and the combination of semi-verification and identification to train the other one. In order to estimate semi-verification loss at a low computation cost, a circle, which is composed of all faces, is used for selecting face pairs from pairwise samples. In the process of face normalization, we propose using different landmarks of faces to solve the problems caused by poses. In addition, the final face representation is formed by the concatenating feature of each deep CNN after principal component analysis (PCA) reduction. Furthermore, each feature is a combination of multi-scale representations through making use of auxiliary classifiers. For the final verification, we only adopt the face representation of one region and one resolution of a face jointing Joint Bayesian classifier. Experiments show that our method can extract effective face representation with a small training dataset and our algorithm achieves 99.71% verification accuracy on Labeled Faces in the Wild (LFW) dataset.
      PubDate: 2017-05-17
      DOI: 10.3390/e19050228
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 229: Investigation of the Intra- and Inter-Limb
           Muscle Coordination of Hands-and-Knees Crawling in Human Adults by Means
           of Muscle Synergy Analysis

    • Authors: Xiang Chen, Xiaocong Niu, De Wu, Yi Yu, Xu Zhang
      First page: 229
      Abstract: To investigate the intra- and inter-limb muscle coordination mechanism of human hands-and-knees crawling by means of muscle synergy analysis, surface electromyographic (sEMG) signals of 20 human adults were collected bilaterally from 32 limb related muscles during crawling with hands and knees at different speeds. The nonnegative matrix factorization (NMF) algorithm was exerted on each limb to extract muscle synergies. The results showed that intra-limb coordination was relatively stable during human hands-and-knees crawling. Two synergies, one relating to the stance phase and the other relating to the swing phase, could be extracted from each limb during a crawling cycle. Synergy structures during different speeds kept good consistency, but the recruitment levels, durations, and phases of muscle synergies were adjusted to adapt the change of crawling speed. Furthermore, the ipsilateral phase lag (IPL) value which was used to depict the inter-limb coordination changed with crawling speed for most subjects, and subjects using the no-limb-pairing mode at low speed tended to adopt the trot-like mode or pace-like mode at high speed. The research results could be well explained by the two-level central pattern generator (CPG) model consisting of a half-center rhythm generator (RG) and a pattern formation (PF) circuit. This study sheds light on the underlying control mechanism of human crawling.
      PubDate: 2017-05-17
      DOI: 10.3390/e19050229
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 230: Specific and Complete Local Integration of
           Patterns in Bayesian Networks

    • Authors: Martin Biehl, Takashi Ikegami, Daniel Polani
      First page: 230
      Abstract: We present a first formal analysis of specific and complete local integration. Complete local integration was previously proposed as a criterion for detecting entities or wholes in distributed dynamical systems. Such entities in turn were conceived to form the basis of a theory of emergence of agents within dynamical systems. Here, we give a more thorough account of the underlying formal measures. The main contribution is the disintegration theorem which reveals a special role of completely locally integrated patterns (what we call ι-entities) within the trajectories they occur in. Apart from proving this theorem we introduce the disintegration hierarchy and its refinement-free version as a way to structure the patterns in a trajectory. Furthermore, we construct the least upper bound and provide a candidate for the greatest lower bound of specific local integration. Finally, we calculate the ι -entities in small example systems as a first sanity check and find that ι -entities largely fulfil simple expectations.
      PubDate: 2017-05-18
      DOI: 10.3390/e19050230
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 231: A Novel Faults Diagnosis Method for Rolling
           Element Bearings Based on EWT and Ambiguity Correlation Classifiers

    • Authors: Xingmeng Jiang, Li Wu, Mingtao Ge
      First page: 231
      Abstract: According to non-stationary characteristic of the acoustic emission signal of rolling element bearings, a novel fault diagnosis method based on empirical wavelet transform (EWT) and ambiguity correlation classification (ACC) is proposed. In the proposed method, the acoustic emission signal acquired from a one-channel sensor is firstly decomposed using the EWT method, and then the mutual information of decomposed components and the original signal is computed and used to extract the noiseless component in order to obtain the reconstructed signal. Afterwards, the ambiguity correlation classifier, which has the advantages of ambiguity functions in the processing of the non-stationary signal, and the combining of correlation coefficients, is applied. Finally, multiple datasets of reconstructed signals for different operative conditions are fed to the ambiguity correlation classifier for training and testing. The proposed method was verified by experiments, and experimental results have shown that the proposed method can effectively diagnose three different operative conditions of rolling element bearings with higher detection rates than support vector machine and back-propagation (BP) neural network algorithms.
      PubDate: 2017-05-18
      DOI: 10.3390/e19050231
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 232: A Kullback–Leibler View of Maximum Entropy
           and Maximum Log-Probability Methods

    • Authors: Ali Abbas, Andrea H. Cadenbach, Ehsan Salimi
      First page: 232
      Abstract: Entropy methods enable a convenient general approach to providing a probability distribution with partial information. The minimum cross-entropy principle selects the distribution that minimizes the Kullback–Leibler divergence subject to the given constraints. This general principle encompasses a wide variety of distributions, and generalizes other methods that have been proposed independently. There remains, however, some confusion about the breadth of entropy methods in the literature. In particular, the asymmetry of the Kullback–Leibler divergence provides two important special cases when the target distribution is uniform: the maximum entropy method and the maximum log-probability method. This paper compares the performance of both methods under a variety of conditions. We also examine a generalized maximum log-probability method as a further demonstration of the generality of the entropy approach.
      PubDate: 2017-05-19
      DOI: 10.3390/e19050232
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 233: On Linear Coding over Finite Rings and
           Applications to Computing

    • Authors: Sheng Huang, Mikael Skoglund
      First page: 233
      Abstract: This paper presents a coding theorem for linear coding over finite rings, in the setting of the Slepian–Wolf source coding problem. This theorem covers corresponding achievability theorems of Elias (IRE Conv. Rec. 1955, 3, 37–46) and Csiszár (IEEE Trans. Inf. Theory 1982, 28, 585–592) for linear coding over finite fields as special cases. In addition, it is shown that, for any set of finite correlated discrete memoryless sources, there always exists a sequence of linear encoders over some finite non-field rings which achieves the data compression limit, the Slepian–Wolf region. Hence, the optimality problem regarding linear coding over finite non-field rings for data compression is closed with positive confirmation with respect to existence. For application, we address the problem of source coding for computing, where the decoder is interested in recovering a discrete function of the data generated and independently encoded by several correlated i.i.d. random sources. We propose linear coding over finite rings as an alternative solution to this problem. Results in Körner–Marton (IEEE Trans. Inf. Theory 1979, 25, 219–221) and Ahlswede–Han (IEEE Trans. Inf. Theory 1983, 29, 396–411, Theorem 10) are generalized to cases for encoding (pseudo) nomographic functions (over rings). Since a discrete function with a finite domain always admits a nomographic presentation, we conclude that both generalizations universally apply for encoding all discrete functions of finite domains. Based on these, we demonstrate that linear coding over finite rings strictly outperforms its field counterpart in terms of achieving better coding rates and reducing the required alphabet sizes of the encoders for encoding infinitely many discrete functions.
      PubDate: 2017-05-20
      DOI: 10.3390/e19050233
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 234: The Particle as a Statistical Ensemble of
           Events in Stueckelberg–Horwitz–Piron Electrodynamics

    • Authors: Martin Land
      First page: 234
      Abstract: In classical Maxwell electrodynamics, charged particles following deterministic trajectories are described by currents that induce fields, mediating interactions with other particles. Statistical methods are used when needed to treat complex particle and/or field configurations. In Stueckelberg–Horwitz–Piron (SHP) electrodynamics, the classical trajectories are traced out dynamically, through the evolution of a 4D spacetime event x μ ( τ ) as τ grows monotonically. Stueckelberg proposed to formalize the distinction between coordinate time x 0 = c t (measured by laboratory clocks) and chronology τ (the temporal ordering of event occurrence) in order to describe antiparticles and resolve problems of irreversibility such as grandfather paradoxes. Consequently, in SHP theory, the elementary object is not a particle (a 4D curve in spacetime) but rather an event (a single point along the dynamically evolving curve). Following standard deterministic methods in classical relativistic field theory, one is led to Maxwell-like field equations that are τ -dependent and sourced by a current that represents a statistical ensemble of instantaneous events distributed along the trajectory. The width λ of this distribution defines a correlation time for the interactions and a mass spectrum for the photons emitted by particles. As λ becomes very large, the photon mass goes to zero and the field equations become τ -independent Maxwell’s equations. Maxwell theory thus emerges as an equilibrium limit of SHP, in which λ is larger than any other relevant time scale. Thus, statistical mechanics is a fundamental ingredient in SHP electrodynamics, and its insights are required to give meaning to the concept of a particle.
      PubDate: 2017-05-19
      DOI: 10.3390/e19050234
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 236: Entropy in Investigation of Vasovagal
           Syndrome in Passive Head Up Tilt Test

    • Authors: Katarzyna Buszko, Agnieszka Piątkowska, Edward Koźluk, Grzegorz Opolski
      First page: 236
      Abstract: This paper presents an application of Approximate Entropy (ApEn) and Sample Entropy (SampEn) in the analysis of heart rhythm, blood pressure and stroke volume for the diagnosis of vasovagal syndrome. The analyzed biosignals were recorded during positive passive tilt tests—HUTT(+). Signal changes and their entropy were compared in three main phases of the test: supine position, tilt, and pre-syncope, with special focus on the latter, which was analyzed in a sliding window of each signal. In some cases, ApEn and SampEn were equally useful for the assessment of signal complexity (p < 0.05 in corresponding calculations). The complexity of the signals was found to decrease in the pre-syncope phase (SampEn (RRI): 1.20–0.34, SampEn (sBP): 1.29–0.57, SampEn (dBP): 1.19–0.48, SampEn (SV): 1.62–0.91). The pattern of the SampEn (SV) decrease differs from the pattern of the SampEn (sBP), SampEn (dBP) and SampEn (RRI) decrease. For all signals, the lowest entropy values in the pre-syncope phase were observed at the moment when loss of consciousness occurred.
      PubDate: 2017-05-20
      DOI: 10.3390/e19050236
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 237: Can a Robot Have Free Will?

    • Authors: Keith Farnsworth
      First page: 237
      Abstract: Using insights from cybernetics and an information-based understanding of biological systems, a precise, scientifically inspired, definition of free-will is offered and the essential requirements for an agent to possess it in principle are set out. These are: (a) there must be a self to self-determine; (b) there must be a non-zero probability of more than one option being enacted; (c) there must be an internal means of choosing among options (which is not merely random, since randomness is not a choice). For (a) to be fulfilled, the agent of self-determination must be organisationally closed (a “Kantian whole”). For (c) to be fulfilled: (d) options must be generated from an internal model of the self which can calculate future states contingent on possible responses; (e) choosing among these options requires their evaluation using an internally generated goal defined on an objective function representing the overall “master function” of the agent and (f) for “deep free-will”, at least two nested levels of choice and goal (d–e) must be enacted by the agent. The agent must also be able to enact its choice in physical reality. The only systems known to meet all these criteria are living organisms, not just humans, but a wide range of organisms. The main impediment to free-will in present-day artificial robots, is their lack of being a Kantian whole. Consciousness does not seem to be a requirement and the minimum complexity for a free-will system may be quite low and include relatively simple life-forms that are at least able to learn.
      PubDate: 2017-05-20
      DOI: 10.3390/e19050237
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 238: Lyapunov Spectra of Coulombic and
           Gravitational Periodic Systems

    • Authors: Pankaj Kumar, Bruce Miller
      First page: 238
      Abstract: An open question in nonlinear dynamics is the relation between the Kolmogorov entropy and the largest Lyapunov exponent of a given orbit. Both have been shown to have diagnostic capability for phase transitions in thermodynamic systems. For systems with long-range interactions, the choice of boundary plays a critical role and appropriate boundary conditions must be invoked. In this work, we compute Lyapunov spectra for Coulombic and gravitational versions of the one-dimensional systems of parallel sheets with periodic boundary conditions. Exact expressions for time evolution of the tangent-space vectors are derived and are utilized toward computing Lypaunov characteristic exponents using an event-driven algorithm. The results indicate that the energy dependence of the largest Lyapunov exponent emulates that of Kolmogorov entropy for each system for a given system size. Our approach forms an effective and approximation-free instrument for studying the dynamical properties exhibited by the Coulombic and gravitational systems and finds applications in investigating indications of thermodynamic transitions in small as well as large versions of the spatially periodic systems. When a phase transition exists, we find that the largest Lyapunov exponent serves as a precursor of the transition that becomes more pronounced as the system size increases.
      PubDate: 2017-05-20
      DOI: 10.3390/e19050238
      Issue No: Vol. 19, No. 5 (2017)
  • Entropy, Vol. 19, Pages 142: A Novel Framework for Shock Filter Using
           Partial Differential Equations

    • Authors: Chunmei Duan, Hongqian Lu
      First page: 142
      Abstract: In dilation or erosion processes, a shock filter is widely used in signal enhancing or image deburring. Traditionally, sign function is employed in shock filtering for reweighting of edge-detection in images and decides whether a pixel should dilate to the local maximum or evolve to the local minimum. Some researchers replace sign function with tanh function or arctan function, trying to change the evolution tracks of the pixels when filtering is in progress. However, analysis here reveals that only function replacement does usually not work. This paper revisits first shock filters and their modifications. Then, a fuzzy shock filter is proposed after a membership function in a shock filter model is adopted to adjust the evolve rate of image pixels. The proposed filter is a parameter tuning system, which unites several formulations of shock filters into one fuzzy framework. Experimental results show that the new filter is flexible and robust and can converge fast.
      PubDate: 2017-03-26
      DOI: 10.3390/e19040142
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 143: Paradigms of Cognition

    • Authors: Flemming Topsøe
      First page: 143
      Abstract: An abstract, quantitative theory which connects elements of information —key ingredients in the cognitive proces—is developed. Seemingly unrelated results are thereby unified. As an indication of this, consider results in classical probabilistic information theory involving information projections and so-called Pythagorean inequalities. This has a certain resemblance to classical results in geometry bearing Pythagoras’ name. By appealing to the abstract theory presented here, you have a common point of reference for these results. In fact, the new theory provides a general framework for the treatment of a multitude of global optimization problems across a range of disciplines such as geometry, statistics and statistical physics. Several applications are given, among them an “explanation” of Tsallis entropy is suggested. For this, as well as for the general development of the abstract underlying theory, emphasis is placed on interpretations and associated philosophical considerations. Technically, game theory is the key tool.
      PubDate: 2017-03-27
      DOI: 10.3390/e19040143
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 144: The Many Classical Faces of Quantum

    • Authors: Chris Heunen
      First page: 144
      Abstract: Interpretational problems with quantum mechanics can be phrased precisely by only talking about empirically accessible information. This prompts a mathematical reformulation of quantum mechanics in terms of classical mechanics. We survey this programme in terms of algebraic quantum theory.
      PubDate: 2017-03-29
      DOI: 10.3390/e19040144
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 145: Multiscale Cross-Approximate Entropy Analysis
           of Bilateral Fingertips Photoplethysmographic Pulse Amplitudes among
           Middle-to-Old Aged Individuals with or without Type 2 Diabetes

    • Authors: Hsien-Tsai Wu, Cheng-Chan Yang, Gen-Min Lin, Bagus Haryadi, Shiao-Chiang Chu, Chieh-Ming Yang, Cheuk-Kwan Sun
      First page: 145
      Abstract: Multiscale cross-approximate entropy (MC-ApEn) between two different physiological signals could evaluate cardiovascular health in diabetes. Whether MC-ApEn analysis between two similar signals such as photoplethysmographic (PPG) pulse amplitudes of bilateral fingertips can reflect diabetes status is unknown. From a middle-to-old-aged population free of prior cardiovascular disease, we selected the unaffected (no type 2 diabetes, n = 36), the well-controlled diabetes (glycated hemoglobin (HbA1c) < 8%, n = 30), and the poorly- controlled diabetes (HbA1c ≥ 8%, n = 26) groups. MC-ApEn indexes were calculated from simultaneous consecutive 1500 PPG pulse amplitudes signals of bilateral index fingertips. The average of scale factors 1–5 (MC-ApEnSS) and of scale factors 6–10 (MC-ApEnLS) were defined as the small- and large-scales MC-ApEn, respectively. The MC-ApEnLS index was highest in the unaffected, followed by the well-controlled diabetes, and then the poorly-controlled diabetes (0.70, 0.62, and 0.53; all paired p-values were <0.05); in contrast, the MC-ApEnSS index did not differ between groups. Our findings suggested that the bilateral fingertips large-scale MC-ApEnLS index of PPG pulse amplitudes might be able to evaluate the glycemic status and detect subtle vascular disease in type 2 diabetes.
      PubDate: 2017-03-30
      DOI: 10.3390/e19040145
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 146: Design and Implementation of SOC Prediction
           for a Li-Ion Battery Pack in an Electric Car with an Embedded System

    • Authors: Emel Soylu, Tuncay Soylu, Raif Bayir
      First page: 146
      Abstract: Li-Ion batteries are widely preferred in electric vehicles. The charge status of batteries is a critical evaluation issue, and many researchers are studying in this area. State of charge gives information about how much longer the battery can be used and when the charging process will be cut off. Incorrect predictions may cause overcharging or over-discharging of the battery. In this study, a low-cost embedded system is used to determine the state of charge of an electric car. A Li-Ion battery cell is trained using a feed-forward neural network via Matlab/Neural Network Toolbox. The trained cell is adapted to the whole battery pack of the electric car and embedded via Matlab/Simulink to a low-cost microcontroller that proposed a system in real-time. The experimental results indicated that accurate robust estimation results could be obtained by the proposed system.
      PubDate: 2017-04-17
      DOI: 10.3390/e19040146
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 148: Unsupervised Symbolization of Signal Time
           Series for Extraction of the Embedded Information

    • Authors: Yue Li, Asok Ray
      First page: 148
      Abstract: This paper formulates an unsupervised algorithm for symbolization of signal time series to capture the embedded dynamic behavior. The key idea is to convert time series of the digital signal into a string of (spatially discrete) symbols from which the embedded dynamic information can be extracted in an unsupervised manner (i.e., no requirement for labeling of time series). The main challenges here are: (1) definition of the symbol assignment for the time series; (2) identification of the partitioning segment locations in the signal space of time series; and (3) construction of probabilistic finite-state automata (PFSA) from the symbol strings that contain temporal patterns. The reported work addresses these challenges by maximizing the mutual information measures between symbol strings and PFSA states. The proposed symbolization method has been validated by numerical simulation as well as by experimentation in a laboratory environment. Performance of the proposed algorithm has been compared to that of two commonly used algorithms of time series partitioning.
      PubDate: 2017-03-31
      DOI: 10.3390/e19040148
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 149: A Distribution Family Bridging the Gaussian
           and the Laplace Laws, Gram–Charlier Expansions, Kurtosis Behaviour, and
           Entropy Features

    • Authors: Mario Faliva, Maria Zoia
      First page: 149
      Abstract: The paper devises a family of leptokurtic bell-shaped distributions which is based on the hyperbolic secant raised to a positive power, and bridges the Laplace and Gaussian laws on asymptotic arguments. Moment and cumulant generating functions are then derived and represented in terms of polygamma functions. The behaviour of shape parameters, namely kurtosis and entropy, is investigated. In addition, Gram–Charlier-type (GCT) expansions, based on the aforementioned distributions and their orthogonal polynomials, are specified, and an operational criterion is provided to meet modelling requirements in a possibly severe kurtosis and skewness environment. The role played by entropy within the kurtosis ranges of GCT expansions is also examined.
      PubDate: 2017-03-31
      DOI: 10.3390/e19040149
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 150: Minimum Sample Size for Reliable Causal
           Inference Using Transfer Entropy

    • Authors: Antônio Ramos, Elbert Macau
      First page: 150
      Abstract: Transfer Entropy has been applied to experimental datasets to unveil causality between variables. In particular, its application to non-stationary systems has posed a great challenge due to restrictions on the sample size. Here, we have investigated the minimum sample size that produces a reliable causal inference. The methodology has been applied to two prototypical models: the linear model autoregressive-moving average and the non-linear logistic map. The relationship between the Transfer Entropy value and the sample size has been systematically examined. Additionally, we have shown the dependence of the reliable sample size and the strength of coupling between the variables. Our methodology offers a realistic lower bound for the sample size to produce a reliable outcome.
      PubDate: 2017-03-31
      DOI: 10.3390/e19040150
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 151: A Combined Entropy/Phase-Field Approach to

    • Authors: Georg J. Schmitz
      First page: 151
      Abstract: Terms related to gradients of scalar fields are introduced as scalar products into the formulation of entropy. A Lagrange density is then formulated by adding constraints based on known conservation laws. Applying the Lagrange formalism to the resulting Lagrange density leads to the Poisson equation of gravitation and also includes terms which are related to the curvature of space. The formalism further leads to terms possibly explaining nonlinear extensions known from modified Newtonian dynamics approaches. The article concludes with a short discussion of the presented methodology and provides an outlook on other phenomena which might be dealt with using this new approach.
      PubDate: 2017-03-31
      DOI: 10.3390/e19040151
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 152: An Approach to the Evaluation of the Quality
           of Accounting Information Based on Relative Entropy in Fuzzy Linguistic

    • Authors: Ming Li, Xiaoli Ning, Mingzhu Li, Yingcheng Xu
      First page: 152
      Abstract: There is a risk when company stakeholders make decisions using accounting information with varied qualities in the same way. In order to evaluate the accounting information quality, this paper proposed an approach to the evaluation of the quality of accounting information based on relative entropy in fuzzy linguistic environments. Firstly, the accounting information quality evaluation criteria are constructed not only from the quality of the accounting information content but also from the accounting information generation environment. Considering that the rating values with respect to the criteria are in linguistic forms with different granularities, the method to deal with the linguistic rating values is given. In the method, the linguistic terms are modeled with the 2-tuple linguistic model. Relative entropy is used to calculate the information consistency, which is used to derive the weight of experts and criteria. Finally, the example is given to illustrate the feasibility and practicability of the proposed method.
      PubDate: 2017-04-05
      DOI: 10.3390/e19040152
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 153: Maxentropic Solutions to a Convex
           Interpolation Problem Motivated by Utility Theory

    • Authors: Henryk Gzyl, Silvia Mayoral
      First page: 153
      Abstract: Here, we consider the following inverse problem: Determination of an increasing continuous function U ( x ) on an interval [ a , b ] from the knowledge of the integrals ∫ U ( x ) d F X i ( x ) = π i where the X i are random variables taking values on [ a , b ] and π i are given numbers. This is a linear integral equation with discrete data, which can be transformed into a generalized moment problem when U ( x ) is supposed to have a positive derivative, and it becomes a classical interpolation problem if the X i are deterministic. In some cases, e.g., in utility theory in economics, natural growth and convexity constraints are required on the function, which makes the inverse problem more interesting. Not only that, the data may be provided in intervals and/or measured up to an additive error. It is the purpose of this work to show how the standard method of maximum entropy, as well as the method of maximum entropy in the mean, provides an efficient method to deal with these problems.
      PubDate: 2017-04-01
      DOI: 10.3390/e19040153
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 154: Is Turbulence a State of Maximum Energy

    • Authors: Martin Mihelich, Davide Faranda, Didier Paillard, Bérengère Dubrulle
      First page: 154
      Abstract: Turbulent flows are known to enhance turbulent transport. It has then even been suggested that turbulence is a state of maximum energy dissipation. In this paper, we re-examine critically this suggestion in light of several recent works around the Maximum Entropy Production principle (MEP) that has been used in several out-of-equilibrium systems. We provide a set of four different optimization principles, based on maximization of energy dissipation, entropy production, Kolmogorov–Sinai entropy and minimization of mixing time, and study the connection between these principles using simple out-of-equilibrium models describing mixing of a scalar quantity. We find that there is a chained-relationship between most probable stationary states of the system, and their ability to obey one of the four principles. This provides an empirical justification of the Maximum Entropy Production principle in this class of systems, including some turbulent flows, for special boundary conditions. Otherwise, we claim that the minimization of the mixing time would be a more appropriate principle. We stress that this principle might actually be limited to flows where symmetry or dynamics impose pure mixing of a quantity (like angular momentum, momentum or temperature). The claim that turbulence is a state of maximum energy dissipation, a quantity intimately related to entropy production, is therefore limited to special situations that nevertheless include classical systems such as shear flows, Rayleigh–Bénard convection and von Kármán flows, forced with constant velocity or temperature conditions.
      PubDate: 2017-03-31
      DOI: 10.3390/e19040154
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 155: Random Walks Associated with Nonlinear
           Fokker–Planck Equations

    • Authors: Renio dos Santos Mendes, Ervin Lenzi, Luis Malacarne, Sergio Picoli, Max Jauregui
      First page: 155
      Abstract: A nonlinear random walk related to the porous medium equation (nonlinear Fokker–Planck equation) is investigated. This random walk is such that when the number of steps is sufficiently large, the probability of finding the walker in a certain position after taking a determined number of steps approximates to a q-Gaussian distribution ( G q , β ( x ) ∝ [ 1 − ( 1 − q ) β x 2 ] 1 / ( 1 − q ) ), which is a solution of the porous medium equation. This can be seen as a verification of a generalized central limit theorem where the attractor is a q-Gaussian distribution, reducing to the Gaussian one when the linearity is recovered ( q → 1 ). In addition, motivated by this random walk, a nonlinear Markov chain is suggested.
      PubDate: 2017-04-01
      DOI: 10.3390/e19040155
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 156: Use of Exergy Analysis to Quantify the Effect
           of Lithium Bromide Concentration in an Absorption Chiller

    • Authors: Andrew Lake, Behanz Rezaie, Steven Beyerlein
      First page: 156
      Abstract: Absorption chillers present opportunities to utilize sustainable fuels in the production of chilled water. An assessment of the steam driven absorption chiller at the University of Idaho, was performed to quantify the current exergy destruction rates. Measurements of external processes and flows were used to create a mathematical model. Using engineering equation solver to analyze and identify the major sources of exergy destruction within the chiller. It was determined that the absorber, generator and condenser are the largest contribution to the exergy destruction at 30%, 31% and 28% of the respectively. The exergetic efficiency is found to be 16% with a Coefficient of performance (COP) of 0.65. Impacts of weak solution concentration of lithium bromide on the exergy destruction rates were evaluated using parametric studies. The studies reveled an optimum concentration that could be obtained by increasing the weak solution concentration from 56% to 58.8% a net decrease in 0.4% of the exergy destruction caused by the absorption chiller can be obtained. The 2.8% increase in lithium-bromide concentration decreases the exergy destruction primarily within the absorber with a decrease of 5.1%. This increase in concentration is shown to also decrease the maximum cooling capacity by 3% and increase the exergy destruction of the generator by 4.9%. The study also shows that the increase in concentration will change the internal temperatures by 3 to 7 °C. Conversely, reducing the weak solution concentration results is also shown to increase the exergetic destruction rates while also potentially increasing the cooling capacity.
      PubDate: 2017-04-01
      DOI: 10.3390/e19040156
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 157: Quadratic Mutual Information Feature

    • Authors: Davor Sluga, Uroš Lotrič
      First page: 157
      Abstract: We propose a novel feature selection method based on quadratic mutual information which has its roots in Cauchy–Schwarz divergence and Renyi entropy. The method uses the direct estimation of quadratic mutual information from data samples using Gaussian kernel functions, and can detect second order non-linear relations. Its main advantages are: (i) unified analysis of discrete and continuous data, excluding any discretization; and (ii) its parameter-free design. The effectiveness of the proposed method is demonstrated through an extensive comparison with mutual information feature selection (MIFS), minimum redundancy maximum relevance (MRMR), and joint mutual information (JMI) on classification and regression problem domains. The experiments show that proposed method performs comparably to the other methods when applied to classification problems, except it is considerably faster. In the case of regression, it compares favourably to the others, but is slower.
      PubDate: 2017-04-01
      DOI: 10.3390/e19040157
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 158: Nonequilibrium Thermodynamics and Steady
           State Density Matrix for Quantum Open Systems

    • Authors: Hervé Ness
      First page: 158
      Abstract: We consider the generic model of a finite-size quantum electron system connected to two (temperature and particle) reservoirs. The quantum open system is driven out of equilibrium by the presence of both potential temperature and chemical differences between the two reservoirs. The nonequilibrium (NE) thermodynamical properties of such a quantum open system are studied for the steady state regime. In such a regime, the corresponding NE density matrix is built on the so-called generalised Gibbs ensembles. From different expressions of the NE density matrix, we can identify the terms related to the entropy production in the system. We show, for a simple model, that the entropy production rate is always a positive quantity. Alternative expressions for the entropy production are also obtained from the Gibbs–von Neumann conventional formula and discussed in detail. Our results corroborate and expand earlier works found in the literature.
      PubDate: 2017-04-02
      DOI: 10.3390/e19040158
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 159: A Study of the Transfer Entropy Networks on
           Industrial Electricity Consumption

    • Authors: Can-Zhong Yao, Peng-Cheng Kuang, Qing-Wen Lin, Bo-Yi Sun
      First page: 159
      Abstract: We study information transfer routes among cross-industry and cross-region electricity consumption data based on transfer entropy and the MST (Minimum Spanning Tree) model. First, we characterize the information transfer routes with transfer entropy matrixes, and find that the total entropy transfer of the relatively developed Guangdong Province is lower than others, with significant industrial cluster within the province. Furthermore, using a reshuffling method, we find that driven industries contain much more information flows than driving industries, and are more influential on the degree of order of regional industries. Finally, based on the Chu-Liu-Edmonds MST algorithm, we extract the minimum spanning trees of provincial industries. Individual MSTs show that the MSTs follow a chain-like formation in developed provinces and star-like structures in developing provinces. Additionally, all MSTs with the root of minimal information outflow industrial sector are of chain-form.
      PubDate: 2017-04-13
      DOI: 10.3390/e19040159
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 160: Consistent Estimation of Partition Markov

    • Authors: Jesús Garca, Verónica González-López
      First page: 160
      Abstract: The Partition Markov Model characterizes the process by a partition L of the state space, where the elements in each part of L share the same transition probability to an arbitrary element in the alphabet. This model aims to answer the following questions: what is the minimal number of parameters needed to specify a Markov chain and how to estimate these parameters. In order to answer these questions, we build a consistent strategy for model selection which consist of: giving a size n realization of the process, finding a model within the Partition Markov class, with a minimal number of parts to represent the process law. From the strategy, we derive a measure that establishes a metric in the state space. In addition, we show that if the law of the process is Markovian, then, eventually, when n goes to infinity, L will be retrieved. We show an application to model internet navigation patterns.
      PubDate: 2017-04-06
      DOI: 10.3390/e19040160
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 161: P-Adic Analog of Navier–Stokes Equations:
           Dynamics of Fluid’s Flow in Percolation Networks (from Discrete Dynamics
           with Hierarchic Interactions to Continuous Universal Scaling Model)

    • Authors: Klaudia Oleschko, Andrei Khrennikov, María Correa López
      First page: 161
      Abstract: Recently p-adic (and, more generally, ultrametric) spaces representing tree-like networks of percolation, and as a special case of capillary patterns in porous media, started to be used to model the propagation of fluids (e.g., oil, water, oil-in-water, and water-in-oil emulsion). The aim of this note is to derive p-adic dynamics described by fractional differential operators (Vladimirov operators) starting with discrete dynamics based on hierarchically-structured interactions between the fluids’ volumes concentrated at different levels of the percolation tree and coming to the multiscale universal topology of the percolating nets. Similar systems of discrete hierarchic equations were widely applied to modeling of turbulence. However, in the present work this similarity is only formal since, in our model, the trees are real physical patterns with a tree-like topology of capillaries (or fractures) in random porous media (not cascade trees, as in the case of turbulence, which we will be discussed elsewhere for the spinner flowmeter commonly used in the petroleum industry). By going to the “continuous limit” (with respect to the p-adic topology) we represent the dynamics on the tree-like configuration space as an evolutionary nonlinear p-adic fractional (pseudo-) differential equation, the tree-like analog of the Navier–Stokes equation. We hope that our work helps to come closer to a nonlinear equation solution, taking into account the scaling, hierarchies, and formal derivations, imprinted from the similar properties of the real physical world. Once this coupling is resolved, the more problematic question of information scaling in industrial applications will be achieved.
      PubDate: 2017-04-07
      DOI: 10.3390/e19040161
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 162: Situatedness and Embodiment of Computational

    • Authors: Marcin Miłkowski
      First page: 162
      Abstract: In this paper, the role of the environment and physical embodiment of computational systems for explanatory purposes will be analyzed. In particular, the focus will be on cognitive computational systems, understood in terms of mechanisms that manipulate semantic information. It will be argued that the role of the environment has long been appreciated, in particular in the work of Herbert A. Simon, which has inspired the mechanistic view on explanation. From Simon’s perspective, the embodied view on cognition seems natural but it is nowhere near as critical as its proponents suggest. The only point of difference between Simon and embodied cognition is the significance of body-based off-line cognition; however, it will be argued that it is notoriously over-appreciated in the current debate. The new mechanistic view on explanation suggests that even if it is critical to situate a mechanism in its environment and study its physical composition, or realization, it is also stressed that not all detail counts, and that some bodily features of cognitive systems should be left out from explanations.
      PubDate: 2017-04-07
      DOI: 10.3390/e19040162
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 163: Modelling Urban Sprawl Using Remotely Sensed
           Data: A Case Study of Chennai City, Tamilnadu

    • Authors: Rajchandar Padmanaban, Avit K. Bhowmik, Pedro Cabral, Alexander Zamyatin, Oraib Almegdadi, Shuangao Wang
      First page: 163
      Abstract: Urban sprawl (US), propelled by rapid population growth leads to the shrinkage of productive agricultural lands and pristine forests in the suburban areas and, in turn, adversely affects the provision of ecosystem services. The quantification of US is thus crucial for effective urban planning and environmental management. Like many megacities in fast growing developing countries, Chennai, the capital of Tamilnadu and one of the business hubs in India, has experienced extensive US triggered by the doubling of total population over the past three decades. However, the extent and level of US has not yet been quantified and a prediction for future extent of US is lacking. We employed the Random Forest (RF) classification on Landsat imageries from 1991, 2003, and 2016, and computed six landscape metrics to delineate the extent of urban areas within a 10 km suburban buffer of Chennai. The level of US was then quantified using Renyi’s entropy. A land change model was subsequently used to project land cover for 2027. A 70.35% expansion in urban areas was observed mainly towards the suburban periphery of Chennai between 1991 and 2016. The Renyi’s entropy value for year 2016 was 0.9, exhibiting a two-fold level of US when compared to 1991. The spatial metrics values indicate that the existing urban areas became denser and the suburban agricultural, forests and particularly barren lands were transformed into fragmented urban settlements. The forecasted land cover for 2027 indicates a conversion of 13,670.33 ha (16.57% of the total landscape) of existing forests and agricultural lands into urban areas with an associated increase in the entropy value to 1.7, indicating a tremendous level of US. Our study provides useful metrics for urban planning authorities to address the social-ecological consequences of US and to protect ecosystem services.
      PubDate: 2017-04-07
      DOI: 10.3390/e19040163
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 164: Heisenberg and Entropic Uncertainty Measures
           for Large-Dimensional Harmonic Systems

    • Authors: David Puertas-Centeno, Irene Toranzo, Jesús Dehesa
      First page: 164
      Abstract: The D-dimensional harmonic system (i.e., a particle moving under the action of a quadratic potential) is, together with the hydrogenic system, the main prototype of the physics of multidimensional quantum systems. In this work, we rigorously determine the leading term of the Heisenberg-like and entropy-like uncertainty measures of this system as given by the radial expectation values and the Rényi entropies, respectively, at the limit of large D. The associated multidimensional position-momentum uncertainty relations are discussed, showing that they saturate the corresponding general ones. A conjecture about the Shannon-like uncertainty relation is given, and an interesting phenomenon is observed: the Heisenberg-like and Rényi-entropy-based equality-type uncertainty relations for all of the D-dimensional harmonic oscillator states in the pseudoclassical ( D → ∞ ) limit are the same as the corresponding ones for the hydrogenic systems, despite the so different character of the oscillator and Coulomb potentials.
      PubDate: 2017-04-09
      DOI: 10.3390/e19040164
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 165: An Entropy-Based Approach for Evaluating
           Travel Time Predictability Based on Vehicle Trajectory Data

    • Authors: Tao Xu, Xianrui Xu, Yujie Hu, Xiang Li
      First page: 165
      Abstract: With the great development of intelligent transportation systems (ITS), travel time prediction has attracted the interest of many researchers, and a large number of prediction methods have been developed. However, as an unavoidable topic, the predictability of travel time series is the basic premise for travel time prediction, which has received less attention than the methodology. Based on the analysis of the complexity of the travel time series, this paper defines travel time predictability to express the probability of correct travel time prediction, and proposes an entropy-based method to measure the upper bound of travel time predictability. Multiscale entropy is employed to quantify the complexity of the travel time series, and the relationships between entropy and the upper bound of travel time predictability are presented. Empirical studies are made with vehicle trajectory data in an express road section to shape the features of travel time predictability. The effectiveness of time scales, tolerance, and series length to entropy and travel time predictability are analyzed, and some valuable suggestions about the accuracy of travel time predictability are discussed. Finally, comparisons between travel time predictability and actual prediction results from two prediction models, ARIMA and BPNN, are made. Experimental results demonstrate the validity and reliability of the proposed travel time predictability.
      PubDate: 2017-04-11
      DOI: 10.3390/e19040165
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 166: Entropic Aspects of Nonlinear Partial
           Differential Equations: Classical and Quantum Mechanical Perspectives

    • Authors: Angelo Plastino
      First page: 166
      Abstract: There has been increasing research activity in recent years concerning the properties and the applications of nonlinear partial differential equations that are closely related to nonstandard entropic functionals, such as the Tsallis and Renyi entropies.[...]
      PubDate: 2017-04-12
      DOI: 10.3390/e19040166
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 167: Application of the Fuzzy Oil Drop Model
           Describes Amyloid as a Ribbonlike Micelle

    • Authors: Irena Roterman, Mateusz Banach, Leszek Konieczny
      First page: 167
      Abstract: We propose a mathematical model describing the formation of micellar forms—whether spherical, globular, cylindrical, or ribbonlike—as well as its adaptation to protein structure. Our model, based on the fuzzy oil drop paradigm, assumes that in a spherical micelle the distribution of hydrophobicity produced by the alignment of polar molecules with the external water environment can be modeled by a 3D Gaussian function. Perturbing this function by changing the values of its sigma parameters leads to a variety of conformations—the model is therefore applicable to globular, cylindrical, and ribbonlike micelles. In the context of protein structures ranging from globular to ribbonlike, our model can explain the emergence of fibrillar forms; particularly amyloids.
      PubDate: 2017-04-14
      DOI: 10.3390/e19040167
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 169: Where There is Life There is Mind: In Support
           of a Strong Life-Mind Continuity Thesis

    • Authors: Michael D. Kirchhoff, Tom Froese
      First page: 169
      Abstract: This paper considers questions about continuity and discontinuity between life and mind. It begins by examining such questions from the perspective of the free energy principle (FEP). The FEP is becoming increasingly influential in neuroscience and cognitive science. It says that organisms act to maintain themselves in their expected biological and cognitive states, and that they can do so only by minimizing their free energy given that the long-term average of free energy is entropy. The paper then argues that there is no singular interpretation of the FEP for thinking about the relation between life and mind. Some FEP formulations express what we call an independence view of life and mind. One independence view is a cognitivist view of the FEP. It turns on information processing with semantic content, thus restricting the range of systems capable of exhibiting mentality. Other independence views exemplify what we call an overly generous non-cognitivist view of the FEP, and these appear to go in the opposite direction. That is, they imply that mentality is nearly everywhere. The paper proceeds to argue that non-cognitivist FEP, and its implications for thinking about the relation between life and mind, can be usefully constrained by key ideas in recent enactive approaches to cognitive science. We conclude that the most compelling account of the relationship between life and mind treats them as strongly continuous, and that this continuity is based on particular concepts of life (autopoiesis and adaptivity) and mind (basic and non-semantic).
      PubDate: 2017-04-14
      DOI: 10.3390/e19040169
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 170: Dynamic Rankings for Seed Selection in
           Complex Networks: Balancing Costs and Coverage

    • Authors: Jarosław Jankowski
      First page: 170
      Abstract: Information spreading processes within the complex networks are usually initiated by a selection of highly influential nodes in accordance with the used seeding strategy. The majority of earlier studies assumed the usage of selected seeds at the beginning of the process. Our previous research revealed the advantage of using a sequence of seeds instead of a single stage approach. The current study extends sequential seeding and further improves results with the use of dynamic rankings, which are created by recalculation of network measures used for additional seed selection during the process instead of static ranking computed only once at the beginning. For calculation of network centrality measures such as degree, only non-infected nodes are taken into account. Results showed increased coverage represented by a percentage of activated nodes dependent on intervals between recalculations as well as the trade-off between outcome and computational costs. For over 90% of simulation cases, dynamic rankings with a high frequency of recalculations delivered better coverage than approaches based on static rankings.
      PubDate: 2017-04-15
      DOI: 10.3390/e19040170
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 171: Entropy Generation of Double Diffusive Forced
           Convection in Porous Channels with Thick Walls and Soret Effect

    • Authors: Mohsen Torabi, Mehrdad Torabi, G.P. Peterson
      First page: 171
      Abstract: The second law performance of double diffusive forced convection in a horizontal porous channel with thick walls was considered. The Soret effect is included in the concentration equation and the first order chemical reaction was chosen for the concentration boundary conditions at the porous-solid walls interfaces. This investigation is focused on two principal types of boundary conditions. The first assumes a constant temperature condition at the outer surfaces of the solid walls, and the second assumes a constant heat flux at the lower wall and convection heat transfer at the upper wall. After obtaining the velocity, temperature and concentration distributions, the local and total entropy generation formulations were used to visualize the second law performance of the two cases. The results indicate that the total entropy generation rate is directly related to the lower wall thickness. Interestingly, it was observed that the total entropy generation rate for the second case reaches a minimum value, if the upper and lower wall thicknesses are chosen correctly. However, this observation was not true for the first case. These analyses can be useful for the design of microreactors and microcombustor systems when the second law analysis is taken into account.
      PubDate: 2017-04-15
      DOI: 10.3390/e19040171
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 172: Multilevel Integration Entropies: The Case of

    • Authors: Slobodan Maletić, Yi Zhao
      First page: 172
      Abstract: The emergence of complex datasets permeates versatile research disciplines leading to the necessity to develop methods for tackling complexity through finding the patterns inherent in datasets. The challenge lies in transforming the extracted patterns into pragmatic knowledge. In this paper, new information entropy measures for the characterization of the multidimensional structure extracted from complex datasets are proposed, complementing the conventionally-applied algebraic topology methods. Derived from topological relationships embedded in datasets, multilevel entropy measures are used to track transitions in building the high dimensional structure of datasets captured by the stratified partition of a simplicial complex. The proposed entropies are found suitable for defining and operationalizing the intuitive notions of structural relationships in a cumulative experience of a taxi driver’s cognitive map formed by origins and destinations. The comparison of multilevel integration entropies calculated after each new added ride to the data structure indicates slowing the pace of change over time in the origin-destination structure. The repetitiveness in taxi driver rides, and the stability of origin-destination structure, exhibits the relative invariance of rides in space and time. These results shed light on taxi driver’s ride habits, as well as on the commuting of persons whom he/she drove.
      PubDate: 2017-04-18
      DOI: 10.3390/e19040172
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 174: Leaks: Quantum, Classical, Intermediate and

    • Authors: John Selby, Bob Coecke
      First page: 174
      Abstract: We introduce the notion of a leak for general process theories and identify quantum theory as a theory with minimal leakage, while classical theory has maximal leakage. We provide a construction that adjoins leaks to theories, an instance of which describes the emergence of classical theory by adjoining decoherence leaks to quantum theory. Finally, we show that defining a notion of purity for processes in general process theories has to make reference to the leaks of that theory, a feature missing in standard definitions; hence, we propose a refined definition and study the resulting notion of purity for quantum, classical and intermediate theories.
      PubDate: 2017-04-19
      DOI: 10.3390/e19040174
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 175: Second Law Analysis of a Mobile Air
           Conditioning System with Internal Heat Exchanger Using Low GWP

    • Authors: Vicente Pérez-García, Juan Belman-Flores, José Rodríguez-Muñoz, Víctor. Rangel-Hernández, Armando Gallegos-Muñoz
      First page: 175
      Abstract: This paper investigates the results of a Second Law analysis applied to a mobile air conditioning system (MACs) integrated with an internal heat exchanger (IHX) by considering R152a, R1234yf and R1234ze as low global warming potential (GWP) refrigerants and establishing R134a as baseline. System simulation is performed considering the maximum value of entropy generated in the IHX. The maximum entropy production occurs at an effectiveness of 66% for both R152a and R134a, whereas for the cases of R1234yf and R1234ze occurs at 55%. Sub-cooling and superheating effects are evaluated for each one of the cases. It is also found that the sub-cooling effect shows the greatest impact on the cycle efficiency. The results also show the influence of isentropic efficiency on relative exergy destruction, resulting that the most affected components are the compressor and the condenser for all of the refrigerants studied herein. It is also found that the most efficient operation of the system resulted to be when using the R1234ze refrigerant.
      PubDate: 2017-04-19
      DOI: 10.3390/e19040175
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 176: Multi-Scale Permutation Entropy Based on
           Improved LMD and HMM for Rolling Bearing Diagnosis

    • Authors: Yangde Gao, Francesco Villecco, Ming Li, Wanqing Song
      First page: 176
      Abstract: Based on the combination of improved Local Mean Decomposition (LMD), Multi-scale Permutation Entropy (MPE) and Hidden Markov Model (HMM), the fault types of bearings are diagnosed. Improved LMD is proposed based on the self-similarity of roller bearing vibration signal by extending the right and left side of the original signal to suppress its edge effect. First, the vibration signals of the rolling bearing are decomposed into several product function (PF) components by improved LMD respectively. Then, the phase space reconstruction of the PF1 is carried out by using the mutual information (MI) method and the false nearest neighbor (FNN) method to calculate the delay time and the embedding dimension, and then the scale is set to obtain the MPE of PF1. After that, the MPE features of rolling bearings are extracted. Finally, the features of MPE are used as HMM training and diagnosis. The experimental results show that the proposed method can effectively identify the different faults of the rolling bearing.
      PubDate: 2017-04-19
      DOI: 10.3390/e19040176
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 177: Entropy in Natural Time and the Associated
           Complexity Measures

    • Authors: Nicholas Sarlis
      First page: 177
      Abstract: Natural time is a new time domain introduced in 2001. The analysis of time series associated with a complex system in natural time may provide useful information and may reveal properties that are usually hidden when studying the system in conventional time. In this new time domain, an entropy has been defined, and complexity measures based on this entropy, as well as its value under time-reversal have been introduced and found applications in various complex systems. Here, we review these applications in the electric signals that precede rupture, e.g., earthquakes, in the analysis of electrocardiograms, as well as in global atmospheric phenomena, like the El Niño/La Niña Southern Oscillation.
      PubDate: 2017-04-20
      DOI: 10.3390/e19040177
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 178: Entropy “2”-Soft Classification
           of Objects

    • Authors: Yuri Popkov, Zeev Volkovich, Yuri Dubnov, Renata Avros, Elena Ravve
      First page: 178
      Abstract: A proposal for a new method of classification of objects of various nature, named “2”-soft classification, which allows for referring objects to one of two types with optimal entropy probability for available collection of learning data with consideration of additive errors therein. A decision rule of randomized parameters and probability density function (PDF) is formed, which is determined by the solution of the problem of the functional entropy linear programming. A procedure for “2”-soft classification is developed, consisting of the computer simulation of the randomized decision rule with optimal entropy PDF parameters. Examples are provided.
      PubDate: 2017-04-20
      DOI: 10.3390/e19040178
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 179: On the Definition of Diversity Order Based on
           Renyi Entropy for Frequency Selective Fading Channels

    • Authors: Seungyeob Chae, Minjoong Rim
      First page: 179
      Abstract: Outage probabilities are important measures of the performance of wireless communication systems, but to obtain outage probabilities it is necessary to first determine detailed system parameters, followed by complicated calculations. When there are multiple candidates of diversity techniques applicable for a system, the diversity order can be used to roughly but quickly compare the techniques for a wide range of operating environments. For a system transmitting over frequency selective fading channels, the diversity order can be defined as the number of multi-paths if multi-paths have all equal energy. However, diversity order may not be adequately defined when the energy values are different. In order to obtain a rough value of diversity order, one may use the number of multi-paths or the reciprocal value of the multi-path energy variance. Such definitions are not very useful for evaluating the performance of diversity techniques since the former is meaningful only when the target outage probability is extremely small, while the latter is reasonable when the target outage probability is very large. In this paper, we propose a new definition of diversity order for frequency selective fading channels. The proposed scheme is based on Renyi entropy, which is widely used in biology and many other fields. We provide various simulation results to show that the diversity order using the proposed definition is tightly correlated with the corresponding outage probability, and thus the proposed scheme can be used for quickly selecting the best diversity technique among multiple candidates.
      PubDate: 2017-04-20
      DOI: 10.3390/e19040179
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 180: Using Measured Values in Bell’s

    • Authors: Alejandro Hnilo
      First page: 180
      Abstract: The recent loophole-free experiments have confirmed the violation of Bell’s inequalities in nature. Yet, in order to insert measured values in Bell’s inequalities, it is unavoidable to make a hypothesis similar to “ergodicity at the hidden variables level”. This possibility opens a promising way out from the old controversy between quantum mechanics and local realism. Here, I review the reason why such a hypothesis (actually, it is one of a set of related hypotheses) in addition to local realism is necessary, and present a simple example, related to Bell’s inequalities, where the hypothesis is violated. This example shows that the violation of the additional hypothesis is necessary, but not sufficient, to violate Bell’s inequalities without violating local realism. The example also provides some clues that may reveal the violation of the additional hypothesis in an experiment.
      PubDate: 2017-04-22
      DOI: 10.3390/e19040180
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 181: Citizen Science and Topology of Mind:
           Complexity, Computation and Criticality in Data-Driven Exploration of Open
           Complex Systems

    • Authors: Masatoshi Funabashi
      First page: 181
      Abstract: Recently emerging data-driven citizen sciences need to harness an increasing amount of massive data with varying quality. This paper develops essential theoretical frameworks, example models, and a general definition of complexity measure, and examines its computational complexity for an interactive data-driven citizen science within the context of guided self-organization. We first define a conceptual model that incorporates the quality of observation in terms of accuracy and reproducibility, ranging between subjectivity, inter-subjectivity, and objectivity. Next, we examine the database’s algebraic and topological structure in relation to informational complexity measures, and evaluate its computational complexities with respect to an exhaustive optimization. Conjectures of criticality are obtained on the self-organizing processes of observation and dynamical model development. Example analysis is demonstrated with the use of biodiversity assessment database—the process that inevitably involves human subjectivity for management within open complex systems.
      PubDate: 2017-04-22
      DOI: 10.3390/e19040181
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 182: Carnot-Like Heat Engines Versus
           Low-Dissipation Models

    • Authors: Julian Gonzalez-Ayala, José Roco, Alejandro Medina, Antonio Calvo Hernández
      First page: 182
      Abstract: In this paper, a comparison between two well-known finite time heat engine models is presented: the Carnot-like heat engine based on specific heat transfer laws between the cyclic system and the external heat baths and the Low-Dissipation model where irreversibilities are taken into account by explicit entropy generation laws. We analyze the mathematical relation between the natural variables of both models and from this the resulting thermodynamic implications. Among them, particular emphasis has been placed on the physical consistency between the heat leak and time evolution on the one side, and between parabolic and loop-like behaviors of the parametric power-efficiency plots. A detailed analysis for different heat transfer laws in the Carnot-like model in terms of the maximum power efficiencies given by the Low-Dissipation model is also presented.
      PubDate: 2017-04-23
      DOI: 10.3390/e19040182
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 183: Low Complexity List Decoding for Polar Codes
           with Multiple CRC Codes

    • Authors: Jong-Hwan Kim, Sang-Hyo Kim, Ji-Woong Jang, Young-Sik Kim
      First page: 183
      Abstract: Polar codes are the first family of error correcting codes that provably achieve the capacity of symmetric binary-input discrete memoryless channels with low complexity. Since the development of polar codes, there have been many studies to improve their finite-length performance. As a result, polar codes are now adopted as a channel code for the control channel of 5G new radio of the 3rd generation partnership project. However, the decoder implementation is one of the big practical problems and low complexity decoding has been studied. This paper addresses a low complexity successive cancellation list decoding for polar codes utilizing multiple cyclic redundancy check (CRC) codes. While some research uses multiple CRC codes to reduce memory and time complexity, we consider the operational complexity of decoding, and reduce it by optimizing CRC positions in combination with a modified decoding operation. Resultingly, the proposed scheme obtains not only complexity reduction from early stopping of decoding, but also additional reduction from the reduced number of decoding paths.
      PubDate: 2017-04-24
      DOI: 10.3390/e19040183
      Issue No: Vol. 19, No. 4 (2017)
  • Entropy, Vol. 19, Pages 185: Slow Dynamics and Structure of Supercooled
           Water in Confinement

    • Authors: Gaia Camisasca, Margherita De Marzio, Mauro Rovere, Paola Gallo
      First page: 185
      Abstract: We review our simulation results on properties of supercooled confined water. We consider two situations: water confined in a hydrophilic pore that mimics an MCM-41 environment and water at interface with a protein. The behavior upon cooling of the α relaxation of water in both environments is well interpreted in terms of the Mode Coupling Theory of glassy dynamics. Moreover, we find a crossover from a fragile to a strong regime. We relate this crossover to the crossing of the Widom line emanating from the liquid-liquid critical point, and in confinement we connect this crossover also to a crossover of the two body excess entropy of water upon cooling. Hydration water exhibits a second, distinctly slower relaxation caused by its dynamical coupling with the protein. The crossover upon cooling of this long relaxation is related to the protein dynamics.
      PubDate: 2017-04-24
      DOI: 10.3390/e19040185
      Issue No: Vol. 19, No. 4 (2017)
School of Mathematical and Computer Sciences
Heriot-Watt University
Edinburgh, EH14 4AS, UK
Tel: +00 44 (0)131 4513762
Fax: +00 44 (0)131 4513327
Home (Search)
Subjects A-Z
Publishers A-Z
Your IP address:
About JournalTOCs
News (blog, publications)
JournalTOCs on Twitter   JournalTOCs on Facebook

JournalTOCs © 2009-2016