entropy-logo

Journal Browser

Journal Browser

Selected Papers from 5th International Electronic Conference on Entropy and Its Applications

A special issue of Entropy (ISSN 1099-4300). This special issue belongs to the section "Multidisciplinary Applications".

Deadline for manuscript submissions: closed (30 April 2020) | Viewed by 25344

Special Issue Editor


E-Mail Website
Guest Editor
Research Unit Nuclear Fusion, Department of Applied Physics, Ghent University, Sint-Pietersnieuwstraat 41, B-9000 Ghent, Belgium
Interests: probability theory; Bayesian inference; machine learning; information geometry; differential geometry; nuclear fusion; plasma physics; plasma turbulence; continuum mechanics; statistical mechanics
Special Issues, Collections and Topics in MDPI journals

Special Issue Information

Dear Colleagues,

The 5th International Electronic Conference on Entropy and Its Applications (ECEA-5) is organized by Entropy from November 18 to 30, 2019 and hosted on the MDPI Sciforum platform. A broad range of topics is discussed concerning theory and applications related to the interdisciplinary concept of Entropy.
All conference contributors, both to oral and poster sessions, are encouraged to submit a full paper related to their contribution to this Special Issue of Entropy, with 20% discount on the APC charges. The Special Issue will maintain the topical subdivision of the conference in the following six fields:

  • Thermodynamics and Statistical Physics
  • Information Theory, Probability, Statistics and Artificial Intelligence
  • Quantum Information and Quantum Computing
  • Complex Systems
  • Biological Systems
  • Astrophysics, Cosmology and Black Holes

For more information about the topics, please visit the conference website: https://sciforum.net/conference/ecea-5.
We are looking forward to receiving your manuscript.

Prof. Dr. Geert Verdoolaege
Guest Editor

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Entropy is an international peer-reviewed open access monthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Published Papers (6 papers)

Order results
Result details
Select all
Export citation of selected articles as:

Research

16 pages, 3213 KiB  
Article
Skyrmions and Spin Waves in Magneto–Ferroelectric Superlattices
by Ildus F. Sharafullin and Hung T. Diep
Entropy 2020, 22(8), 862; https://doi.org/10.3390/e22080862 - 04 Aug 2020
Cited by 3 | Viewed by 2894
Abstract
We present in this paper the effects of Dzyaloshinskii–Moriya (DM) magneto–electric coupling between ferroelectric and magnetic interface atomic layers in a superlattice formed by alternate magnetic and ferroelectric films. We consider two cases: magnetic and ferroelectric films have the simple cubic lattice and [...] Read more.
We present in this paper the effects of Dzyaloshinskii–Moriya (DM) magneto–electric coupling between ferroelectric and magnetic interface atomic layers in a superlattice formed by alternate magnetic and ferroelectric films. We consider two cases: magnetic and ferroelectric films have the simple cubic lattice and the triangular lattice. In the two cases, magnetic films have Heisenberg spins interacting with each other via an exchange J and a DM interaction with the ferroelectric interface. The electrical polarizations of ±1 are assumed for the ferroelectric films. We determine the ground-state (GS) spin configuration in the magnetic film and study the phase transition in each case. In the simple cubic lattice case, in zero field, the GS is periodically non collinear (helical structure) and in an applied field H perpendicular to the layers, it shows the existence of skyrmions at the interface. Using the Green’s function method we study the spin waves (SW) excited in a monolayer and also in a bilayer sandwiched between ferroelectric films, in zero field. We show that the DM interaction strongly affects the long-wave length SW mode. We calculate also the magnetization at low temperatures. We use next Monte Carlo simulations to calculate various physical quantities at finite temperatures such as the critical temperature, the layer magnetization and the layer polarization, as functions of the magneto–electric DM coupling and the applied magnetic field. Phase transition to the disordered phase is studied. In the case of the triangular lattice, we show the formation of skyrmions even in zero field and a skyrmion crystal in an applied field when the interface coupling between the ferroelectric film and the ferromagnetic film is rather strong. The skyrmion crystal is stable in a large region of the external magnetic field. The phase transition is studied. Full article
Show Figures

Figure 1

34 pages, 1431 KiB  
Article
Information Theory in Computational Biology: Where We Stand Today
by Pritam Chanda, Eduardo Costa, Jie Hu, Shravan Sukumar, John Van Hemert and Rasna Walia
Entropy 2020, 22(6), 627; https://doi.org/10.3390/e22060627 - 06 Jun 2020
Cited by 24 | Viewed by 9137
Abstract
“A Mathematical Theory of Communication” was published in 1948 by Claude Shannon to address the problems in the field of data compression and communication over (noisy) communication channels. Since then, the concepts and ideas developed in Shannon’s work have formed the basis of [...] Read more.
“A Mathematical Theory of Communication” was published in 1948 by Claude Shannon to address the problems in the field of data compression and communication over (noisy) communication channels. Since then, the concepts and ideas developed in Shannon’s work have formed the basis of information theory, a cornerstone of statistical learning and inference, and has been playing a key role in disciplines such as physics and thermodynamics, probability and statistics, computational sciences and biological sciences. In this article we review the basic information theory based concepts and describe their key applications in multiple major areas of research in computational biology—gene expression and transcriptomics, alignment-free sequence comparison, sequencing and error correction, genome-wide disease-gene association mapping, metabolic networks and metabolomics, and protein sequence, structure and interaction analysis. Full article
Show Figures

Figure 1

23 pages, 2083 KiB  
Article
Renormalization Analysis of Topic Models
by Sergei Koltcov and Vera Ignatenko
Entropy 2020, 22(5), 556; https://doi.org/10.3390/e22050556 - 16 May 2020
Cited by 6 | Viewed by 2585
Abstract
In practice, to build a machine learning model of big data, one needs to tune model parameters. The process of parameter tuning involves extremely time-consuming and computationally expensive grid search. However, the theory of statistical physics provides techniques allowing us to optimize this [...] Read more.
In practice, to build a machine learning model of big data, one needs to tune model parameters. The process of parameter tuning involves extremely time-consuming and computationally expensive grid search. However, the theory of statistical physics provides techniques allowing us to optimize this process. The paper shows that a function of the output of topic modeling demonstrates self-similar behavior under variation of the number of clusters. Such behavior allows using a renormalization technique. A combination of renormalization procedure with the Renyi entropy approach allows for quick searching of the optimal number of topics. In this paper, the renormalization procedure is developed for the probabilistic Latent Semantic Analysis (pLSA), and the Latent Dirichlet Allocation model with variational Expectation–Maximization algorithm (VLDA) and the Latent Dirichlet Allocation model with granulated Gibbs sampling procedure (GLDA). The experiments were conducted on two test datasets with a known number of topics in two different languages and on one unlabeled test dataset with an unknown number of topics. The paper shows that the renormalization procedure allows for finding an approximation of the optimal number of topics at least 30 times faster than the grid search without significant loss of quality. Full article
Show Figures

Figure 1

17 pages, 4256 KiB  
Article
A Novel Counterfeit Feature Extraction Technique for Exposing Face-Swap Images Based on Deep Learning and Error Level Analysis
by Weiguo Zhang, Chenggang Zhao and Yuxing Li
Entropy 2020, 22(2), 249; https://doi.org/10.3390/e22020249 - 21 Feb 2020
Cited by 30 | Viewed by 5292
Abstract
The quality and efficiency of generating face-swap images have been markedly strengthened by deep learning. For instance, the face-swap manipulations by DeepFake are so real that it is tricky to distinguish authenticity through automatic or manual detection. To augment the efficiency of distinguishing [...] Read more.
The quality and efficiency of generating face-swap images have been markedly strengthened by deep learning. For instance, the face-swap manipulations by DeepFake are so real that it is tricky to distinguish authenticity through automatic or manual detection. To augment the efficiency of distinguishing face-swap images generated by DeepFake from real facial ones, a novel counterfeit feature extraction technique was developed based on deep learning and error level analysis (ELA). It is related to entropy and information theory such as cross-entropy loss function in the final softmax layer. The DeepFake algorithm is only able to generate limited resolutions. Therefore, this algorithm results in two different image compression ratios between the fake face area as the foreground and the original area as the background, which would leave distinctive counterfeit traces. Through the ELA method, we can detect whether there are different image compression ratios. Convolution neural network (CNN), one of the representative technologies of deep learning, can extract the counterfeit feature and detect whether images are fake. Experiments show that the training efficiency of the CNN model can be significantly improved by the ELA method. In addition, the proposed technique can accurately extract the counterfeit feature, and therefore achieves outperformance in simplicity and efficiency compared with direct detection methods. Specifically, without loss of accuracy, the amount of computation can be significantly reduced (where the required floating-point computing power is reduced by more than 90%). Full article
Show Figures

Figure 1

12 pages, 3955 KiB  
Article
Quantifying Total Influence between Variables with Information Theoretic and Machine Learning Techniques
by Andrea Murari, Riccardo Rossi, Michele Lungaroni, Pasquale Gaudio and Michela Gelfusa
Entropy 2020, 22(2), 141; https://doi.org/10.3390/e22020141 - 24 Jan 2020
Cited by 3 | Viewed by 2080
Abstract
The increasingly sophisticated investigations of complex systems require more robust estimates of the correlations between the measured quantities. The traditional Pearson correlation coefficient is easy to calculate but sensitive only to linear correlations. The total influence between quantities is, therefore, often expressed in [...] Read more.
The increasingly sophisticated investigations of complex systems require more robust estimates of the correlations between the measured quantities. The traditional Pearson correlation coefficient is easy to calculate but sensitive only to linear correlations. The total influence between quantities is, therefore, often expressed in terms of the mutual information, which also takes into account the nonlinear effects but is not normalized. To compare data from different experiments, the information quality ratio is, therefore, in many cases, of easier interpretation. On the other hand, both mutual information and information quality ratio are always positive and, therefore, cannot provide information about the sign of the influence between quantities. Moreover, they require an accurate determination of the probability distribution functions of the variables involved. As the quality and amount of data available are not always sufficient to grant an accurate estimation of the probability distribution functions, it has been investigated whether neural computational tools can help and complement the aforementioned indicators. Specific encoders and autoencoders have been developed for the task of determining the total correlation between quantities related by a functional dependence, including information about the sign of their mutual influence. Both their accuracy and computational efficiencies have been addressed in detail, with extensive numerical tests using synthetic data. A careful analysis of the robustness against noise has also been performed. The neural computational tools typically outperform the traditional indicators in practically every respect. Full article
Show Figures

Figure 1

17 pages, 9175 KiB  
Article
A Novel Improved Feature Extraction Technique for Ship-Radiated Noise Based on IITD and MDE
by Zhaoxi Li, Yaan Li, Kai Zhang and Jianli Guo
Entropy 2019, 21(12), 1215; https://doi.org/10.3390/e21121215 - 12 Dec 2019
Cited by 22 | Viewed by 2536
Abstract
Ship-radiated noise signal has a lot of nonlinear, non-Gaussian, and nonstationary information characteristics, which can reflect the important signs of ship performance. This paper proposes a novel feature extraction technique for ship-radiated noise based on improved intrinsic time-scale decomposition (IITD) and multiscale dispersion [...] Read more.
Ship-radiated noise signal has a lot of nonlinear, non-Gaussian, and nonstationary information characteristics, which can reflect the important signs of ship performance. This paper proposes a novel feature extraction technique for ship-radiated noise based on improved intrinsic time-scale decomposition (IITD) and multiscale dispersion entropy (MDE). The proposed feature extraction technique is named IITD-MDE. First, IITD is applied to decompose the ship-radiated noise signal into a series of intrinsic scale components (ISCs). Then, we select the ISC with the main information through the correlation analysis, and calculate the MDE value as feature vectors. Finally, the feature vectors are input into the support vector machine (SVM) for ship classification. The experimental results indicate that the recognition rate of the proposed technique reaches 86% accuracy. Therefore, compared with the other feature extraction methods, the proposed method provides a new solution for classifying different types of ships effectively. Full article
Show Figures

Figure 1

Back to TopTop