Next Article in Journal
Mining Educational Data to Predict Students’ Performance through Procrastination Behavior
Previous Article in Journal
Electricity Load and Price Forecasting Using Jaya-Long Short Term Memory (JLSTM) in Smart Grids

Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

# Entropy, Information, and Symmetry: Ordered is Symmetrical

by
Edward Bormashenko
Department of Chemical Engineering, Ariel University, Ariel 407000, Israel
Entropy 2020, 22(1), 11; https://doi.org/10.3390/e22010011
Submission received: 22 November 2019 / Revised: 15 December 2019 / Accepted: 18 December 2019 / Published: 19 December 2019

## Abstract

:
Entropy is usually understood as the quantitative measure of “chaos” or “disorder”. However, the notions of “chaos” and “disorder” are definitely obscure. This leads to numerous misinterpretations of entropy. We propose to see the disorder as an absence of symmetry and to identify “ordering” with symmetrizing of a physical system; in other words, introducing the elements of symmetry into an initially disordered physical system. We demonstrate with the binary system of elementary magnets that introducing elements of symmetry necessarily diminishes its entropy. This is true for one-dimensional (1D) and two-dimensional (2D) systems of elementary magnets. Imposing symmetry does not influence the Landauer principle valid for the addressed systems. Imposing the symmetry restrictions onto the system built of particles contained within the chamber divided by the permeable partition also diminishes its entropy.

## 1. Introduction

The notion of entropy, introduced by Rudolf Clausius [1,2], is considered to be one of the most important, but also the most abstract and least visualizable, quantities of physics [3,4]. Clausius (1867) coined the term entropy from the Greek word $τ ρ ο π η$ for transformation and change [5]. The classical thermodynamics macroscopic definition of the entropy change within a reversible process is $Δ S = Δ Q r e v T$, where $Δ Q r e v$ is the heat flow which takes place under the reversible process, and T is the temperature [5]. The statistical definition of the entropy is:
$S = k B ln Ω ,$
where Ω is the multiplicity of a certain state (i.e., the number of different configurations that a system defined by macroscopic variables could assume, or in other words, the number of states accessible to the system) [6,7,8,9]. The widespread illustrative interpretation of entropy is “the measure of disorder” in macroscopic systems built from a large number of particles [9]. However equating entropy with disorder was criticized recently [4,10,11]. Indeed, the multiplicity has a well-defined statistical meaning; whereas, “disorder” is an obscure notion, deeply rooted in human psychology, namely in the human perception of ordered and disordered patterns [12,13,14]. We propose the hypotheses that “ordering” may be strictly related to, and quantified by, symmetry. In turn, “chaos” or disorder is an absence of symmetry. It seems that the idea of symmetry as an adequate characteristic of ordering for various patterns was suggested by Yodogawa [15] and elaborated further by Zabrodsky, Avnir, and Peleg [16] as well as Petitjean [17]. We demonstrate that introducing symmetry into physical systems necessarily “orders” them and decreases their entropy. Symmetry considerations play a key role in modern science [18,19,20], giving rise to the conservation laws in physics, and serves as a dominant factor in quantum theory [21], crystallography [22,23], and condensed-matter physics. We show that it is crucial for constituting thermodynamics and informational properties of physical systems.

## 2. Symmetry and Entropy of Binary Systems

First consider the binary one-dimensional (1D) system illustrated in Figure 1A. We assume that there are N separate and distinct sites fixed in a space and aligned as shown in Figure 1A [8]. Attached to each site is an elementary magnet, which can point only up or down. Thus, a binary, non-interacting system is created. The total number of arrangements of the N magnets is $Ω = 2 N$ if no external restrictions are imposed on the system and all the states are equally accessible to the system (only two possible states are available for the magnets). Thus, the entropy of the system is given by:
$S = k B N ln 2$
If the addressed binary system is in the thermal equilibrium with a thermal reservoir T and the external magnetic field equals zero ($H → = 0$), then the modulus of the term of Helmholtz free energy $| F S |$ arising from entropy contributions is supplied by:
$| F S | = k B T N ln 2$
thus, illustrating the Landauer principle [24,25,26]. Indeed, if erasing one bit of information is performed under re-orientation of the single elementary magnet, the energy cost of such an erasure equals $k B T ln 2$ in a strict accordance with the Landauer principle [24,25,26].
Now let us restrict the possible configurations of elementary magnets by introducing the symmetry axis, shown with the dashed line in Figure 1B. After introducing the symmetry axis, only symmetric configurations of the elementary magnets are available, as depicted in Figure 1B. The total number of arrangements of N magnets is $Ω = 2 N 2$. Hence, the entropy of the symmetrized, ordered, binary, non-interacting system is given by:
$S = k B N 2 ln 2$
It is seen that introducing symmetry orders the binary system, and consequently decreases entropy. It seems plausible to equate “ordering” with symmetrizing of the system. If this identifying is accepted, the entropy is indeed the measure of disorder, in other words, an absence of symmetry. Obviously, the axis of symmetry may be replaced by the center of symmetry [18].
The modulus of the entropy-related term of the Helmholtz free energy denoted $| F S | ,$ for the symmetrized system shown in Figure 1B equals $| F S | = k B T N 2 ln 2$. Thus, the Landauer principle remains untouched. Indeed, in this case erasing one bit of information is performed under simultaneous re-orientation of two symmetric elementary magnets, and the energy cost of such an erasure again equals $k B T ln 2$ in accordance with the Landauer principle [24,25,26].
Consider now the two-dimensional (2D) system of elementary magnets depicted in Figure 1C. Generalization of the aforementioned approach for 2D systems is straightforward. If the system is not symmetrized (ordered) and the arrangement of elementary magnets is equally available, the entropy of the system is still given by $S = k B N ln 2$. If the system is symmetrized and possesses two axes of symmetry, as shown in Figure 1C, its entropy is $S = k B N 4 ln 2$. Additional elements of symmetry in this 2D case (i.e., the axes or centers of symmetry) result in a larger decrease in the entropy of the system. This supports the idea that ordering (understood as symmetrizing) necessarily decreases the entropy.
Consider one more example shown in Figure 2. Four molecules of two different kinds (i.e., blue and red ones) are located within a chamber divided equally by the permeable partition. The particles of the same kind are considered as indistinguishable. Consider the states, within which two molecules may be located simultaneously on one side of the partition. These states may be realized by three various arrangements (recall, that particles of the same sort are identical and indistinguishable). Hence, the entropy of such a system is $S = k B ln 3$. Now let us introduce “ordering” into our system. Impose the demand that the particles should be necessarily located symmetrically relative to the axis $O O ′$ passing over the partition as depicted in Figure 2. Introducing symmetry diminishes the multiplicity to $Ω = 1$. Consequently, the entropy of the symmetrized system of particles equals zero. The generalization of the suggested approach to the system of 2N particles is straightforward.
It is noteworthy, that the notion of the Voronoi entropy fails to quantify the ordering of points constituting the 2D pattern [27,28,29]. It was demonstrated that the symmetric patterns may be characterized by the values of the Voronoi entropy being very close to those inherent to random ones [30].

## 3. Conclusions

Misinterpretations of entropy are ubiquitous among scientists and non-scientists [4,11]. The widespread interpretation of entropy is “the measure of disorder” [4,11]. However, this understanding of entropy was criticized recently and equating entropy to “disorder” or “chaos” was considered a misconception [4,11]. Indeed, “disorder” and “chaos” are obscure notions, actually rooted in human psychology [12,13,14], that can hardly be accurately defined. We demonstrate how this misconception may be avoided. The misunderstanding is eliminated if “ordering” is identified with symmetrizing the system. Thus, “chaos” or “disorder” is understood as an absence of symmetry. We demonstrate that introducing elements of symmetry orders the system and consequently diminishes its entropy. The idea is illustrated through a binary system built from elementary magnets where 1D and 2D exemplifications of the binary systems are presented. We also demonstrate that introducing symmetry does not influence the Landauer principle for binary systems. We also considered the system built of particles contained within the chamber divided by the permeable partition. Again, imposing symmetry restrictions diminished the entropy of the system. To be rigorous, the author concludes that it is possible that other pathways of ordering physical systems, apart from imposing elements of symmetry, exist; these alternative pathways call for additional physical insights.

## Funding

This research received no external funding.

## Acknowledgments

The author is thankful to Yelena Bormashenko and Irina Legchenkova for their kind help in preparing this paper. The author is indebted to the anonymous reviewers for their fruitful, instructive criticism.

## Conflicts of Interest

The author declares no conflict of interest.

## References

1. Clausius, R. On the Application of the Mechanical theory of Heat to the Steam-Engine. In The Mechanical Theory of Heat—with Its Applications to the Steam Engine and to Physical Properties of Bodies; John van Voorst: London, UK, 1856; 1 Paternoster Row, MDCCCLXVII; pp. 136–207. [Google Scholar]
2. Müller, I. A History of Thermodynamics; The Doctrine of Energy and Entropy; Springer: Berlin, Germany, 2007. [Google Scholar]
3. Falk, G. Entropy, a resurrection of caloric-a look at the history of thermodynamics. Eur. J. Phys. 1985, 6, 108–115. [Google Scholar] [CrossRef] [Green Version]
4. Martin, J.S.; Smith, N.A.; Francis, C.D. Removing the entropy from the definition of entropy: Clarifying the relationship between evolution, entropy, and the second law of thermodynamics. Evol. Educ. Outreach 2013, 6, 30. [Google Scholar] [CrossRef]
5. Clausius, R. On Several Convenient Forms of the Fundamental Equations of the Mechanical Theory of Heat. In The Mechanical Theory of Heat with Its Applications to the Steam-Engine and to the Physical Properties of Bodies; Tyndall, J., Translator; John Van Voorst: London, UK, 1867; pp. 327–365. [Google Scholar]
6. Gaudenzi, R. Entropy? Exercices de Style. Entropy 2019, 21, 742. [Google Scholar] [CrossRef] [Green Version]
7. Baierlein, R. Thermal Physics; Cambridge University Press: Cambridge, UK, 1999. [Google Scholar]
8. Landau, L.D.; Lifshitz, E.M. Statistical Physics, 3rd ed.; Elsevier: Oxford, UK, 2011; Course of Theoretical Physics; Volume 5. [Google Scholar]
9. Kittel, C. Thermal Physics; J. Wiley & Sons: New York, NY, USA, 1969. [Google Scholar]
10. Wright, P.G. Entropy and disorder. Contemp. Phys. 1970, 11, 581–588. [Google Scholar] [CrossRef]
11. Styer, D. Entropy as disorder: History of misconception. Phys. Teach. 2019, 57, 454–458. [Google Scholar] [CrossRef] [Green Version]
12. Darrigol, O. Number and measure: Hermann von Helmholtz at the crossroads of mathematics, physics, and psychology. Stud. Hist. Philos. Sci. A 2003, 34, 515–573. [Google Scholar] [CrossRef]
13. Myszkowski, N.; Storme, M.; Zenasni, F. Order in complexity: How Hans Eysenck brought differential psychology and aesthetics together. Personal. Individ. Differ. 2016, 103, 156–162. [Google Scholar] [CrossRef]
14. Shaki, S.; Fischer, M.H.; Petrusic, W.M. Reading habits for both words and numbers contribute to the SNARC effect. Psychon. Bull. Rev. 2009, 16, 328–331. [Google Scholar] [CrossRef] [PubMed] [Green Version]
15. Yodogawa, E. Symmetropy, an entropy-like measure of visual symmetry. Percept. Psychophys. 1982, 32, 230–240. [Google Scholar] [CrossRef] [PubMed] [Green Version]
16. Zabrodsky, H.; Avnir, D.; Peleg, S. Symmetry as a continuous feature. IEEE Trans. Pattern Anal. Mach. Intell. 1995, 17, 1154–1166. [Google Scholar] [CrossRef] [Green Version]
17. Petitjean, M. Chirality and symmetry measures: A transdisciplinary review. Entropy 2003, 5, 271–312. [Google Scholar] [CrossRef]
18. Weyl, H. Symmetry; Princeton University Press: Princeton, NJ, USA, 1989. [Google Scholar]
19. Van Fraassen, B.C. Laws and Symmetry; Oxford University Press: Oxford, UK, 1989. [Google Scholar]
20. Rosen, J. Symmetry in Science: An Introduction to the General Theory; Springer: Berlin, Germany, 1995. [Google Scholar]
21. Hall, B.C. Quantum Theory for Mathematicians; Graduate Texts in Mathematics; Springer: Berlin, Germany, 2013. [Google Scholar]
22. Chatterjee, S.K. Crystallography and the World of Symmetry; Springer: Berlin, Germany, 2008. [Google Scholar]
23. El-Batanouny, M.; Wooten, F. Symmetry and Condensed Matter Physics—A Computational Approach; Cambridge University Press: Cambridge, UK, 2010. [Google Scholar]
24. Landauer, R. Dissipation and heat generation in the computing process. IBM J. Res. Dev. 1961, 5, 183. [Google Scholar] [CrossRef]
25. Landauer, R. Information is physical. Phys. Today 1991, 44, 23–29. [Google Scholar] [CrossRef]
26. Landauer, R. Minimal energy requirements in communication. Science 1996, 272, 1914–1918. [Google Scholar] [CrossRef] [PubMed]
27. Barthélemy, M. Spatial networks. Phys. Rep. 2011, 499, 1–101. [Google Scholar] [CrossRef] [Green Version]
28. Bormashenko, E.; Frenkel, M.; Vilk, A.; Legchenkova, I.; Fedorets, A.; Aktaev, N.; Dombrovsky, L.; Nosonovsky, M. Characterization of self-assembled 2D patterns with Voronoi Entropy. Entropy 2018, 20, 956. [Google Scholar] [CrossRef] [Green Version]
29. Fedorets, A.A.; Frenkel, M.; Bormashenko, E.; Nosonovsky, M. Small levitating ordered droplet clusters: Stability, symmetry, and Voronoi Entropy. J. Phys. Chem. Lett. 2017, 8, 5599–5602. [Google Scholar] [CrossRef] [PubMed]
30. Bormashenko, E.; Legchenkova, I.; Frenkel, M. Symmetry and Shannon Measure of ordering: Paradoxes of Voronoi tessellation. Entropy 2019, 21, 452. [Google Scholar] [CrossRef] [Green Version]
Figure 1. (A) The binary one-dimensional (1D) system of N non-interacting elementary magnets (the external magnetic field equals zero ($H → = 0$). All of the up/down arrangements of the magnets are available. (B) The axis of symmetry shown with the dashed line restricts the number of available configurations of magnets. (C) Two-dimensional (2D) binary system of elementary magnets. Axes of symmetry shown with dashed lines restrict the available arrangements of the magnets.
Figure 1. (A) The binary one-dimensional (1D) system of N non-interacting elementary magnets (the external magnetic field equals zero ($H → = 0$). All of the up/down arrangements of the magnets are available. (B) The axis of symmetry shown with the dashed line restricts the number of available configurations of magnets. (C) Two-dimensional (2D) binary system of elementary magnets. Axes of symmetry shown with dashed lines restrict the available arrangements of the magnets.
Figure 2. (A) Particles of two kinds (blue and red) are located within the chamber divided equally by the permeable partition. The arrangements at which two particles are simultaneously located at one side of the partition are permitted. (B) Particles of two kinds (blue and red) are located within the chamber divided equally by the permeable partition. Only the arrangements symmetric relatively to axis $O O ′$ shown with the red dashed line are permitted.
Figure 2. (A) Particles of two kinds (blue and red) are located within the chamber divided equally by the permeable partition. The arrangements at which two particles are simultaneously located at one side of the partition are permitted. (B) Particles of two kinds (blue and red) are located within the chamber divided equally by the permeable partition. Only the arrangements symmetric relatively to axis $O O ′$ shown with the red dashed line are permitted.

## Share and Cite

MDPI and ACS Style

Bormashenko, E. Entropy, Information, and Symmetry: Ordered is Symmetrical. Entropy 2020, 22, 11. https://doi.org/10.3390/e22010011

AMA Style

Bormashenko E. Entropy, Information, and Symmetry: Ordered is Symmetrical. Entropy. 2020; 22(1):11. https://doi.org/10.3390/e22010011

Chicago/Turabian Style

Bormashenko, Edward. 2020. "Entropy, Information, and Symmetry: Ordered is Symmetrical" Entropy 22, no. 1: 11. https://doi.org/10.3390/e22010011

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.