Next Article in Journal
A UAV-Based Thermal-Imaging Approach for the Monitoring of Urban Landfills
Next Article in Special Issue
Classification of Tree Species in the Process of Timber-Harvesting Operations Using Machine-Learning Methods
Previous Article in Journal
Tidal Supplementary Control Schemes-Based Load Frequency Regulation of a Fully Sustainable Marine Microgrid
Previous Article in Special Issue
Heat Pump Dryer Design Optimization Algorithm
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Entropy Model for Sustainability Assessment in Industrial Ecosystems

by
Tatyana Tolstykh
1,
Nadezhda Shmeleva
2,
Yulia Vertakova
3,4 and
Vladimir Plotnikov
5,*
1
Industrial Management Department, National University of Science & Technology (MISIS), 119049 Moscow, Russia
2
Economics Department, National University of Science & Technology (MISIS), 119049 Moscow, Russia
3
Financial University under the Government of the Russian Federation, Kursk Branch, 305016 Kursk, Russia
4
Regional Economy and Management Department, Southwest State University, 305004 Kursk, Russia
5
General Economic Theory and History of Economic Thought Department, St. Petersburg State University of Economics, 191023 St. Petersburg, Russia
*
Author to whom correspondence should be addressed.
Inventions 2020, 5(4), 54; https://doi.org/10.3390/inventions5040054
Submission received: 11 October 2020 / Revised: 3 November 2020 / Accepted: 5 November 2020 / Published: 7 November 2020
(This article belongs to the Special Issue Computational Intelligence in Agriculture and Natural Resources)

Abstract

:
The aim of this paper is to address the gap in the academic literature towards the development of methodological approaches to the industrial ecosystem sustainability assessment. This study was focused on the industrial ecosystems formed based on an entropy model and implementing the principles of complex systems. This article systematizes the problem of applying the ecosystem approach to cross-industry interaction. A contribution to the literature was achieved by providing a systemic perspective on the sustainable industrial process. In this paper, we develop the methodological foundations to improve the understanding of integration processes’ influence on the industrial ecosystem potential. For a relevant analysis of industrial ecosystem potential, the existing patterns of system functioning were taken into account, including entropy equilibrium and the Harrington model. We illustrate our assumptions with an empirical case study of the National University of Science and Technology (NUST) “MISIS” ecosystem—“Green technologies for resource conservation” (Russia), with an assessment of ecosystem sustainability through the actors’ collaboration level. The propositions arising from this analysis provide information to help academics, policymakers, government, and individual enterprises with a more adequate understanding of the practical mechanisms and tools that help trigger the self-organization and sustainability of the industrial ecosystems.

1. Introduction

Technological, digital, environmental, and political trends swiftly and universally have covered all social and economic processes. Emerging fundamental challenges change approaches to the development of socio-economic systems towards:
(1)
Changing the paradigm from “human for economics” to “economics for human”.
(2)
Transformation of the environment through the triad of nature, technology, and culture.
(3)
Transformation of the new world order as a result of the humanitarian and technological revolution [1,2,3].
Market participants are forced not only to respond to challenges, but also to predict them. This requires a search for new behavioral models and new approaches to strategizing. This situation is especially relevant for industrial enterprises, which have a significant inertial log within their industry specifics. A fundamentally different type of resources is coming to the forefront intellectual, changing the ratio of competitive advantages in the market. It is practically impossible for enterprises not only to maintain competitive leadership, but also simply to survive in the present realities alone, which entails the need to change the models of interaction between organizations [4,5,6].
The search for organizational and managerial models that provide innovative sustainable development through synergistic symbiosis has been going on for several decades. These models include clusters, industrial networks, and industrial and eco-industrial parks. Each of these models has its own advantages and limitations. The main limiting point of network and cluster models is that horizontal synergistic interaction between participants is subject to vertical management from above. The management system can be either a state structure or a large enterprise, building network relations with other enterprises for their interests. Elements of the management vertical initially violate the principles of harmonization and balanced development of individual participants, since the interests and priorities of the governing body do not always coincide with the interests of other participants. In Antifragility: Things That Gain from Disorder, Nassim Nicholas Taleb [7] defined large vertical systems as “fragile” in terms of the risks of making managerial decisions. In contrast to such systems, the combination of companies on partnership terms without vertical administration is “anti-fragile” with respect to internal and external challenges.
One of the most relevant discussed organizational and economic models of socio-economic development are ecosystem models [8,9,10,11,12,13,14,15,16]. The ecosystem model allows for forming a special friendly environment for enterprises through a voluntary partnership for the generation and implementation of innovative projects in various fields. It allows the ecosystem participants to be open to external challenges through the integration of resources, knowledge, information, technologies, competencies, ensuring the principles of their sustainable development.
The authors consider that an ecosystem is the association of independent actors based on the principles of self-organization and self-development to achieve their internal goals, which correspond to the requirements and needs of the society. The actors are united in ecosystems according to their functional target interests, forming numerous sectoral, entrepreneurial, innovative, business, and other ecosystems [17,18,19]. This approach allows for developing the open innovation perspective through the principles of the ecosystem, when all participating companies, regardless of their size and type of activity, benefit from networking and collaboration.
Despite the increased interest of the scientific community in the problem of the formation and development of industrial ecosystems, one should admit the weak methodological elaboration of this theory, which complicates its application in practice.
This article aims to develop methodological approaches to assessing industrial ecosystems sustainability, taking into consideration the new paradigm of socio-economic development. The subject of the research is innovative industrial ecosystems. The article systematizes the problem of applying the ecosystem approach to cross-sectoral interaction. The main research question was how to operationalize the processes of self-organization in the industrial ecosystem without an external governing body and to ensure ecosystem sustainability.
The article is organized as follows. Section 2 provides a theoretical overview of the industrial ecosystem, related concepts, and approaches. In this section, we analyze the sustainability perspective of ecosystems with specific reference to the emerging perspectives on what the role and objective of sustainability assessment should be. Section 3 is devoted to the theoretical foundations of our research, introducing our conceptual assumptions and chosen approaches. Section 4 presents a new methodology for the assessment of industrial ecosystem sustainability using the theory of conflictology, entropy, and Harrington models. Section 5 further specifies how to operationalize the assessment using the described methodology. We demonstrate our methodology by the example of an empirical case study of the National University of Science and Technology (NUST) “MISIS” ecosystem. Section 6 highlights the key findings of the study and presents the theoretical contribution and practical significance of the study. In this section, we also discuss propositions arising from the conducted analysis to bring out the features of the sustainability of industrial ecosystems and their implications in terms of actor’s collaboration. Finally, in Section 7, some limitations of the research and points for further discussion are proposed, specifically regarding our concerns on the possibility of performing a more accurate sustainability assessment for different types of ecosystems.

2. Literature Review

One of the most discussed models of enterprises’ innovative development is the formation of industrial ecosystems [8,20]. Over the past decade, the concept of the ecosystem has become so popular in the discussion that we agree with the author [20], who believe this is the reason for unclear and incorrect formulations. From our point of view, sometimes there is a substitution of terms: the ecosystem is understood as a network innovation cluster or looks like a trinity of major players: University–business–state [21]. According to Bruns [22], the term “ecosystem” describes the effects of symbiosis in production, associations of firms (business ecosystems, entrepreneurial ecosystems), or other activities (services, innovations, and digital ecosystems). As a result of ambiguity in terminology, the scientific literature uses “business ecosystems” [23], “innovation ecosystems” [24], “digital ecosystems” [25], “University ecosystems” [26], or “financial ecosystems” [27]. In [28], an ecosystem is a system consisting of actors and dynamic processes in which they participate.
We believe the most comprehensive definition of the innovation industrial ecosystem is that proposed by Granstrand and Holgersson (2020). According to the authors, such an ecosystem is an evolving set of actors, activities, and artifacts, and the institutions and relations, including complementary and substitute relations, that are important for the innovative performance of an actor or a population of actors [29]. The researchers identify two conceptual approaches to the ecosystems [30]. According to the second approach, an ecosystem is a system of interconnected technologies, cooperating and competing firms offering related goods and services [31,32]. In parallel, the theory of industrial ecosystems is actively evolving. Kleiner defines industrial ecosystems as localized socioeconomic formations achieving sustainable development through the circulation of resources in objective, environmental, process, and project subsystems [33]. In [30], the industrial ecosystem is defined as a set of components made by the product platform’s owner and enhancements made by independent companies from the periphery. In turn, the ecosystem platform is defined as a network of innovations, increasing the platform’s value [34,35]. Several terms related to the industrial ecosystems that have appeared in the literature, stressing their interdisciplinary nature, including the industrial symbiosis, (eco-) industrial parks, and (eco-) industrial networks. We further specify these notions.
We agree with the position of the authors who believe that ecosystems are not a simple integration of individual participants, but the formation of an intellectual environment between actors [12,13]. In this case, the goal of collaboration ecosystem actors can be digital platforms, new technologies, materials, innovative projects, or specific research organizations that integrate actors around themselves through joint relationships based on the exchange of knowledge, competencies, and information [20,30,36]. An ecosystem is, first of all, a voluntary association of a certain number of actors to implement projects, the digital transformation of business processes, and the development of new materials or technologies [20,29].
The industrial enterprises are often integrated into the processes of initiation and implementation of various projects, which, from our point of view, can be considered as the initial stage of ecosystem formation.
We propose to use the concept of entropy as a measure of ordering and evaluation of the degree of interaction. The entropy of a system is a way of the mutual arrangement of system elements in an equilibrium state [37]. An ecosystem involves a constant and intensive exchange of energy between actors (information, knowledge, technologies, and competencies), which defines an ecosystem as “open” or “dissipative”. One of the defining principles of ecosystem formation is self-organization. In the theory of synergetics [38], self-organization is understood as the emergence of stable States of organization and manageability without external influence. Creating conditions for self-organization may by controlling the order of the system, adding useful energy to it, which leads to an increase in negative entropy (negoentropy) [38]. As a result, reducing the entropy of the system. The greater the entropy of systems, the less is it ordered. In complex systems, the information component of the process, rather than the material one, comes to the fore, considering not only the qualities of actors, but also the connections between them, as discussed in [7]. The self-organization of complex systems based on the entropy approach was studied by Kleyner [35], Haken [37], and Prangishvili [39]. However, the entropy approach is used in the analysis of physical, social, or information systems. There are few works devoted to the use of the entropy approach for evaluating large industrial complexes or symbioses, which makes the research relevant.

3. Conceptual Framework

The cooperation of ecosystem actors is based on network partnership principles and cognition as a principal mechanism for achieving strategic goals by the actors [40,41]. The ecosystem operates at a basis of “energy” exchange between business, industry, scientific community, and government. By “energy” we mean information, knowledge, technologies, or key resources. Ecosystem self-organization occurs as a response to digital challenges, ecological and industrial trends in the forms of new innovation projects, products, digital platforms, and technologies. The ecosystem model is the evolution of cluster, network, and infrastructure communication models (Table 1). It brings together best cooperation practices with ecosystem-specific features crucial in terms of new technological challenges [17,18,19].
Self-organization, lack of managerial institutions, and intellectual environment are the basic differences between the industrial ecosystem and clusters or networks. However, self-organization does not suppose chaotic and spontaneous integration. “Pacemaker” is the center of the ecosystem that coordinates and balances the actions of all other actors. An actor, technology, project, or platform may act as a “pacemaker”. Actors of the industrial ecosystem include industrial companies, techno-parks, start-ups, venture funds, engineering companies, government institutions, funds, financial structures, and other actors whose interests overlap with the strategic goals of the ecosystem, which are defined by the pacemaker. In terms of the new industrial revolution, we may highlight the following principles for industrial ecosystems establishment:
  • transboundary ecosystem processes;
  • self-organization, self-regulation, and self-development;
  • joint development and use of information, innovation, and intellectual resources;
  • continuous flow of successive projects (one project initiates the following projects’ implementation);
  • agility and flexibility to external challenges;
  • project- and client-orientation;
  • diversity of actors and network organization design;
  • collaboration based on partnership, trust, cooperation, and mutual help;
  • balance between goals and objectives of actors;
  • knowledge circulation;
  • resources conservation priority;
  • maintaining and development of each actor’s potential.
Each actor, being included in the ecosystem, is overgrown with connections with other actors. Therefore, the number and strength of connections are the basis for ecosystem sustainability. The behavior of the ecosystem depends on the behavior of many subsystems (actors), including relationships between them [36].
We consider that an industrial ecosystem is an open and self-developing system of actors network equality, self-organizing as a result of the collaboration between actors and the exchange of energy. The energy in an ecosystem is new knowledge, technology, information, or unique resources.
Industrial enterprises, ecosystems, engineering enterprises, startups, venture companies, and funds can work as actors of the industrial ecosystem [42]. At the same time, the actor can play different roles, participating in projects, for example, a customer, a provider of unique resources, a stakeholder, a developer, etc. The keyword in defining an ecosystem is self-organization, which occurs as a result of the emerging needs of market participants, shaped by digital and industrial challenges, and is implemented in the form of innovative projects, creating a new product, developing digital platforms, creating new technology, etc.
Universities that accumulate and create national and worldwide expertise and cooperate with many companies from the industry can act as integrators involving new actors and enabling collaboration, as well as knowledge and information exchange. An integrator also acts as a pacemaker and a project office. When new members are involved and knowledge is being exchanged, actors start to generate ideas and initiate projects. That provides the principle that ecosystem projects have no time limits.
The sustainability of an industrial ecosystem is associated with the entropy concept. According to Bailey (Social Entropy Theory) and Forsé (L’Ordre Improbable. Entropie et Processus Sociaux) [43], the development of systems is characterized by instability and non-equilibrium as a constant fluctuation between organization and disorganization. Ecosystems are systems that are characterized by instability and disorganization. The ecosystems are created on the principles of self-organization when there is no external management system. The idea (pacemaker) of ecosystem formation is, for example, a new project, which is the response of economic actors to technological challenges acting as chaos [17]. It is chaos for complex disorganization systems, being ecosystems, that ensures their openness, and acts as an incentive for development. Negative entropy characterizes the development of a system and its openness. The greater the entropy is, the stiffer the structure of the system is, and the more unstable the system is from the standpoint of external influences (fluctuations).
Entropy stability is present if the order and organization within the system balance the disorder and disorganization of interactions between actors. It is here when a system can be called sustainable. Each ecosystem strives for entropy equilibrium. The more complex the ecosystem structure is, the larger it is, and the less predictable its behavior is. The sustainability of the ecosystem is ensured by the diversity and complexity of the relationships of the participants included in its composition. Systems of high sustainability can perceive significant effects without substantially changing their structure, that is, without going beyond the equilibrium state. Moreover, the concept of sustainability is not equivalent to the concept of stability, since attention is paid to the invariability of the structure here. Systems of an invariable structure can be called “fragile” by analogy with technical systems. An assessment of ecosystems in terms of sustainability is determined, as a rule, by the variability of the environment: Under stable conditions, systems are prone to a higher internal organization; under variable conditions, the preference is given to disorganization.

4. Research Methodology

The methodology for assessing the effectiveness of industrial ecosystems is related to estimating stability relations level between actors. An ecosystem is a complex open system, as it interacts with the external environment by transmitting energy in the form of information, knowledge, and competencies. Complex systems are characterized by processes of self-organization, when new actors are connected to the ecosystem and new connections are formed, and processes of disorganization, when connections are destroyed for one reason or another, and the actor leaves the ecosystem. The external environment for an ecosystem is the society, territories, and industry that interact with the ecosystem in pursuit of their goals. Since the ecosystem is a combination of both actors, relationships between them, and processes, it is impossible to predict the state of the ecosystem and assess its stability by observing and studying each element of the system separately.
The behavior of an ecosystem depends on the external environment, on the behavior of actors, and their interaction with each other. Entropy is a quantitative measure of disorder in a system. The greater the entropy of the ecosystem state, the more ways it can be implemented between actors, the less ordered it is, and the more self-organized the actors of this ecosystem are. In other words, an increase in entropy means an increase in the degree of freedom of the actor from external control, and, consequently, an increase in its self-organization and, as a result, responsibility for its own sustainable development.
The authors propose using the entropy method [39] and Harrington’s desirability technique [44] to assess the strength of the connection between actors and the sustainability of the ecosystem. In accordance with the entropy theory the actors (Ai) of ecosystem E across Di—a set of goals and potentials that characterize a given participant ( d i r ) 1 R , then {Di, ( d i r ) 1 R } will represent the system Ai. This is described by Formula (1):
A i = { D i , ( d i r ) 1 R } , i = 1 , 2 , , n .
For example:
A1—one of the actors whose goal is to implement a project of the digital transformation of a business process—a set of D1 targets.
A2—another actor, whose goal is, for example, a project to develop a unique process control sensor—a set of D2 targets.
At the same time, achieving the internal goal of each actor Ai will depend on the implementation of some management trajectory and the eco-environment in which the system operates. The internal transformations’ effectiveness depends on the behavior and the connections between actors in the ecosystem. The influence of actors on ecosystem sustainability depends on
(1)
the potential of the actor, that is, the availability of unique technologies, resources, and competencies;
(2)
the extent of the actor’s relationships with other actors.
On the one hand, the more actors an ecosystem includes, the higher its synergistic potential and the more sustainable it is to external challenges. On the other hand, many relationships entail the risks of interest conflicts.
In order to assess the level of connections stability between actors, evaluate them by representing their interests as a numerical domain, in which for all ( d i r ) 1 R the condition given by Formula (2) is satisfied:
Σ ( d i r ) = 1 ,
where p is a given function that reflects the position that some target indicator k of the Ai actor is preferable for the ecosystem than the indicator l of the Aj actor. This is given by Formula (3):
d i k > d j l
In other words, the p function is a normalized measure of the ecosystem targets. As a function p, you can use the probability that the Ai actor of the ecosystem implements the dik goal, i.e., p(dik). Then p = mi/N, where N—the number of ecosystem goals, and mi is the number of shared goals for actors.
Each actor has its own goal, which is preferable to the goals of other actors, but from the standpoint of the ecosystem. The priority of the projects implementation within the ecosystem is influenced by the integral indicators, reflecting the time cycle of the project (the shorter the cycle, the more preferable), the speed of implementation, the uniqueness of the project, the degree of importance of the project for other actors, etc.
However, it is not possible to describe the sustainable behavior of an ecosystem only from a quantitative approach to determining ecosystem targets. We used the concept of ecosystem entropy behavior. The entropy of ecosystem behavior E considered as a qualitative characteristic of the system, reflecting the level of balanced utility of system projects based on the analysis of the demands for these projects for all actors [38]. By the degree of balance of the usefulness of projects we mean the uniformity of the project’s importance for all actors. If one project is more important than the others, then the balance of usefulness of this project is low. For example, creating a digital project office that allows each actor to effectively interact with other actors in the implementation of their goals has a high balance level. The implementation of private actors’ projects is characterized by a lower level relative to the ecosystem.
We present the category of predictability or unpredictability of ecosystem behavior. If the targets of actors are highly organized or equivalent, then it is difficult to formulate a priori assumptions about the priority of projects, that is, which project will be initially implemented by the system, in other words, the behavior of the system is difficult to identify—the relationship between the categories: organization ~ unpredictability; disorganization ~ predictability. The concepts of organization and unpredictability or disorganization and predictability are not identical; they only correspond to each other. The entropy of ecosystem behavior, as a category of organization (or disorganization), can be viewed as a category of unpredictability with respect to the environment external to the ecosystem or its internal environment (Figure 1).
A measure of ecosystem entropy E or imprecise entropy is some combination of the quantitative characteristics of actors A, i.e., as a function of the quantitative characteristics of targets. If the measure of entropy of the behavior of the actor A1, denote E(A1), it can be represented by Formula (4):
( A i ) = E ( p 1 , , p n ) ,
where p( d i k ) = pi, i = 1, 2, …, n.
Thus, we obtain a uniquely defined measure of the entropy of ecosystem behavior [3]. Entropy is quantified using Formula (5):
E ( A i ) = Σ p ( d i k ) l o g 2 p ( d i k ) .
Entropic equilibrium or stability exists when disorder and disorganization balance order and organization, and the system becomes stable. Any deviation from the point of balance in any direction causes either excessive orderliness and organization, or excessive disorder and disorganization. Each ecosystem strives for entropic balance (Ep = E). This phenomenon is called the regularity of entropic equilibrium, or the increase and decrease of entropy, in an open system [39].
Based on the axioms, the more complex the structure of the ecosystem, the larger it is, the less predictable its behavior is, and, conversely, the less organized the set of target settings of the ecosystem, the more predictable its behavior will be. The concept of entropy of ecosystem behavior is a category that allows describing the dependencies of two actors included in its structure. According to system theory, each system is part of another system, but of a higher level.
Each actor in the ecological environment has his own environment. That is Aj may also include an actor in its environment Ai, which allows you to define the categories of the dependence of the actor on his environment or the dependence between two actors in the ecosystem. The possibility of realizing the goals of an individual actor is his internal behavior, through which the actor manifests himself in the environment of the ecosystem. This capability is a qualitative category, but it has characteristics that qualify it in relation to the environment.
We propose to consider the environment of the actor Ai is a subsystem of the actor’s environment Aj. Then, under the possibilities of implementing the target settings of the actor Ai in relation to the environment Aj, we will understand the possibilities of implementing the target indicators Ai under the assumption that the target indicators of the actor Aj are realized.
The actor dependency concept Ai from the actor Aj is a relative category that characterizes the relationship between the external environments of systems Ai and Aj (Figure 2).
If two actors can be said AjAi, then the actor Aj is called dominant, and the actor Ai—addicted. Figure 2 shows that the relationship of the dependence that can be separated from the entropy of the actor dominating in the dependence AjAi, and the less predictable the behavior of the dominant system, the stronger the dependence and vice versa. If the behavior of the dominant actor in the ecosystem is predictable, then the position of the dependent actor is more favorable, and the dependence is weaker than the case when the behavior of the dominant actor is unpredictable.
Under the magnitude Z(AjAi) we will understand the absolute measure of dependence AjAi, defined by the Formula (6):
Z(AjAi) = E(Aj) − E(Ai|Aj).
The normalized measure of dependence AjAi has the following properties:
  • equal to zero if the system Aj does not depend on the system Ai.
  • equal to 1 (maximum value) when the dependence is maximum, i.e., when any target indicator of the system Ai is uniquely determined by the behavior of the system Aj.
  • takes values from the interval (0, 1).
Determining the measurement of the dependence of actors, one can proceed to assess the environment of the ecosystem as a whole. We believe that ecosystem participants can perform different roles in the system, but each actor can simultaneously or alternately play several different roles, depending on different life cycles of projects being implemented or the life cycle of the ecosystem. Then we considered the role as a part of the actor’s behavior corresponding to a specific dependence. Thus, the actors of the ecosystem form subsystems. A number of these subsystems can be associated with a function for all actor’s pairs that satisfy certain conditions:
  • an actor is independent only from himself, two actors are always dependent.
  • if there is a dependency AjAi, then the inverse relationship equally exists AiAj.
  • an actor Am depending on Ai, then dependence Am on Ai will not decrease if “inserted” Aj in relation to the relationship between Am и Ai.
    These conditions can be formalized as follows:
    • D (Aj → Ai) = 0 ⇔ Aj = Ai.
    • D (Aj → Ai) = D (Ai → Aj).
    • D (Ai → Am) ≤ D (Ai → Aj) + D (Aj → Am).
The dependence between the actors is defined as the contradiction between the needs and the possibilities for the implementation of the target settings Ai in the ecosystem environment.
Considered entropy approach assumes the different openness of actors in the ecosystem. The higher the openness level, the higher the readiness for self-organization at all levels of decision-making. This leads to the greater interest of the actor in developing their potential through the implementation and promotion of various projects. An actor’s interest in development is reflected in the interaction with other actors, which leads to the sustainability of the ecosystem.
Then the following statements are true for each actor:
  • the trajectory of the behavior of the actor Ai is determined by the difference between the need and the possibilities to achieve their goals, considering the dependence on other actors.
  • the trajectory of the behavior of the actor Ai is influenced by the tendency to continue, fulfill, or accept such roles in the ecosystem, which, on the other hand, will reduce his dependence on other actors and, increase the dependence of other actors on the actor Ai.
  • dependence, as a contradiction between the necessity and the possibilities of realizing the goals of the actor Ai, can change in the event of changes either in the actor’s capabilities, or in the event of his adjusting his target indicators.
The more actors are included in the ecosystem and the more connections it includes, the fewer management trajectories in which the dependencies of actors are minimal. Moreover, even if the actor Ai wants to choose a managerial decision that reduces his dependence on another actor Aj, it may turn out that some actor Ak forces Ai to make a completely different decision, which corresponds to the resulting even greater dependence. An attempt to transform the needs of achieving the goals of one actor into the possibility of achieving the goals of another actor will be called the conflict of the ecosystem environment.
From this point of view, conflict is the actions of actors against dependence on other actors, and conflict action is behavior determined by dependencies. The conflicting relationship between the target indicator m of the actor Ai and the target indicator n of the actor Aj is formalized can be represented as P(dim) < P(dim/djn).
Then the relationship of probabilistic cooperation is described as P(dim) > P(dim/djn). The fulfillment of the target indicator of the actor Aj decreases or increases the probability that the actor Ai will reach his indicator m. To identify and assess conflicts in an ecosystem, as a stochastic system, a quantitative approach is needed to assess conflict relationships. Since conflict is the degree of development of a contradiction arising from organization or disorganization, predictability or unpredictability, it is possible to use the concept of entropy as such a measure, which has the following properties:
  • equal to zero if one trajectory is feasible and the others are impossible.
  • maximum when all possible states are equally probable.
  • addictive.
This approach allows you to define the structural dependencies of actors Ai и Aj, namely the proportion of the relationship between conflict and cooperation. And then, by changing the set of possible target indicators of each actor by adjusting management trajectories, it is possible to achieve a change in the relative share of conflict in the overall dependence of actors, which will increase the stability of the ecosystem as a whole.
The presented methodology was tested on the example of the NUST «MISIS» ecosystem (National University of Science and Technology “MISIS” (Russia) ecosystem).

5. Case: The Sustainability Assessment in the Industrial Ecosystems “Green Technologies for Resource Conservation”

The entropy method is described in the methodological part of the article. The “Green technologies for resource conservation” ecosystem is of interest for assessing the ecosystem attractiveness and sustainability, as it is a cross-border, cross-sectoral, and dynamic ecosystem. In such an ecosystem, the actors are represented by different countries, industries, research centers, and the distribution of roles between them vary depending on the life cycle of ongoing projects and the ecosystem. The ecosystem’s pacemaker is the idea of developing fundamentally new technologies and materials in order to improve the environment.
NUST “MISIS” takes part in innovative projects through a system of interaction and partnership with enterprises of various industries, international research centers, and laboratories. One of the strategic directions of the university’s development is the formation of new competencies in the field of green technology engineering, as well as positioning NUST “MISIS” as a leader in the field of sustainable development in the raw materials and processing sectors.
As part of this direction, the University has created a multi-level ecosystem “Green technologies for resource conservation”. Subject areas of the ecosystem:
  • Waste management of mining and processing of mineral raw materials.
  • Processing of chemical products and radioactive waste.
Projects implemented by this ecosystem:
  • Project 1. Development of a new generation of flexible and high-performance catalytic reactor systems based on structured catalysts (adsorbents) for the complex processing of natural and associated gases, as well as biogas using various processes.
  • Project 2. Development of technologies for the production and use of composite binders for the construction of transport and hydraulic structures with the use of large-tonnage waste from the extraction and processing of mineral raw materials.
  • Project 3. Development of an integrated innovative technology for the extraction and processing of mineral raw materials with underground waste isolation for solving state scientific and technological problems of energy and environmental safety.
Descriptions of the actors of the ecosystem “Green technologies for resource conservation” are presented in Table 2, Table 3 and Table 4.
At the same time, the achievement of the internal goal of each actor (Ai) will depend on the behavior of many other actors in the ecosystem and the connections between them. Each actor, being included in the ecosystem, is overgrown with connections with other actors; therefore, the number and strength of connections are the basis for sustainable development of the ecosystem.
The pacemaker acts as the center of intellectual attraction for actors in the ecosystem, which can be an actor, a technology, a project, and a platform [37]. The pacemaker ensures the exchange of cognitive energy balance and the coherence of all actor’s interaction with each other (Figure 3).
The pacemaker of the first level of the ecosystem is the NUST “MISIS” Expert Council, which serves as an entry point for the formation of new ideas, competencies, technological solutions, and the initiation of projects to develop resource-saving technologies. The scientific laboratory of the University “Nano chemistry and Ecology” acts as a pacemaker at the second level of the ecosystem, providing cross-sectoral interaction and the integration of competencies within one scientific area. The laboratory serves as a single-entry point for industrial customers in the implementation of complex projects. The third level pacemaker is a large-scale interdisciplinary project, the development and implementation of which requires the involvement of specialists from different fields, therefore the project serves as an entry point for laboratories, research centers, departments, and industrial enterprises.
The concept of entropy of behavior of an ecosystem (E) is a category that allows describing the dependencies of actors included in its structure, since the entropy of connected processes converges when their connection is strengthened.
First, let us calculate the entropy indicator of the ecosystem behavior “Green technologies for resource conservation” based on the Shannon method (Formulas (5) and (6)) [45]. As a function p (the ratio of the number of common goals of actors to the number of goals of the ecosystem), we will consider the probability of achieving the goals of the ecosystem by actors (Ai). The E(Ai) value is calculated by Formula (7):
E(Ai) = −(0.5 log20.5 + 0.33 log20.33 + 0.17 log20.17) = 1.46.
That is E(Ai) > Ep, therefore, the innovation ecosystem is characterized by weak sustainability. The greater flow of knowledge and information between actors leads to a lower level of entropy in the ecosystem. Thus, the entropy of the ecosystem and the degree (strength) of the connection of actors have an inverse relationship. It should be noted that with an increase in the degree of openness of an ecosystem, entropy decreases, and order is brought about not only in general but in all parameters just in only one indicator or system parameters.
Next, we assess the level and strength of connections between actors from different groups of the ecosystem. Evaluation of qualitative indicators characterizing the relationship between the actors of the ecosystem can be realized using a specially developed scale of expert assessments, normalized in the range from 0 to 5. In the absence of reliable information on indicators, the assessment was carried out on a limited range of indicators. The reference gradation is defined as follows:
  • 0 ≤ Independence of an actor of one group from an actor of another group < 1.
  • 1 ≤ The relationship between actors is for informational purposes only < 2.
  • 2 ≤ The dependence between the actors is partially project-based, resource balanced and intellectual < 3.
  • 3 ≤ Project dependency < 4.
  • 4 ≤ Complete resource and project dependence < 5.
After receiving expert assessments in points, we determined the coded values of the control points (yij) taking into account the lower and upper limits of the value (ymin = 0, ymax = 5) according to the method of the desirability of Harrington [44] (Table 5).
The bond strength of the actors is defined as the geometric mean of the coded values (yij; di). Calculate the encoded values of these breakpoints (yij) and the coded value of the parameter is the dependence between the actors in Project 1. The calculation is done using Formulas (8) and (9):
y ( 1 ) = l n l n ( 1 / 0.37 ) = 0.00576 ;
y ( 10 ) = l n l n ( 1 / 0.8 ) = 1.4999 .
The equation y′ = a × y + b acts as a translation mechanism y to y′. Values a и b can be found through a system of equations: (0.00576 = a × 1 + b) and (1.4999 = a × 10 + b). In this way, a = 0.16576 and b = −0.16025. The final equation becomes Formula (10):
y′ = 0.16576 y − 0.16025.
Similarly, the parameter was estimated for Project 2 and Project 3. The generalized Harrington desirability function (optimization criterion) of the j-th actor is defined as the geometric mean of particular desirability [44]. The results are presented in Table 6.
On the Harrington scale, Project 1 is categorized as “very good”, hence the actors have full resource and project dependence. Project 2 is categorized as “good”, which indicates that there is project dependence between the actors. In Project 3, the relationship between actors is purely informational. The integral indicator of the bond strength of the ecosystem actors was calculated using the Formula (11):
D j = 0.82 × 0.71 × 0.59 3 = 0.698
When the result is closer to 1, then it is better for ecosystem sustainability. In our example, the indicator of the strength of connection was 0.698, therefore, we can talk about the sustainability of the innovative industrial ecosystem “Green technologies for resource conservation”.
This methodology for assessing the potential of projects allows making decisions on the further participation of actors in ecosystem projects.

6. Conclusions

This paper proposed a methodological framework for studying industrial ecosystems in the context of self-organization and sustainability perspective. The main research question was how to operationalize the processes of self-organization in the industrial ecosystem without an external governing body and to ensure ecosystem sustainability. To this end, the authors propose a new tool for estimating the actor’s collaboration level based on the entropy approach Harrington method. It allows for operationalizing the processes of self-organization in the ecosystem without external intervention and addresses the main implications for the sustainability of industrial ecosystems. The authors illustrated their assumptions with an empirical case study of the industrial ecosystem “Green technologies for resource conservation”, which is part of the National University of Science and Technology “MISIS” ecosystem. The propositions arising from this analysis provide information to help academics, policymakers, government, and individual enterprises with a more adequate understanding of the practical mechanisms and tools that help trigger the self-organization and sustainability of the innovation ecosystems. The proposed novel tool for assessing an actor collaboration level in the ecosystem makes a significant contribution to the industrial ecosystem theory and methodology development in terms of conceptualization of the self-organization and self-development processes and further investigation of their impact on ecosystem sustainability.

7. Limitation and Future Research Directions

We have developed a novel methodological framework for industrial ecosystem sustainability assessment with a focus on integration and collaboration effects. Meanwhile, the proposed approach has some shortcomings and limitations caused by them. The following main limitations should be mentioned: It is not applicable for scenario calculations, high volatility of estimates, problems of specification selection when choosing data sources, high susceptibility to the ranking method, and parameter values. We raise the following questions to be addressed as future lines of research. Firstly, it is necessary to develop the conceptual and methodological aspects of the correlation between the ecosystem’s maturity and sustainability. Secondly, the authors plan to propose the model of ecosystem risks for industrial ecosystems economic security Thirdly, to further develop the theory of ecosystems on three levels—macro, meso, and micro.
Finally, it will be necessary to adopt a proposed methodology for assessing sustainability for different types of ecosystems (innovation, entrepreneurial, territorial, ext.) depending on the stage of the ecosystem’s life cycle and to validate the theoretical foundations and propose an extended system of indicators for assessing the circular potential of actors in the industrial ecosystem. Currently, most authors use the same indicators to assess circularity for measuring sustainability. This makes it difficult to reveal the contribution of circular processes to the achievement of environmental/green goals.

Author Contributions

Conceptualization, T.T. and Y.V.; methodology, N.S. and V.P.; formal analysis, T.T., N.S., Y.V., and V.P.; investigation, T.T.; resources, N.S.; elaborated the literature review, T.T. and N.S.; writing—original draft preparation, T.T. and N.S.; writing—review and editing, T.T., N.S., Y.V., and V.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the RFBR grant No. 20-010-00470.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Plotnikov, V.; Vertakova, Y.; Leontyev, E. Evaluation of the effectiveness of the telecommunication company’s cluster management. Econ. Comput. Econ. Cybern. Stud. Res. 2016, 50, 109–118. [Google Scholar]
  2. Vasin, S.; Gamidullaeva, L.; Tolstykh, T.; Rostovskaya, T.; Skorobogatova, V. From innovation system through institutional transformation to digital innovation ecosystem. In Proceedings of the 31st International Business Information Management Association Conference, IBIMA 2018: Innovation Management and Education Excellence through Vision, Milan, Italy, 25–26 April 2018. [Google Scholar]
  3. Vertakova, Y.V.; Plotnikov, V.A. The Integrated Approach to Sustainable Development: The Case of Energy Efficiency and Solid Waste Management. Int. J. Energy Econ. Policy 2019, 9, 194–201. [Google Scholar] [CrossRef]
  4. Koch, T.; Windsperger, J. Seeing through the network: Competitive advantage in the digital economy. J. Organ. Des. 2017, 6, 6. [Google Scholar] [CrossRef]
  5. Porter, M.E. Clusters and the new economics of competition. Harv. Bus. Rev. 1998, 76, 77–90. [Google Scholar] [PubMed]
  6. Richter, C.; Kraus, S.; Brem, A.; Durst, S.; Giselbrecht, C. Digital entrepreneurship: Innovative business models for the sharing economy. Creat. Innov. Manag. 2017, 26, 300–310. [Google Scholar] [CrossRef]
  7. Taleb, N.N. Antifragile: Things That Gain from Disorder; KoLibri, Azbuka-Attikus: Moscow, Russia, 2014. [Google Scholar]
  8. Moore, J.F. The Death of Competition: Leadership and Strategy in the Age of Business Ecosystems; Harper Collins: New York, NY, USA, 1997. [Google Scholar]
  9. Jacobides, M.G.; Cennamo, C.; Gawer, A. Towards a theory of ecosystems. Strateg. Manag. J. 2018, 39, 2255–2276. [Google Scholar] [CrossRef] [Green Version]
  10. Kleiner, G.B. Ecosystem economy: Step into the future. Econ. Revival Russ. 2019, 1, 40–45. [Google Scholar]
  11. Sun, B.; Tang, J. Ecosystem health assessment: A PSR analysis combining AHP and FCE methods for Jiaozhou Bay, China. Ocean Coast. Manag. 2019, 1681, 41–50. [Google Scholar] [CrossRef]
  12. Shvab, K. The Fourth Industrial Revolution. Available online: https://www.vedomosti.ru/economics/articles/2020/01/14/820569-davosskii-forum-manifest-biznesa (accessed on 12 June 2020).
  13. Smorodinskaya, N.V. Network innovation ecosystems and their role in the dynamization of economic growth. Innovations 2014, 7, 27–33. [Google Scholar]
  14. Karpinskaya, V.A. Ecosystem as a Unit of Economic Analysis. In Proceedings of the Second Conference of the Department of Modeling Production Facilities and Complexes of the Central Economics Institute of the Russian Academy of Sciences “Systemic Problems of Domestic Mesoeconomics, Microeconomics, Enterprise Economics”, Moscow, Russia, 12 January 2018. [Google Scholar]
  15. Lundvall, B.-A. National Systems of Innovation: Towards a Theory of Innovation and Interactive Learning; Frances Pinter: London, UK, 1992. [Google Scholar]
  16. Freeman, C. The National System of Innovation in Historical Perspective. Camb. J. Econ. 1995, 19, 5–24. [Google Scholar]
  17. Tolstykh, T.; Shmeleva, N.; Gamidullaeva, L. Evaluation of Circular and Integration Potentials of Innovation Ecosystems for Industrial Sustainability. Sustainability 2020, 12, 4574. [Google Scholar] [CrossRef]
  18. Tolstykh, T.; Shmeleva, N.; Gamidullaeva, L.; Lapygin, Y. Regional Development in Russia: An Ecosystem Approach to Territorial Sustainability Assessment. Sustainability 2020, 12, 6424. [Google Scholar] [CrossRef]
  19. Lenort, R.; Zapletal, F.; Wicher, P.; Shmeleva, N. Sustainability Development Goals Preferences in Metallurgical and Mining Industry. In Proceedings of the 29 International Conference in Metallurgy and Materials (METAL 2020), Brno, Czech Republic, 19–21 May 2020. [Google Scholar]
  20. Brown, R.; Mason, C. Looking inside the spiky bits: A critical review and conceptualisation of entrepreneurial ecosystems. Small Bus. Econ. 2017, 49, 11–30. [Google Scholar] [CrossRef] [Green Version]
  21. Etzkowitz, H.; Leydesdorff, L. The dynamics of innovation: From National Systems and “mode 2” to a Triple Helix of university-industry-government relations. Res. Policy 2000, 29, 109–123. [Google Scholar] [CrossRef]
  22. Bruns, K.; Bosma, N.; Sanders, M.; Schramm, M. Searching for the existence of entrepreneurial ecosystems: A regional cross-section growth regression approach. Small Bus. Econ. 2017, 49, 31–54. [Google Scholar] [CrossRef]
  23. Segura-Salazar, J.; Tavares, L.M. Sustainability in the Minerals Industry: Seeking a Consensus on Its Meaning. Sustainability 2018, 10, 1429. [Google Scholar] [CrossRef] [Green Version]
  24. Adner, R.; Kapoor, R. Value creation in innovation ecosystems: How the structure of technological interdependence affects firm performance in new technology generations. Strateg. Manag. J. 2010, 31, 306–333. [Google Scholar] [CrossRef]
  25. Sussan, F.; Acs, Z.J. The digital entrepreneurial ecosystem. Small Bus. Econ. 2017, 49, 55–73. [Google Scholar] [CrossRef]
  26. Meoli, M.; Paleari, S.; Vismara, S. The governance of universities and the establishment of academic spinoff. Small Bus. Econ. 2017, 52, 485–504. [Google Scholar] [CrossRef]
  27. Ghio, N.; Guerini, M.; Lamastra-Rossi, C. The creation of high-tech ventures in entrepreneurial ecosystems: Exploring the interactions among university knowledge, cooperative banks, and individual attitudes. Small Bus. Econ. 2017, 52, 523–543. [Google Scholar] [CrossRef]
  28. Oksanen, K.; Hautamäki, A. Transforming regions into innovation ecosystems: A model for renewing local industrial structures. Innov. J. Public Sect. Innov. J. 2014, 19, 5. [Google Scholar]
  29. Adner, R. Match your innovation strategy to your innovation ecosystem. Harv. Bus. Rev. 2006, 84, 98–107. [Google Scholar]
  30. Granstranda, O.; Holgerssonb, M. Innovation ecosystems: A conceptual review and a new definition. Technovation 2020, 90–91, 102098. [Google Scholar] [CrossRef]
  31. Wareham, J.; Fox, P.; Lluís Cano Giner, J. Technology ecosystem governance. Organ. Sci. 2014, 25, 1195–1215. [Google Scholar] [CrossRef]
  32. Lieder, M.; Rashid, A. Towards circular economy implementation: A comprehensive review in context of manufacturing industry. J. Clean. Prod. 2016, 115, 36–51. [Google Scholar] [CrossRef]
  33. Carayannis, E.G.; Campbell, D.F.J. Knowledge Creation, Diffusion, and Use in Innovation Networks and Knowledge Clusters: A Comparative Systems Approach across the United States, Europe, and Asia; Praeger Publishers: Westport, CT, USA, 2016. [Google Scholar]
  34. Jackson, D.J. What Is an Innovation Ecosystem? National Science Foundation: Arlington, VA, USA, 2011.
  35. Kleyner, G.B. Industrial ecosystems: A look into the future. J. Russ. Econ. Revival 2018, 3, 53–62. [Google Scholar]
  36. Yun, J.J.; Liu, Z. Micro- and Macro-Dynamics of Open Innovation with a Quadruple-Helix Model. Sustainability 2019, 11, 3301. [Google Scholar] [CrossRef] [Green Version]
  37. Haken, G. Information and Self-Organization: A Macroscopic Approach to Complex Systems; Komkniga: Moscow, Russia, 2005. [Google Scholar]
  38. Tiwana, A. Platform Ecosystems: Aligning Architecture, Governance, and Strategy; Murgan Kaufman Publishers: Burlington, MA, USA, 2013. [Google Scholar]
  39. Prangishvili, I.V. Entropy and Other System Regularities: Issues of Managing Complex Systems; Nauka: Moscow, Russia, 2003. [Google Scholar]
  40. Clarysse, B.; Wright, M.; Bruneel, J.; Mahajan, A. Creating value in ecosystems: Crossing the chasm between knowledge and business ecosystems. Res. Policy 2014, 43, 1164–1176. [Google Scholar] [CrossRef]
  41. Vertakova, Y.; Plotnikov, V. Innovative and industrial development: Specifics of interrelation. Econ. Ann.-XXI 2016, 156, 37–40. [Google Scholar] [CrossRef] [Green Version]
  42. Shmeleva, N. Innovation ecosystems in metallurgical industry: Evolution, measurements and trends. In Proceedings of the International Multidisciplinary Scientific GEO Conference Proceeding (SGEM 2018), Albena, Bulgaria, 2–8 July 2018. [Google Scholar]
  43. Bailey, K.D. Social Entropy Theory; State University of New York Press: New York, NY, USA, 1990. [Google Scholar]
  44. Harrington, E.C. The Desirability Function. Ind. Qual. Control 1965, 21, 494–498. [Google Scholar]
  45. Shannon, C.E. Mathematical Theory of Communication. Available online: http://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf (accessed on 30 September 2020).
Figure 1. Interpretation of an ecosystem entropy behavior.
Figure 1. Interpretation of an ecosystem entropy behavior.
Inventions 05 00054 g001
Figure 2. Interpretation of two systems behavior.
Figure 2. Interpretation of two systems behavior.
Inventions 05 00054 g002
Figure 3. The structure of the ecosystem “Green technologies for resource conservation”.
Figure 3. The structure of the ecosystem “Green technologies for resource conservation”.
Inventions 05 00054 g003
Table 1. Comparative analysis of cluster and ecosystem approaches.
Table 1. Comparative analysis of cluster and ecosystem approaches.
Comparison CriterionIndustrial ClustersIndustrial Ecosystems
Coordination Mechanism Decision of federal, industry, or municipal authoritiesSelf-organization
Cooperation TargetIncreasing the competitiveness of an industry or regionInitiation and implementation of digital innovation or unique product
Unification boundariesGeographic or industryCross-industry, territorial
Matching CriteriaStages of the production processLife cycle stages of projects, products, technologies
Relationships between participantsInternal competition and cooperationCooperation and partnership
Possibility to include or exclude actorsRestriction on inputs and outputsHigh level of openness
Controllabilitygovernment bodies at federal or regional levelsPacemaker
Table 2. Characteristics of actors—researchers (National University of Science and Technology (NUST) “MISIS”).
Table 2. Characteristics of actors—researchers (National University of Science and Technology (NUST) “MISIS”).
Group of Actors (A1)ObjectivesIntegral Indicators (D1)
1. Laboratory “Nano Chemistry and Ecology”.
2. MISIS Center for Resource-Saving Technologies for Processing Mineral Raw Materials.
3. Industrial Technology Engineering Center.
Innovative Scientific and Educational Center “Romelt”.
Development of new technologies for resource conservation and processing of industrial and man-made waste.
Commercialization of technologies.
R & D.
Total innovation index SII.
The level of digital maturity.
The share of unique technologies in the overall structure.
Research and development costs.
Table 3. Characteristics of actors—partners of the ecosystem.
Table 3. Characteristics of actors—partners of the ecosystem.
Group of Actors (A2)ObjectivesIntegral Indicators (D2)
NRU MGSU.
BSTU V.G. Shukhov.
SNRU named after S.P. Korolev.
University of the Basque.
Commercialization of technologies.
R & D.
Implementation of complex high-budget projects for large industrial companies.
The level of development of cooperation between actors.
The number and cost of joint projects in which ecosystem actors are involved.
Table 4. Characteristics of actors—customers/consumers.
Table 4. Characteristics of actors—customers/consumers.
Group of Actors (A3)ObjectivesIntegral Indicators (D3)
Inter-RAO PJSC.
RusHydro PJSC.
Rosatom State Corporation.
Alrosa PJSC.
Novolipetsk Metallurgical Plant (Group of Companies).
Federal Agency for Special Construction of Russia (Spetsstroy of Russia).
Zabsibgazprom.
Increasing competitiveness and profitability through the introduction of innovative technologies and processes.Balanced financial result of the actor.Correspondence of resources to the strategic goals of the actor.
Transfer of knowledge, technologies, results within the ecosystem.
Table 5. Harrington desirability scale.
Table 5. Harrington desirability scale.
(1.00–0.80)
«Very Good»
(0.80–0.63)
«Good»
(0.63–0.37)
«Satisfactorily»
(0.37–0.20)
«Bad»
(0.20–0)
«Very Bad»
Complete resource and project dependence.Project dependency.The dependence between the actors is partially project-based, resource balanced and intellectual.The relationship between actors is for informational purposes only.Independence of an actor of one group from an actor of another group.
Table 6. Interpretation of standard marks on the Harrington scale for ecosystem actors.
Table 6. Interpretation of standard marks on the Harrington scale for ecosystem actors.
ProjectsA Group of Actors—ResearchersGroup of Actors—PartnersCustomer Actor GroupHarrington Generalized Desirability Function (D)
yijD1yijD2yijD3
Project 11.4860.7971.2510.7511.3310.7680.82
Project 21.1350.7250.8640.6561.3780.7800.71
Project 31.1230.6840.7560.5981.1540.7230.59
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Tolstykh, T.; Shmeleva, N.; Vertakova, Y.; Plotnikov, V. The Entropy Model for Sustainability Assessment in Industrial Ecosystems. Inventions 2020, 5, 54. https://doi.org/10.3390/inventions5040054

AMA Style

Tolstykh T, Shmeleva N, Vertakova Y, Plotnikov V. The Entropy Model for Sustainability Assessment in Industrial Ecosystems. Inventions. 2020; 5(4):54. https://doi.org/10.3390/inventions5040054

Chicago/Turabian Style

Tolstykh, Tatyana, Nadezhda Shmeleva, Yulia Vertakova, and Vladimir Plotnikov. 2020. "The Entropy Model for Sustainability Assessment in Industrial Ecosystems" Inventions 5, no. 4: 54. https://doi.org/10.3390/inventions5040054

Article Metrics

Back to TopTop