Next Article in Journal
Investigation on the Influence of Active Underpinning Process on Bridge Substructures during Shield Tunnelling: Numerical Simulation and Field Monitoring
Next Article in Special Issue
A Study of Ornamental Craftsmanship in Doors and Windows of Hui-Style Architecture: The Huizhou Three Carvings (Brick, Stone, and Wood Carvings)
Previous Article in Journal
A Proposed eFSR Blockchain System for Optimal Planning of Facility Services with Probabilistic Arrivals and Stochastic Service Durations
Previous Article in Special Issue
Identifying and Prioritizing the Challenges and Obstacles of the Green Supply Chain Management in the Construction Industry Using the Fuzzy BWM Method
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Introduction of an Integrated System for Measuring the BSC and DEA-Based Performance of Social Systems Using Uncontrollable Factors: A Case Study of Shahriar Municipalities

Department of Engineering, Faculty of Industrial and Mechanical Engineering, Qazvin Branch, Islamic Azad University (IAU), Qazvin 341851416, Iran
*
Author to whom correspondence should be addressed.
Buildings 2023, 13(1), 242; https://doi.org/10.3390/buildings13010242
Submission received: 18 November 2022 / Revised: 16 December 2022 / Accepted: 29 December 2022 / Published: 15 January 2023

Abstract

:
Today, achieving managerial success and ongoing improvement depend greatly on the performance evaluation of service and economic units. On the other hand, we are aware that strategy is the primary driver of an organization’s long-term development and that, even if the right strategies are adopted, this effort will be ineffective if the strategy is not effectively executed. A balanced scorecard is an essential tool for strategy implementation. The network data envelopment analysis model, on the other hand, is recommended for the relative analysis and assessment of decision-making units in evaluating and improving the organizations’ performance with multiple inputs and outputs. The four components of the balanced scorecard are financial (retrospective indicators), and processes, customers, and learning and growth (prospective indicators). According to investigations, in addition to the four previously mentioned fields, a balanced scorecard for urban services (municipality) also encompasses the social responsibility field. In order to design performance evaluation indicators, this article attempted to use BSC while also attempting to evaluate performance using DEA. The Shahriar city municipal units of Ferdowsieh, Vahidie, Sabashahr, Shahedshahr, Andisheh, Baghestan, and Shahryar have all adopted this hybrid model. The findings indicate that the municipality of Andisheh city is efficient, while the remaining municipalities are inefficient. Nevertheless, the Baghestan municipality performs well and is effective in terms of social responsibilities.

1. Introduction

Managers and researchers have had a difficult time keeping up with the challenge of accurately measuring the performance of the organization. Therefore, it contributes significantly to the advancement of the organizational contribution. [1,2,3,4,5]. It is critical to comprehend the influence of measurement systems on organizational assessment. In today’s competitive environment, all organizations, whether government or private, require some kind of effective performance evaluation system for development, growth, and sustainability. The effectiveness and efficiency of the organization’s strategies and human resources procedures can be evaluated using this method. In other words, high-ranking management has always sought a solution to ensure strategy execution. As a tool to manage the execution of their strategies, performance assessment methods have been preferred in the meantime. Today, numerous manufacturers and service providers are compelled to adopt innovative management strategies. The balanced scorecard is an effective and essential tool in performance evaluation. The emphasis in this measurement system shifts from internal to external factors. Additionally, attention is given to how to implement processes with regard to environmental conditions as well as strategy implementation rather than task performance. The balanced scorecard is regarded as a new kind of measurement system. It investigates the organization’s conditions in four domains: financial, processes, customers, and learning and growth [1,2,3,4,5,6,7,8,9,10,11,12].
However, we should be aware that the four aspects of the balanced scorecard are widely accepted as a fundamental model. However, a greater or lesser number of card aspects may be taken into consideration depending on the character of the organizations, their type of mission, and their organizational framework. Programs that have the potential to be effective and efficient are identified by the performance evaluation system. This system can also identify undesired but beneficial projects and plans. The management team is also assisted by the control and evaluation system in identifying program weaknesses and implementing the appropriate corrective actions. In order to create an open space where people can learn from their errors and improve, a control and evaluation strategy can be employed to lessen anxiety inside the government and organization. One source of knowledge capital is an effective control and evaluation system. The government and organizations can use this system to design and develop knowledge-based programs and initiatives. Additionally, it enhances organizational knowledge while providing ongoing feedback during the management, adjustment, and evaluation processes in order to accomplish particular goals. [12,13,14,15,16]
Municipalities are among the organizations that, on a global scale, are known to have significant impact on the country’s development and the expansion of the civil sphere. Municipalities in Iran function as non-governmental public organizations responsible for providing residents with basic services while also enhancing the city’s effectiveness, usefulness, and economic development. Currently, the demands for an organizational performance measurement tool is understood more than ever before, owing to the growth and development of cities, as well as the increase in their inhabitants, and as a consequence of the expansion of the rang e of urban services. One of the most popular models for assessing how well municipalities are performing globally is the balanced scorecard. The municipality’s long-term achievement can be evaluated using the balanced scorecard method, which can also be employed as a monitoring tool for the municipality’s performance.
On the other hand, we are aware that the municipality places a high priority on social responsibility because it is one of the most significant institutions in the public sector and the body in charge of the city’s administration. By evaluating the dimensions of the sustainable city regularly, this organization can inspect the city’s state from the standpoint of sustainable development and enhance the city’s state. As a result, the municipality ought to serve as a pioneer to follow in adhering to social responsibility in addition to its legally defined obligations. In addition to the four standpoints of financial state, customer, internal processes, and learning and development, the balanced evaluation model described in this article takes into account and analyzes the organization’s performance in the field of social responsibilities. According to the researchers, one of the primary cornerstones of municipalities’ obligations is the domain of social responsibilities, and managing municipalities’ development without taking social responsibilities into account is worthless.
The quantitative assessment of various domains of the card, which is performed with the assistance of data coverage analysis, is a crucial subject in the assessment of points for the card domains. The non-parametric data envelopment analysis (DEA) method converts numerous inputs into numerous outputs while considering both quantitative and qualitative criteria. It is used to analyze and evaluate the decision-making units (DMUs) performance.
While the balanced scorecard and data coverage analysis together make for a potent tool, they have only been around for a short period of time, and consequently, there are only a small number of studies and articles dedicated to the topic. Decision units are compared to one another because DEA is based on relative analysis [15,16,17]. One of the main challenges with the balanced scorecard, the requirement to establish the benchmarks and the baseline, is thus circumvented by employing the BSC–DEA integrated model. One of the most significant benefits of the recommended model is that it provides administrators with an exhaustive perspective of the business, and a balanced assessment based on all the aspects highlighted in the BSC in a networked manner while preserving the balance, linearity, and flexibility between them [16,17,18,19].
The input and output indicators in all five domains are initially determined employing the balanced scorecard (BSC) and also according to its objectives and strategic network map. Afterward, a combined and concurrent evaluation of the five components of the BSC is carried out for the municipalities using data envelopment analysis, a tool based on network and decision theory. Increasing the effectiveness of the entire organization is the ultimate objective [16].

2. Balanced Scorecard in the Municipality

According to Kaplan and Norton, administrators and employees pay attention to what is evaluated, and what is not evaluated cannot be managed effectively. As a result, managers devote most of their attention and energy to meeting short-term financial goals while paying little attention to managing and investing in the intangible resources that will ultimately determine the organization’s financial achievement in the future. Therefore, without a solid and efficient performance system, managers cannot develop and improve their intangible resources. As a result, they miss out on numerous chances for value creation [1,2,3,4,5].They presented a balanced scorecard approach to compensate for this omission. This method assesses the performance of the organization by including three additional dimensions, such as customers, internal business processes, and learning and growth, in addition to the conventional financial assessment. The aforementioned method focuses on the organization’s intangible resources, which have grown in importance in the modern era. This method enables the organization to incorporate it into the favored assessment model by monitoring, controlling, and being informed of the intangible assets’ quality and, if needed, repairing the deficiencies and compensating for the shortcomings. The traditional balanced scorecard, which has four main domains, including financial, internal processes, customer, and growth and learning aspects, is depicted in the Figure 1:
The financial aspect includes customary performance indicators typically connected to profitability [17]. Meeting shareholder expectations is a concern for financial criteria.
The customer aspect typically involves shared indicators resulting from the strategy’s successful findings when properly executed. For instance, customer retention typically results from customer satisfaction.
The objective of the internal processe aspect is to gain customer and beneficiary gratification by succeeding in some of the most effective business processes. The internal process or processes that have the biggest effects on customer gratification and achieving organizational objectives should be the focus of internal process criteria.
The learning and growth aspect’s initial objective is to set up the framework for achieving the objectives of the other three perspectives and to facilitate long-term development and improvement through people, systems, and organizational practices. In other words, this field minimizes the disparities between the human workforce, the system, and the favored and actual processes.
The municipality is in charge of urban management as one of the most significant public sector organizations and as the governing body of the city. Therefore, it is associated with the city’s social, economic, technological, and environmental aspects. By measuring the aspects of the sustainable city on a regular basis, this organization can inspect the state of the city from the standpoint of sustainable development and improve the state of the city. Economic growth, sustainable development, and societal welfare are some of the most significant outcomes of adhering to social responsibility principles. As a result, the municipality should be a pioneer in adhering to social responsibility beyond its legitimately delineated obligations. The domain of social responsibilities will therefore be included in the assessment of the municipality along with the other four components of the balanced scorecard. A balanced scorecard including five domains is depicted in Figure 2.
We should be aware that the objectives and metrics for these five domains are connected by a kind of cause-and-effect relationship. An excellent scorecard creates a cause-and-effect relationship between an organization’s present actions and its long-term achievement. The balanced scorecard will be an indispensable tool for the control and management of an organization’s intangible assets, as their development is dependent on these assets. We must create value for our customers to attain financial success in the field of finance, according to Figure 3 (in the customer field). In the domain of social responsibility, we ought to perform well. This is impractical unless we succeed in our operational procedures and adjust them to our customers’ and society’s needs (in the context of internal processes and social responsibilities). Without creating a comfortable workplace for employees and fostering innovation, creativity, learning, and development within the organization, operational excellence and the development of value-creating processes are impossible (growth and learning domain).
The social responsibility of organizations is often divided into four subsystems, which are economic, legal, moral, and public responsibilities that are carried out voluntarily.
In general, social responsibility is the commitment of decision makers for actions that, in addition to securing their own interests, also improve the welfare of the society. In this definition, there are several elements; first, social responsibility is an obligation that institutions must be accountable for actions that harm the health of the society, and should be avoided. Lastly, the organizations should try to improve social welfare by allocating financial resources and by actions such as helping the country’s culture and cultural institutions and improving the quality of life. Finally, what is meant by social responsibility is that because organizations have a major impact on society, their activities must be in such a way that there is no harm to society as a result, and in case of harm, the related organizations are required to provide compensation. In simpler words, organizations should act as a part related to the larger system in which they are situated.
We know that the set of municipal activities can be divided into two sectors: public services and special services. In the public services sector, which is considered one of the social responsibilities of municipalities, and special services are like the types of licenses that private sectors give and earn from them. We should know that both types of activities are very important for municipalities and the success in both depends on the conditions of the organization’s internal processes. If the organization is agile and the processes respond to the needs, the success of the municipalities is certain. The importance of the two fields of social responsibility and customer is the same from the point of view of the municipality and the audience. We should know that the municipality, as one of the important organizations of the public sector, and as the organization that manages the city, which is responsible for urban management and is related to all the different aspects of the city, such as social, economic, technological and environmental aspects. Regular measurement of the dimensions of a sustainable city improves the state of the city, because one of the most important results of acting on the principles of social responsibility is economic growth, sustainable development, and welfare of society. Therefore, the municipality should be a leader in adhering to social responsibility beyond its defined legal responsibilities. In general, the discussion of social responsibility is associated with the missions of municipalities, and it is not possible to create a clear demarcation between legal responsibility and social responsibility of municipalities.
There are few studies and articles that have been published on the subject of the integrated method of balanced scorecard and data envelopment analysis, despite the fact that they are a potent instrument in this context [20,21,22,23]. Professor Galloni, head of the Faculty of Engineering at Technics University, presented an article titled DEA–BSC. Professor Galloni applied for the first time the DEA–BSC technique to R&D projects. Dr. Alirezaei and Dr. Mir Hosseini’s article “Comprehensive Organizational Productivity System using DEA Centered on BSC”, and another article titled “Integration of two performance assessment systems, a mathematical viewpoint” was presented in Iran. Each article approached the topic of integration from a unique perspective. Some articles that concentrate on the DEA–BSC method are shown in Table 1.

3. Data Envelopment Analysis Using Uncontrollable Factors

One of the scheduling methods that is frequently employed to assess the effectiveness of similar units with numerous inputs and similar outputs is data envelopment analysis. Each decision-making unit’s (DMU) efficiency is a fractional programming issue. This means that the efficiency of each DMU is attributed to maximum weighted output to weighted input ratio subject to a set of constraints.
Assume that n is a decision-making unit in the shape of {DMUj: j = 1…n}, with m different inputs producing s outputs: y rj and x ij represent the rth output of r = (1… s ) and the ith input of i = (1,..., m ) of the decision-making unit jth of i = (1,..., n), respectively.
If we suppose that u = ( u 1 u s) and v = ( v 1 v m) represent the vectors of output and input weights, respectively; additionally, the efficiency of the DMUp in the multiple forms and the input nature will be as follows (Najafi et al. [16]):
M a x   E p = r s = 1 u r y r p i = 1 m v i x i p s . t . r = 1 s u r y r j i = 1 m v i x i j 0 ,                                   j = 1 , , n i = 1 m v i x i p = 1 u r , v i ε         , r = 1 , 2 , , s           ;         i = 1 , 2 , . . , m
Network systems are systems that have multiple processes that are linked together. A network DEA model (NDEA) is required to measure the efficiency of a network system. Lewis and Sexton recommended the network DEA model in response to the shortcomings of the traditional DEA model. This model possesses a multi-stage framework that accounts for divisional and total efficiencies in a single framework and encompasses internal DMU interrelations. The DEA network model, in contrast to conventional DEA models, is network structure-dependent and lacks a standard form. Some network models were developed by Grosskopf and Fare et al [13]. We determine the amount of input reduction or output enhancement required to achieve the efficiency limit when we solve the data envelopment analysis model for a decision-making unit. This indicates that while the management has total dominance over all inputs and outputs, in actuality, several factors influencing the degree of technical efficiency are outside of the management’s control and are not practical under the management’s supervision. For the first time, Banker and Murray (BM) (1986) recognized the significance of the fact that a number of production-affecting variables are outside of management’s supervision and coined the term “uncontrollable factors.” Investigations in this study demonstrate that a number of indicators are beyond management’s supervision.

4. Data Envelopment Analysis and Balanced Scorecard Model

The balanced scorecard is employed as a tool for designing the criteria of performance assessment in the integrated BSC and DEA model, and the DEA is employed as a tool for performance assessment in this model. Both controllable and uncontrollable criteria are provided in this model. Depending on the balance and sustaining the balance between important criteria, performance, and high resolution, the concurrent application of the balanced scorecard and DEA technique, and eventually the adoption of the DEA–BSC integrated balanced model, is recognized to be the most appropriate model for analyzing manufacturing companies. This approach is novel and unique in its own right.
Figure 4 depicts an integrated model of the indexing and performance evaluation phases using two DEA and BSC techniques.
The following algorithm is used by the aforementioned hybrid model:
1. Organization identification: The objectives of the organization’s strategies are recognized in this stage, and the BSC technique is used to design the criteria in each perspective. As a result, balanced indicators with various standpoints are developed.
2. Performance evaluation: BSC-evaluated indicators are divided into input and output groups and evaluated employing DEA.
3. Correction and improvement path designing by DEA: For each indicator, the improvement and correction path is determined. Indicators of input should be corrected and improved in a downward direction, while those of output should be improved in an upward direction.
4. Setting the index objectives for the next period: The DEA-determined indicator objectives are used to establish the indicator objectives for the subsequent period of BSC execution. In this technique, the organization is assessed using the DEA technique, and the indicator objectives are determined in the following period every time the BSC is executed, that is, each period whenever the organization’s data is entered into the BSC system and the findings are displayed. The organization will achieve the optimum and anticipated performance situations if the predefined objectives are accomplished. The organization’s situation is compared to the anticipated conditions of the previous period in the upcoming period of performance analysis, and new efficiency and objectives are then established. The manager is intended to manage the organization toward the most efficient circumstances by developing new strategies after each implementation of this method, which is done on a periodic basis.
If we desire to generalize the preceding model, it can take the form shown in Figure 5. This model defines the correlation between the balanced scorecard’s five functional domains and the organizational strategies. Each field’s pertinent indicators are defined by this model, some of which can be input or output:
We can integrate these indicators in a unified manner if we demonstrate the inputs and outputs of five domains in the form of x ij and yri, where i = (1,..., m and r = (1,..., s). Therefore, based on the nature of inputs and the multiple CCR model, the unit being evaluated will be as follows (Aryanezhad et al. [21]):
max       r = 1 s u r y r s . t .             r = 1 s u r y r j i = 1 s v i x i j 0               ,               j = 1 , 2 , 3 , 4 , 5                                       i = 1 m v i x i o = 1                                             u r o                                   ,                     r = 1 , , s                                                     v i o                                   ,           i = 1 , , m                                                              
We understand that the significance of different domains in a balanced scorecard varies depending on the type and the organization’s assignment. The significance of the domains must therefore be determined in addition to the efficiency calculated using the strategy model. It is worth noting that the importance of each domain in the model mentioned above varies depending on the organizational framework. From a different angle, senior management can establish boundaries between departments to maximize organizational utility. As a result, we characterize a band (upper and lower limits) in each domain in the collection, the values of which show the significance of each domain. The degree of importance of each card must be determined if o1 to o5 is a balanced scorecard and OT is assumed to be the overall strategy. This is done by establishing the lower limit and upper limit for each domain. The importance of the kth domain of a balanced scorecard is referred to as Fk. It is equivalent to the inputs of the same card divided by the total inputs for inputs and the outputs of the same card divided by the total outputs for outputs. As a result, Fk is described as follows:
F o k = r o k U r Y r p r = 1 U r p                                   k = 1 5  
F i k = r o k V i X i p i = 1 m V i X i p                                   k = 1 5  
The significance of inputs and outputs must now be established. It is preferable to set this significance in an upper and lower range of each card for this important process. The following equations result from defining the upper and lower limits of each domain as [Lk, UR]:
L o k   F k =   r o k U r Y r p r = 1 Y r p U o k                               j  
L i k   F k =   i o k V i X i p i = 1 m V i Y i p U i k                               j  
The integrated BSC–DEA model will be as follows if the constraints mentioned above are added to the primary model:
M a x           r 1 s u r Y r j s . t                 r = 1 s U r Y i j       0                 ,                 j = 1 , . , n i = 1 m V i X i 0 = 1 L o k r o r U r Y i p r o U r Y i p                                           U o k                         k = 1 5 L i k r o r U r Y i p r o U r Y i p                                           U o k                         k = 1 5 U r     0                         ,                       r = I ,   , s V i     0                         ,                     i = I ,   , m
In real-world issues, it is clear that management lacks adequate control over all indicators. It is evident that the integrated model should be developed in accordance with this significant trend. The indicators in Figure 6 are classified as controllable or uncontrollable.
We are aware that the uncontrollable index needs to be taken into account in the numerical model so that management cannot influence or change it. Based on the uncontrollable indicators in the character of the input, the integrated DEA–BSC model will be as follows:
M a x r = 1 r D y s u r y r o s . t           r = 1 r D y s u r y r j + r N D y u r ( y r j y r p ) i = 1 s v i x i j i N D x V i ( X i j X i p ) 0   ,     j = 1 . . n         i = 1 m v i x i 0 = 1 i o k U r Y r p + L o k r o t U r Y r p 0                                 k = 1 5 r o k r D y r D y U r Y r p U o k r o t r D y i D x U Y r p 0                                 k = 1 5 i o k i V X i p + L i k i o t V i X i p 0                                 k = 1 5 i o k i D x V i X i p U o k i o t i D x V i X i p 0                                 k = 1 5 u r 0     ,     r = 1 , , s v i 0     ,     r = 1 , , m  
The DEA technique is used to evaluate the organization every time the BSC is executed in the integrated method. The organization will achieve the favored and anticipated performance situations if the objectives established for the previous period are accomplished. This indicates that in all periods, the organization is compared to the anticipated situations of the earlier period, and new efficiency and objectives are established. The calculation of efficiency also takes into account uncontrollable inputs and outputs that will not change or have an impact on the following period. However, the influence of external, uncontrollable factors on an organization should be minimized by defining the controllable indicators as precisely as possible.

5. Results Analysis Model Implementation

The stages that should be taken into consideration in the design of a scorecard integration system and data envelopment analysis were explained in the preceding sections. In this section, we explain the implementation of this integrated system in Shahriar Municipality. We first gathered indicators for this crucial procedure employing the balanced scorecard’s five domains. Based on the types of input and output, the selected indicators are grouped, and the organization provides the data for each one.
The indicators chosen for the balanced scorecard’s five aspects, along with their input or output character, are shown in Table 2. It is important to note that these indicators were developed using library research and a professional team in the discipline of social responsibilities. After interviewing specialists and studying the literature on the topic, we collected three informing and culture-making indicators for urban services: the quantity of advertisements disseminated to enhance traffic culture and the indicators of environmental pollution reduction.
As it was said, in order to identify the investigated indicators, 75 indicators were first identified through library studies and interviews. In practice, however, a large number of indicators can cause ambiguity and deviation for decision-makers. Kaplan and Atkinson announced that to implement a standard balanced scorecard, the number of indicators should be between 10 and 25. In order to select the final indicators, the specified indicators were provided to the experts and with the help of the questionnaire, 21 indicators were finally approved.
The expansion of tourism services is an unmanageable indicator among the above indicators and in the domain of customers. Owing to the fact that it has additional trustees, the municipality does not have sole authority over this matter. As a result, this index is uncontrollable.
The weights of each balanced scorecard category must then be calculated. We can employ the hierarchical structure (AHP) shown in Figure 7 for this critical process. As a result, the specialists were requested to offer their viewpoints by filling out a pairwise comparison table between the five parallel scorecard domains until the relative weights and significance of each aspect were determined by employing the AHP method.
As a first step, we use the experts’ recommendations to develop a matrix of pairwise comparisons (Table 3).
The following results were acquired by entering the matrix of pairwise comparisons into the Expert Choice software (Table 4).
The upper and lower limits for each domain of the balanced scorecard are determined with the assistance of the expert team and are shown in Table 5 because they are required by the numerical model.
According to the tables, the financial sector and customers are given the most weight. Municipalities place a high priority on their finances, and many of their operations are governed in part because doing so will boost their financial assets. A low priority is given to the field of social responsibilities. According to the investigations, this domain is still not recognized as a necessity and an essential factor in generating sustainable income. This field will undoubtedly become much more significant in the management of municipalities in the future.
The importance of the five areas of the balanced scorecard has been obtained by taking into account the opinion of experts in the urban area (Table 3), and of course, we should know that these results depend to a large extent on the area under investigation. In larger cities with different cultures, different results may be obtained. We know that the social responsibilities of municipalities can be mentioned from development in the fields of transportation, architecture, urban planning and green space to even programs to fight poverty, addiction, begging, social harm, and other issues and problems of society. The issue of public transportation in a metropolis like Tehran has become one of the main tasks of municipalities, but this is not among the priorities of the municipalities in many cities.
Ferdowsieh, Vahidie, Sabashahr, Shahed Shahr, Andisheh, Baghestan, and Shahriar are the seven municipalities that comprise Shahriar Municipality, which has seven departments in total. The processing was carried out using the provided numerical model after gathering the necessary data and completing the data tables; the results are displayed in Table 6.
Table 6 shows that Andisheh City’s municipality is more effective and productive than those of other cities. The next two ranks are held by the municipalities of Shahriar and Vahidie.
Each municipality’s five domains were evaluated independently, and the results are shown in Table 7:
We cannot analyze the network model with connections between domains because each domain in Table 7 was evaluated individually and independently. In comparison to other cities, Ferdowsieh performs poorly in the financial sector, despite the fact that the findings of the other domains demonstrate that they do not perform well. The results of an analysis of cities based on various domains are demonstrated in the form of a graph (Figure 8).
As shown, compared to the other municipalities, the municipalities of Andisheh and Shahriar have significantly better conditions in all five aspects. In terms of sustainable development issues, social responsibilities, with its financial aspect being important from the perspective of municipal managers, should be seen as one of the most crucial foundations of municipalities today. Superior performance was shown by the three municipalities of Andisheh, Baghestan, and Shahryar. This function has both positive and negative aspects.
Considering the network structure of the model based on the interaction model between the five balanced scorecard domains depicted in Figure 2, this connection is established, as illustrated in Figure 9. The network model is sequential, and the customer and social responsibilities domains are grouped together in a single box.
The following network multiple model is derived if we prefer to take the uncontrollable indicators into account when considering the numerical model of the aforementioned structure:
max     e p = i = 1 s U r Y r p S . T   :   i = 1           i & D m 4 V i X p = 1 r = 1 s U r Y r j i = 1         i ϵ D m 8 V i X i j i = 1 i N D m 8 V i ( X i j X i 0 ) 0         j = 1 , n d = 1 D η r Z r j i = 1         i ϵ D m 1 V i X i j i = m i N D m 8 V i ( X i j X i 0 ) 0         j = 1 , n f = 1 F γ r T r j d = 1         m 8 λ i Z d j i = m 2 i D m 8 V i X i j i = m 3 i N D m 4 V i ( X i j X i 0 ) 0         j = 1 , n e = 1 E π e H e j f = 1       F γ f T f j i = m 4 m 8 V i X i j i = m 7 i N D m 8 ( X i j X i 0 ) 0         j = 1 , n r = 1 s U r Y r j e = 1         E π e H e j i = m 6 m 7 V i X i j i = m 7 i ϵ N D m 8 ( X i j X i 0 ) 0         j = 1 , n                                                                                     γ f           ε                 ,   π e   ε             U r ε               , V i ε           η d ε
The growth of tourism services is an uncontrollable indicator, according to the indicators in Table 2 and Table 8 considering the important note in the field of customers.
Customers and social responsibility are taken into account in the model above, but if we want to assess them independently, the network structure corresponds to that depicted in Figure 10.
If this model is used, then the findings are as shown in Table 9.
According to the findings in Table 9, the municipalities of Andisheh and Shahriar performed relatively well. Andisheh municipality is efficient in four domains and ineffective in only the growth and learning domain. In light of the fact that the system has a network structure, this unit should focus more on this domain.
As can be seen in Table 9, Andishe municipality is ineffective in the field of growth and learning but efficient in other areas. It should be said that in the time-series system, the efficiency of the whole system is efficient when all its subcomponents are efficient. Therefore, the functionality of the following components is not definitely efficient. Perhaps, with changes in the efficiency of the growth and learning area, the other components may become ineffective.

6. Conclusions

In this paper, it was intended to evaluate the performance of the municipalities of Shahriar city with a combined method of balanced scorecard and data coverage analysis. First, in accordance with the goals and strategies of the municipality, and in order to create balance and coordination between its various indicators, the balanced scoring card (BSC) was created according to the structure of the municipalities. We know that one of the topics that has received much attention in recent years in municipalities is adherence to social responsibilities. Therefore, in the design of the balanced scorecard model, in addition to the four areas (growth and learning, process, customer, finance), the area of social responsibility has been added to it. The field of social responsibility is, in fact, an effort to understand and respond to the expectations of the organization’s stakeholders in society, and it is very important. The balanced scorecard model, which is one of the innovations of this article, should be evaluated with similar units in Shahriar city, which comprise seven municipal units. Therefore, the network data coverage analysis model has been written in the form of a balanced scorecard. The combined model of these two tools (BSC–NDEA) has been able to consider all indicators in a balanced way.
The network model was investigated and analyzed in two cases, i.e., when two areas of customer and social responsibilities are examined in the form of one area. Additionally, the two mentioned areas have an independent personality. In the first case, the average efficiency is 0.789, and Andisheh municipality is efficient and Wahidiye municipality has the lowest efficiency. The average efficiency in the second case is equal to 0.72 for the joint domain and 0.714 for the domain of social responsibilities, which are very close to each other. Ferdowsie has the lowest efficiency in social responsibilities with a value of 0.476. The results show that in the cities of Shahryar and Andisheh, social responsibilities are highly important (Andisheh = 1 and Shahryar = 0.891). Surveys show that the more we move toward the big cities, the social responsibilities are more important. Therefore, the municipalities of big cities and metropolises should focus more on social responsibilities.
The results show that, in Shahryar city, the field of customer is more important than social responsibilities, but it seems that in big cities like Tehran, this difference is not noticeable and perhaps the field of social responsibilities is more important (which can be suggested as a future study). The results indicate that the two cities of Shahryar and Andisheh have far better results than the other cities.
Research Limitation:
1-
The issue of developing a balanced scorecard required the use of experts in the urban area. This issue depends greatly on the cultural atmosphere of the area. Therefore, first, the number of experts in the urban area in the region was low, and second, there was also a sharp difference in the opinions of the experts in the investigated area.
2-
The concept and understanding of social responsibilities are not the same in the seven subcategory cities. Therefore, it required much time to unify the concept and understanding for different cities.

Author Contributions

Writing—review and editing, Y.C.; writing—review—editing and Supervision, H.S.; Validation, E.M.; Software, A.A.; All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

The model and relevant data involved in the research process have appeared in the paper.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kaplan, R.S.; Norton, D.P. Translating Strategy into Action: The Balanced Scorecard; Harvard Business School Press: Boston, MA, USA, 1996. [Google Scholar]
  2. Charnes, A.; Cooper, W.W.; Lewin, A.; Seiford, L.M. Data Envelopment Analysis: Theory, Methodology and Applications; Kluwer Academic Publishers: Hingham, MA, USA, 1994. [Google Scholar]
  3. Charnes, A.; Cooper, W.W.; Rhodes, E. Measuring the efficiency of decision making units. Eur. J. Oper. Res. 1978, 2, 429–444. [Google Scholar] [CrossRef]
  4. Charnes, A.; Cooper, W.W.; Wei, Q.L.; Huang, Z.M. Cone-ratio data envelopment analysis and multi-objective programming. Int. J. Syst. Sci. 1989, 20, 1099–1118. [Google Scholar] [CrossRef]
  5. Kaplan, R.S.; Norton, D.P. The balanced scorecard: Measures that drive performance. Harv. Bus. Rev. 2005, 83, 172. [Google Scholar]
  6. Kaplan, R.S.; Norton, D.P. Using the balanced scorecard as a strategic management system. Harv. Bus. Rev. 1996, 75–85. [Google Scholar]
  7. Kao, C.; Hwang, S.-N. Efficiency decomposition in two-stage data envelopment analysis: An application to non-life insurance companies in Taiwan. Eur. J. Oper. Res. 2008, 185, 418–429. [Google Scholar] [CrossRef]
  8. Färe, R.; Grosskopf, S. Intertemporal Production Frontiers: With Dynamic DEA; Kluwer Academic Publishers: Boston, MA, USA, 1996. [Google Scholar]
  9. Färe, R.; Grosskopf, S. Productivity and intermediate products: A frontier approach. Econ. Lett. 1996, 50, 65–70. [Google Scholar] [CrossRef]
  10. Färe, R.; Grosskopf, S. Network DEA. Socio-Econ. Plan. Sci. 2000, 34, 35–49. [Google Scholar] [CrossRef]
  11. Färe, R.; Whittaker, G. Intermediate input model of dairy production using complex survey data. J. Agric. Econ. 1995, 46, 201–223. [Google Scholar] [CrossRef]
  12. Färe, R.; Grabowski, R.; Grosskopf, S.; Kraft, S. Efficiency of a fixed but allocatable input: A non-parametric approach. Econ. Lett. 1996, 56, 187–193. [Google Scholar] [CrossRef]
  13. Färe, R.; Grosskopf, S.; Whittaker, G. Network DEA. In Modeling Data Irregularities and Structural Complexities in DEA; Zhu, J., Cook, W.D., Eds.; Springer: New York, NY, USA, 2007; pp. 209–240. [Google Scholar]
  14. Ghasemi, N.; Najafi, E.; Hoseinzadeh Lotfi, F.; Movahedi Sobhani, F. Assessing the performance of organizations with the hierarchical structure using data envelopment analysis: An efficiency analysis of Farhangian University. Measurement 2020, 156, 107609. [Google Scholar] [CrossRef]
  15. Entezam, H.F.; Sobhani, F.M.; Najafi, S.E.; Roshdi, I. A multicomponent enhanced Russell measure of efficiency: With application to water supply plans. Socio-Econ. Plan. Sci. 2020, 70, 100719. [Google Scholar] [CrossRef]
  16. Najafi, E.; Aryanegad, M.; Lotfi, F.; Ebnerasould, A. Efficiency and effectiveness rating of organization with combined DEA and BSC. Appl. Math. Sci. 2009, 3, 239–265. [Google Scholar]
  17. Namakin, A.; Najafi, S.E.; Fallah, M.; Javadi, M. A New Evaluation for Solving the Fully Fuzzy Data Envelopment Analysis with Z-Numbers. Symmetry 2018, 10, 384. [Google Scholar] [CrossRef]
  18. Amado, C.A.F.; Santos, S.P.; Marques, P.M. Integrating the Data Envelopment Analysis and the Balanced Scorecard approaches for enhanced performance assessment. Omega: Int. J. Manag. Sci. 2012, 40, 390–403. [Google Scholar] [CrossRef] [Green Version]
  19. Dwivedi, Y.K.; Hughes, L.; Ismagilova, E.; Aarts, G.; Coombs, C.; Crick, T.; Eirug, A. Artificial intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy. Int. J. Inf. Manag. 2021, 57, 101994. [Google Scholar] [CrossRef]
  20. Asosheh, A.; Nalchigar, S.; Jamporazmey, M. Information technology project evaluation: An integrated data envelopment analysis and balanced scorecard approach. Expert Syst. Appl. Int. J. 2010, 37, 5931–5938. [Google Scholar] [CrossRef]
  21. Najafi, E.; Aryanezhad, M. A BSC-DEA approach to measure the relative efficiency of service industry: A case study of banking sector. Int. J. Ind. Eng. Comput. 2011, 2, 273–282. [Google Scholar]
  22. Basso, A.; Casarin, F.; Funari, S. How well is the museum performing? A joint use of DEA and BSC to measure the performance of museums. Omega 2018, 81, 67–84. [Google Scholar] [CrossRef]
  23. Lin, C.; Ting, S.-F.; Lee, L.; Lin, S.-T. Firm capability assessment via the BSC and DEA. Ind. Manag. Data Syst. 2021, 567–593. [Google Scholar] [CrossRef]
  24. Chen, T.Y.; Chen, L. DEA performance evaluation based on BSC indicators in- corporated: The case of semiconductor industry. Int. J. Product. Perform. Manag. 2007, 56, 335–357. [Google Scholar] [CrossRef]
  25. Asadpour, E.; Pouya, A.; Motahari Farimani, N. Designing a Balanced Scorecard Dynamic Model for Evaluating Bank Branch Performance. Ind. Manag. Perspect. 2018, 7, 163–197. [Google Scholar]
  26. Avakoli Golpayegani, M.; Alam Tabriz, A.; Amiri, M.; Motemeni, A. Designing and Explaining Performance Evaluation Model with Integrated Data Envelopment Analysis, Factor Analysis and Weights. Ind. Manag. Perspect. 2015, 5, 76–144. [Google Scholar]
  27. Akbarian, M.; Najafi, E.; Tavakkoli-Moghaddam, R.; Hosseinzadeh-Lotfi, F. A network-based data envelope analysis model in a dynamic balanced score card. Math. Probl. Eng. 2015, 2015, 914108. [Google Scholar] [CrossRef]
  28. Momeni, E.; Lotfi, F.; Saen, R.; Najafi, E. Centralized DEA-based reallocation of emission permits under cap and trade regulation. J. Clean. Prod. 2019, 234, 306–314. [Google Scholar] [CrossRef]
Figure 1. Balanced scorecard framework.
Figure 1. Balanced scorecard framework.
Buildings 13 00242 g001
Figure 2. Five domains of the balanced scorecard in the municipality.
Figure 2. Five domains of the balanced scorecard in the municipality.
Buildings 13 00242 g002
Figure 3. Cause and effect relationship in the balanced scorecard.
Figure 3. Cause and effect relationship in the balanced scorecard.
Buildings 13 00242 g003
Figure 4. The overall structure of the recommended DEA and BSC integrated model.
Figure 4. The overall structure of the recommended DEA and BSC integrated model.
Buildings 13 00242 g004
Figure 5. Generalized integrated model of the scorecard and data envelopment analysis.
Figure 5. Generalized integrated model of the scorecard and data envelopment analysis.
Buildings 13 00242 g005
Figure 6. Data envelopment analysis and the integrated scorecard model with uncontrollable data.
Figure 6. Data envelopment analysis and the integrated scorecard model with uncontrollable data.
Buildings 13 00242 g006
Figure 7. Hierarchical organization of a balanced scorecard.
Figure 7. Hierarchical organization of a balanced scorecard.
Buildings 13 00242 g007
Figure 8. Diagram of various municipalities according to the balanced scorecard aspects.
Figure 8. Diagram of various municipalities according to the balanced scorecard aspects.
Buildings 13 00242 g008
Figure 9. The network structure of the issue based on the BSC aspects.
Figure 9. The network structure of the issue based on the BSC aspects.
Buildings 13 00242 g009
Figure 10. Network model of the BSC structure.
Figure 10. Network model of the BSC structure.
Buildings 13 00242 g010
Table 1. Some papers about the DEA–BSC topic.
Table 1. Some papers about the DEA–BSC topic.
No.AuthorsResearch Explanation
1Najafi, E.; Aryanezhad, M [21]The integrated model of the balanced scorecard and data envelopment analysis (2018) based on a case study was used to assess the relative efficacy of the pharmaceutical companies that are stock exchange members. The research population consisted of pharmaceutical companies that are stock exchange members (22 companies); the whole selected population was incorporated into the research via the census method. Eventually, some factors of long-term development and increased efficiency in pharmaceutical companies have been focusing on the issue of research and development in the pharmaceutical industry, as well as endeavors toward joint production with international pharmaceutical companies.
2C Amado, S Santoz, P Margues [24]They assessed decision-making units from various perspectives and combined the balanced scorecard method with another non-parametric technique known as data envelopment analysis. This integration is accomplished through various and associated models that cover four aspects of performance assessment. Monetary and financial aspects, customers, internal processes, and learning and growth are the four aspects. The benefit of this conceptual model has been examined in assessing the performance of a multinational corporation in two business domains. This article offers recommendations for the effective use of DEA and its integration with BSC in order to support the process of uninterrupted learning and increase implementation effectiveness.
3Akbarian, Najafi and Tavakkoli Moghaddam [25]They investigated the balanced scorecard’s data envelopment analysis model. Managers’ most important requirements are time performance evaluation and strategy. A balanced scorecard with a strategic objective and data envelopment analysis were employed as qualitative and quantitative instruments to assess performance, respectively. In order to measure efficiency through time, a hybrid framework of the BSC and DEA models is suggested in this paper, along with a strategy based on the time delay of the crucial performance indicators of a BSC model. A dynamic BSC is what is initially thought of as the relationship between time and perspective in the BSC model. The efficiency of nine subsidiary refineries of the National Iranian Oil Distribution and Refining Company (NIORDC) is afterward measured through time using a new targeted function and in conjunction with the strategy after the DEA network’s structure has been established.
4Najafi, Aryanegad and Hosseinzadeh Lotfi [13]The authors performed investigations on the integrated DEA–BSC model to rank the organizations’ efficiency. To accomplish the objectives of control, planning, etc., management must measure the performance of the production system. In order to create a regional network DEA model that takes into account the interrelationships of the BSC in the system, this research’s methodology combines the balanced scorecard and data envelopment analysis. By analyzing the efficiency, input, and output of the integrated model (DEA–BSC) are determined in the cards categorized with the related BSC, allowing the process that results in the system’s inefficient performance to be distinguished for subsequent improvements. Eventually, the suggested method was tested in a case study involving six bank branches.
5Asosheh, Nalchigar Jamporazmey [26]The integrated model approach of data envelopment analysis and balanced scorecard was used to assess the information technology project.
This study takes two major approaches. First, it recommends a new approach for IT project selection by combining the two methods of balanced scorecard BSC and data envelopment analysis. This approach defines IT project evaluation criteria using BSC as a comprehensive framework and ranks IT projects using DEA as a non-parametric technique. Second, by combining (ordinal) and (cardinal) data, this study presents a novel hybrid DEA model that determines the most effective IT project.
6Kádárová [27]This researcher concentrated on an innovative hybrid model (BSC–DEA). One of the most essential management tools for measuring performance is data envelopment analysis. On the other hand, one of the most commonly used management tools is the balanced scorecard. Numerous investigations focus on novel approaches to modifying the balanced scorecard and data envelopment analysis, frequently by developing new models in conjunction with other methods. However, very few investigations have attempted to combine these two methods and compare the findings. A thorough performance and efficiency management system for industrial companies and their processes has been created in this study by combining the DEA and BSC methods.
7Shafiee, Hosseinzadeh Saleh and Lotfi [28]The evaluation of supply chain (SC) performance, which incorporates a variety of criteria, is one of the most difficult decision-making issues for managers, although there have been numerous investigations on the balanced scorecard perspective (BSC) approach to supply chain performance evaluation. The connection between the BSC approach’s four goals has not been a central focus of these investigations. To accomplish this, all of the correlations between the four objectives of BSC were determined first, and the network structure was obtained using the DEMATEL approach. A network DEA model was built using this network structure. A data envelopment analysis model was employed for this kind of evaluation because performance evaluation cannot be calculated by BSC. Furthermore, a novel viewpoint based on network DEA with perspective of BSC is developed after reviewing different tools used to assess supply chain performance. Eventually, this model was implemented in the Iranian food industry to assess the performance of the supply chain, and the findings demonstrated the high efficiency of designed model. Various assessment processes in different industries can utilize these findings.
8Basso et al [22]The authors investigated the relative efficiency of the museums of Venice by combining the data coverage analysis and the balanced scorecard. The indicators were examined and extracted in the four areas of the scorecard, and finally, their relative evaluation was measured with the data coverage analysis.
Table 2. Selected indicators for measuring the effectiveness of the evaluated units.
Table 2. Selected indicators for measuring the effectiveness of the evaluated units.
AspectIndicatorIndicator Type
Growth and learningThe number of educated and specialized employees in the municipalityinput
The amount of training in municipal service per person per dayinput
The level of skill of employees in work tasksoutput
Occupational satisfaction of employeesoutput
Internal processNumber of employees input
The volume of outsourcing to the private sectorinput
Manufacturing rate of urban development mapsoutput
Elements installed in the cityoutput
CustomersThe volume of citizens’ contribution to the worn-out fabric renovationinput
Attracting the contribution of financial resources from domestic and foreign investorsinput
Growth of tourism servicesoutput
Per capita growth of green spaceoutput
FinancialThe budget for municipality’s technical and executive plans and projectsinput
Growth of tolls and other receivable incomesoutput
The amount of incomes and gains from urban operations and servicesoutput
Social responsibilityInforming and culture-making in the field of urban servicesoutput
The amount of advertisements disseminated to promote traffic cultureoutput
Environmental pollution reductionoutput
Table 3. Balanced scorecard dimensions of pairwise comparison matrix.
Table 3. Balanced scorecard dimensions of pairwise comparison matrix.
Growth and LearningInternal ProcessesCustomersFinancialSocial Responsibilities
Growth and learning13573
Internal processes1/31353
Customers1/51/3131/3
Financial1/71/51/311/5
Social responsibilities1/31/3351
Table 4. The weight of the balanced scorecard domains.
Table 4. The weight of the balanced scorecard domains.
Social ResponsibilitiesFinancialCustomersInternal ProcessesGrowth and Learning
0.1320.3860.2030.1440.135Weight
Table 5. Upper and lower limits of balanced scorecard domains.
Table 5. Upper and lower limits of balanced scorecard domains.
Social ResponsibilitiesFinancialCustomersInternal ProcessesGrowth and Learning
Upper LimitLower LimitUpper LimitLower LimitUpper LimitLower LimitUpper LimitLower LimitUpper LimitLower LimitUpper and Lower Limit
0.20.10.40.20.30.22.50.10.250.1
Table 6. Evaluation results.
Table 6. Evaluation results.
ShahriarBaghestanAndishehShahed ShahrSabashahrVahidieFerdowsieh
0.94150.775610.79390.69700.83430.7430
Table 7. Evaluation results.
Table 7. Evaluation results.
Efficiency
MunicipalityGrowth and LearningInternal ProcessesCustomersFinancialSocial Responsibilities
Ferdowsieh0.6570.7860.8720.5890.894
Vahidie0.7680.6980.6900.6890.739
Sabashahr0.5920.3670.6750.7240.823
Shahed Shahr0.6490.5780.6880.6220.798
Andisheh0.9631110.968
Baghestan0.7030.8790.7940.8971
Shahriar110.9370.9271
Table 8. Serial evaluation results.
Table 8. Serial evaluation results.
MunicipalityGrowth and LearningInternal ProcessesCustomer and Social ResponsibilitiesFinancial
Ferdowsieh0.5560.7230.7860.476
Vahidie0.64506090.6140.621
Sabashahr0.5010.3450.6890.645
Shahed Shahr0.5870.5120.7010576
Andisheh0.878111
Baghestan0.6450.7980.8120.786
Shahriar110.8890.897
Table 9. Serial evaluation results.
Table 9. Serial evaluation results.
MunicipalityGrowth and LearningInternal processesCustomersFinancial Social Responsibilities
Ferdowsieh0.5560.7230.7540.7120.476
Vahidie0.6450.6090.6030.5080.621
Sabashahr0.5010.3450.6120.6340.645
Shahed Shahr0.5870.5120.5670.7540.576
Andisheh0.8781111
Baghestan0.6450.7980.6890.8930.786
Shahriar110.8450.9860.897
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Chaharlang, Y.; Soleimani, H.; Mehdizadeh, E.; Alinezhad, A. Introduction of an Integrated System for Measuring the BSC and DEA-Based Performance of Social Systems Using Uncontrollable Factors: A Case Study of Shahriar Municipalities. Buildings 2023, 13, 242. https://doi.org/10.3390/buildings13010242

AMA Style

Chaharlang Y, Soleimani H, Mehdizadeh E, Alinezhad A. Introduction of an Integrated System for Measuring the BSC and DEA-Based Performance of Social Systems Using Uncontrollable Factors: A Case Study of Shahriar Municipalities. Buildings. 2023; 13(1):242. https://doi.org/10.3390/buildings13010242

Chicago/Turabian Style

Chaharlang, Yusof, Hamed Soleimani, Esmaeil Mehdizadeh, and Alireza Alinezhad. 2023. "Introduction of an Integrated System for Measuring the BSC and DEA-Based Performance of Social Systems Using Uncontrollable Factors: A Case Study of Shahriar Municipalities" Buildings 13, no. 1: 242. https://doi.org/10.3390/buildings13010242

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop