Next Article in Journal
Do Judgments of Learning Impair Recall When Uninformative Cues Are Salient?
Previous Article in Journal
Modulating Visuomotor Sequence Learning by Repetitive Transcranial Magnetic Stimulation: What Do We Know So Far?
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Perception of the Level of Competency of Candidates for Graduation: A Multidisciplinary Approach to Complex Thinking

by
José Carlos Vázquez-Parra
1,
Marco Cruz-Sandoval
2,* and
Paloma Suárez-Brito
1
1
Institute for the Future of Education, Tecnologico de Monterrey, Monterrey 64849, Mexico
2
Center for the Future of Cities, Tecnologico de Monterrey, Monterrey 64849, Mexico
*
Author to whom correspondence should be addressed.
J. Intell. 2023, 11(10), 202; https://doi.org/10.3390/jintelligence11100202
Submission received: 13 August 2023 / Revised: 10 October 2023 / Accepted: 16 October 2023 / Published: 20 October 2023

Abstract

:
Complex thinking is a cognitive skill that focuses on the integrated analysis and synthesis of information with a systemic and critical perspective that enables creative decision-making in the face of complex realities or challenges. At the educational level, it is valued as a transdisciplinary competency, meaning it is relevant for individuals regardless of their profession or field of study. This article presents the results of measuring the perceived achievement of complex thinking among 830 graduating students from a technological university in Mexico, aiming to identify possible significant differences based on their discipline or major. Methodologically, a multivariate descriptive statistical analysis was performed using R and RStudio software, including calculation of means and standard deviations, violin plots, boxplot and ANOVA significance analysis, and t-test. The results show that the differences were not statistically significant in all the disciplines, although it is possible to note significant differences, which reveals a differentiated behavior in the process of formation and development of complex thinking according to the discipline of study. In conclusion, the present study shows that the students’ areas of training are associated with differences in perception of complex thinking and its associated sub-competencies, thus differentiating this ability in their graduation profile. This article contributes to the existing literature on the formation and development of complex thinking and its sub-competencies as relevant professional skills for lifelong learning.

1. Introduction

Complex thinking is the cognitive ability to understand reality integrally, recognizing the connections between different elements and the unpredictability and uncertainty that characterize the current world (Tobón and Luna 2021). It stands on a global multidisciplinary approach that seeks to avoid simplifications and reductionism by addressing issues broadly and holistically (Vertovec 2023). At the professional level, the importance of this skill is acknowledged for tackling challenges in society, industry, and contemporary work, making it a competency applicable in all disciplines (Cheon et al. 2019). In this regard, complex thinking becomes increasingly important in university education, considering that any future professional, regardless of their background, must confront problems that transcend a single discipline, requiring more comprehensive skills employing multiple viewpoints to comprehend and solve complex challenges (Baena et al. 2022).
At the professional level, the challenges faced by contemporary organizations are typically interconnected, uncertain, and dynamic. Therefore, to address such issues, it is essential to have personnel with sufficient and relative cognitive abilities (Hiver et al. 2021).
Based on the above, the objective of this article is to present the results of measuring graduating students’ perceived achievement of complex thinking competency and its sub-competencies at a technological university in Mexico. This sample includes students from the six disciplines offered by this institution: Humanities and Education, Social Sciences and Government, Engineering, Health Sciences, Business, and Architecture and Design. This study aimed to identify the level of competency perceived by students at the end of their educational process, identify possible disciplinary and career differences, and lay the groundwork for future studies on the relevance of promoting complex thinking as a transversal competency applicable to graduates’ profiles in any educational institution. To achieve this, a multivariate descriptive statistical analysis was performed using R (4.2.2 version) and RStudio (2023.6.0.421 version) software, including calculation of means and standard deviations, violin plots, boxplot and ANOVA significance analysis, and t-test.

1.1. Theoretical Framework

1.1.1. Complex Thinking as a Transdisciplinary Competency

There is no doubt that a characteristic of the current world, especially after the COVID-19 pandemic, is the uncertainty and volatility of social and cultural systems, which comprise multiple interconnected elements interacting in unpredictable ways (Alkhatib 2019). Thus, a complex world requires sufficient relevant skills, making complex thinking an ideal competency.
It is important to note that there is no agreed definition of what complex thinking is; however, studies on this competence tend to adhere to certain academically established visions (Melo et al. 2020), which for this specific research will be the approach of the French sociologist and philosopher Edgar Morin. According to Morin (1990), complex thinking is a cognitive ability developed by individuals that allows them to understand reality with its inherent complexity, avoiding the simplification and reductionism of systems and phenomena.
Unlike more traditional approaches, complex thinking is holistic and integrative, analyzing phenomena not in isolation but based on understanding relationships, interactions, and patterns within complex systems (Horn et al. 2022). It allows for recognizing the uncertainty and ambiguity of reality, employing multiple perspectives, and tolerating constantly changing environments.
Being a high-level cognitive competency, complex thinking comprises other sub-competencies that provide versatility and adaptability in approaching the environment, such as systemic thinking, scientific thinking, critical thinking, and innovative thinking (Vázquez-Parra et al. 2022). These sub-competencies allow individuals to develop an integrated view of reality, enabling them to address challenges in their personal and professional spheres (Cruz-Sandoval et al. 2023b).
Specifically, systemic thinking allows for a global understanding of phenomena, recognizing connections between elements and their interactions (Jaaron and Backhouse 2018). Scientific thinking uses objective and validated methods to solve problems, emphasizing the importance of evidence (Koerber and Osterhaus 2019). Critical thinking involves questioning and reevaluating existing knowledge to address current needs and assessing and enriching information (Cui et al. 2021). Finally, innovative thinking goes beyond critical thinking to include cognitive and operational aspects and personal variables like motivation and flexibility to generate socially and culturally accepted new products and solutions (Saienko et al. 2021). While each sub-competency can be acquired and developed in isolation for their cognitive value, the integrated exercise of all four achieves a genuinely integrated vision of approaching complex problems (Ramírez et al. 2021).
Logically, this holistic, systemic, and broad perspective of reality makes complex thinking transdisciplinary, meaning it can be applied to address problems and challenges that transcend the boundaries of a single discipline (Drucker 2021). Many issues within work environments tend to break disciplinary barriers, requiring diverse viewpoints and the cognitive elements characteristic of various academic areas (Sherblom 2017). In this sense, complex thinking integrates different disciplinary approaches, contributing to a more relevant professional vision that aligns with the current needs of industries and professions. From a pedagogical perspective of challenge-based learning, training in complex thinking brings a wide range of advantages, as it enables students to develop skills to recognize interconnections, work collaboratively, integrate multiple perspectives and visions into their decision-making process, and develop a more comprehensive and profound understanding of reality (Silva 2020).
In addition to this, there are other benefits of complex thinking training, as reported by several authors (Zhou 2021; Vázquez-Parra et al. 2022; Castillo-Martínez et al. 2022):
  • The ability to understand problems from various angles for action, providing more robust, well-argued, and innovative solutions;
  • The ability to adapt and be flexible in the face of constant changes in industry, market evolution, and professional needs;
  • A broad vision of the causes and roots of problems and the potential consequences of actions, considering elements that may be overlooked in linear thinking;
  • Development of an innovative and creative perspective, facilitating new routes for solving identified issues;
  • Promoting multidisciplinary collaboration, fostering teamwork, and recognizing the richness of diverse knowledge and perspectives.
In this regard, the relevance of complex thinking training is irrespective of the career or discipline of education, as the skills provided by this cognitive competency are valuable for any professional (Vázquez-Parra et al. 2023a, 2023b). Universities must undertake specific actions to identify how complex thinking is acquired and developed in their curricula. This study provides a valuable approach to understanding how to adopt this competency in the graduation profiles of students from different disciplines.

1.1.2. State of the Art

Based on the above, the reflection of complex thinking as a pedagogical competence has been considerably addressed by previous studies, although focusing on concrete elements such as certain disciplines or its intersection with social or behavioral factors of students and teachers.
Antonio et al. (2004) present the effects of racial diversity on the development of complex thinking in a group of students from three universities, discussing how social context and interactions in the face of racial diversity influence the level of development of complex thinking. At the teaching level, Zepke (2011) reports a study in which he seeks to understand how complex thinking can influence not only students’ engagement with their subjects but also their teachers’ motivation. Meanwhile, Forsman et al. (2014) studied the level of complex thinking in university students in the disciplines of physics and engineering, analyzing how having a high level of complex thinking can influence the retention level of students, providing tools to view and analyze complex educational issues in higher education in terms of nested, interdependent and interconnected systems. Tobón and Luna (2021) link the development of complex thinking competence with training in sustainable social development, considering that the cognitive skills developed by a complex thinker are very appropriate for teaching contemporary social challenges.
It is important to note that the present study arises as a result of the research work of a research group dedicated to the study of complex thinking, and therefore, there are relevant antecedents regarding this cognitive competence. It is possible to mention some previous studies that made a measurement similar to the one proposed in this article but that did not consider students who were candidates to graduate, which made the results not accurate because they did not consider the closure of the university process (Vázquez-Parra et al. 2022). There are also other studies that have paid more attention to the gender element, certain sub-competencies associated with some specific disciplines, and even relevant social factors in the Latin American context (Cruz-Sandoval et al. 2023a; Carlos-Arroyo et al. 2023).
The intention of making these remarks is to highlight the originality and value of the present study, as it is the first reflection that considers such a large group of graduating students from all disciplines.

2. Materials and Methods

A random convenience sample of 830 students (455 Men and 377 Women) in the last semester of all the disciplines offered by the institution (Humanities and Education, Social Sciences and Government, Business, Engineering, Architecture and Design, and Health Sciences) included data collected during 20–24 April 2023, from an orientation course for graduate candidates organized by the Campus Life and Professional Development Center. The students responded voluntarily to a self-administered questionnaire digitalized on the Google Forms platform. Table 1 shows more information regarding the characteristics of the sample.
Although the population was not proportional among the disciplines, it did correspond to the characteristics of the institution’s student body. Being a technological university, most careers in the sample population corresponded to engineering. Also, this institution has gained recognition for its business training, which shows in the number of sample participants in this discipline. The other areas correspond to the number of students in their majors.

2.1. Ethical Considerations

Since this exploratory study involves human beings, its implementation was supervised and approved by the interdisciplinary research group R4C, and it had the technical support of the Writing Lab of the Institute for the Future of Education of Tecnologico de Monterrey.
As part of this supervision, the personal information that the present study could use was regulated, considering that, for the objectives of this research, it was sufficient to have access to the results of the questionnaire, the discipline, the study career, and the gender of the participants. For this reason, there is no further information associated with the sample. Additionally, it was determined that the implementation process of the instrument would be self-administered, sending a link to the questionnaire to the participants’ homes. The implementation process was only for the collection of information related to this instrument, i.e., it did not consider additional questions or information. In order to answer the instrument and access the items, the individual had to accept the privacy notice and the terms and conditions assigned by the institution for this type of research. This ensured that all participants expressed their consent and prevented their responses from being influenced by any implementer.

2.2. Instrument and Data Analysis

This study employed the validated eComplexity instrument to measure participants’ perception of their mastery of complex thinking and its sub-competencies. The eComplexity instrument has the objective of measuring the level of perception of achievement that participants have of the complex thinking competency and its sub-competencies. It is an instrument that has been validated both theoretically and statistically, as well as by a team of experts in the field (Castillo-Martínez et al. 2022). As for the structure of the instrument, it is made up of 25 items divided into three sub-competencies, systemic thinking, scientific thinking, and critical thinking, and each of these three sub-competencies was, in turn, divided into three areas: knowledge, skills, and attitudes or values. Although the instrument was shown to have high validity and reliability, after statistical analysis, modifications were made considering the observations of the experts. The improved version was validated with 443 participants who evidenced the reliability with the internal consistency of the instrument for complexity reasoning competence (Ramírez et al. 2021). The validation procedure of the eComplexity instrument consisted of a first phase of theoretical validation, as well as an expert validation was performed to validate the content of the instrument. Based on the theoretical and content validation by means of expert judgment, it was determined that the eComplexity instrument is highly valid and reliable (Castillo-Martínez et al. 2022). The items are a set of statements related to characteristics associated with their sub-competencies:
  • I have the ability to find associations between variables, conditions, and constraints in a project;
  • I identify data from my discipline and other areas that contribute to solving problems;
  • I participate in projects that need to be solved using inter/multidisciplinary perspectives;
  • I organize information to solve problems;
  • I enjoy learning different perspectives on a problem;
  • I am inclined to use strategies to understand the parts and the whole of a problem;
  • I have the ability to identify the essential components of a problem to formulate a research question;
  • I know the structure and formats for research reports used in my area or discipline;
  • I identify the structure of a research paper used in my area or discipline;
  • I apply the appropriate analysis methodology to solve a research problem;
  • I design research instruments consistent with the research method used;
  • I formulate and test research hypotheses;
  • I am inclined to use scientific data to analyze research problems;
  • I have the ability to critically analyze problems from different perspectives;
  • I identify the rationale for my own and others’ judgments to recognize false arguments;
  • I self-evaluate the level of progress and achievement of my goals to make the necessary adjustments;
  • I use reasoning based on scientific knowledge to make judgments about a problem;
  • I make sure to review the ethical guidelines of the projects in which I participate;
  • I appreciate criticism in the development of projects in order to improve them;
  • I know the criteria for determining a problem;
  • I have the ability to identify variables from various disciplines that can help answer questions;
  • I apply innovative solutions to diverse problems;
  • I solve problems by interpreting data from different disciplines;
  • I analyze research problems, contemplating the context to create solutions;
  • I tend to evaluate, with a critical and innovative sense, the solutions derived from a problem.
The analysis of the eComplexity instrument considers the evaluation of both the general competency (complex thinking) and each of its sub-competencies (systemic, scientific, innovative, and critical thinking). In this sense, the general competency includes all the items, while in the case of the sub-competencies, these consider specific items: systemic thinking (1–6), scientific thinking (7–13), critical thinking (14–19), and innovative thinking (20–25).
To analyze the data, we used a multivariate descriptive statistical approach through the R software (R Core Team 2017), version 4.2.2, and Rstudio (RStudio Team 2022), version 2023.6.0.42. This analysis included calculating mean values and standard deviations to describe the distribution and variability of the dataset. The mean and standard deviation are basic descriptive statistics that offer valuable insight into the centrality and dispersion of the data. These metrics are the first approach that provides a comprehensive understanding of the data distribution. The mean value, representing the center of the distribution, allowed for finding the balance point of the data, while the standard deviation measured the variability from the mean value. Additionally, we produced violin plots to visualize the density of the data distribution, a graphical tool introduced by Hintze and Nelson (1998). This plot is a visual instrument that combines the features of a Boxplot with a Kernel Density Distribution. One of its primary strengths is that it not only illustrates the central tendency and spread of the data but also its probability density. This aids in pinpointing where the data clusters and where observations are infrequent. It is an essential tool in descriptive analyses, especially when the objective is to comprehend the core structure of the data and the nature of its distribution. Subsequently, significance analyses tested differences in mean values through Analysis of Variance (ANOVA) and t-tests. ANOVA is a statistical approach designed to compare the means of three or more independent groups, identifying if there are statistically significant differences between them. One of its primary strengths is its ability to assess multiple groups concurrently, thereby reducing the risk of committing a Type I error, also known as an alpha error or false positive (i.e., when a true null hypothesis is incorrectly rejected). This analysis is crucial in studies that seek to elucidate the effects of categorical variables with three or more categories on a continuous outcome variable. On the other hand, the t-test or Student’s t-test is a statistical tool used to determine if there are significant differences between the means of two groups. These tests were performed with a 95% confidence interval, employing a p-value of 0.05.

3. Results

Table 2 presents the results of students’ perceived achievement of complex thinking and its sub-competencies, broken down by disciplines. The data reveal that students in Health Sciences had the highest perception of the overall competency (complex thinking; mean 4.50), while students in Architecture, Art, and Design demonstrated the lowest mean (4.22). Regarding the sub-competency of systemic thinking, students in the School of Humanities and Education perceived themselves with the highest development (4.54), whereas students in the School of Architecture, Art, and Design showed the lowest mean (4.06). Notably, students in the School of Health Sciences perceived the highest development in scientific thinking (4.44), critical thinking (4.56), and innovative thinking (4.52). On the other hand, students in the School of Humanities and Education had the lowest perceived achievement in the sub-competency of scientific thinking (4.12). Regarding critical thinking, students in the School of Social Sciences and Government had the lowest mean in perceived achievement (4.35). Finally, in innovative thinking, students in Architecture, Art, and Design perceived themselves with the lowest achievement (4.25).
Figure 1 presents the students’ perceived achievement of the complex thinking competency. The results show that students in the School of Health Sciences have a significantly higher perception of achievement in this competency than students from other disciplines.
Figure 2 is a boxplot analysis comparing the students’ perception of complex thinking per discipline and the data dispersion. The analysis reveals that, although the mean values are relatively similar between the disciplines, the least dispersion occurs in the Social Sciences and Government, Humanities and Education, and Health Sciences schools. In contrast, the Architecture, Sciences and Engineering, and Business students had a wider data dispersion in the mean values of perceived complex thinking.
Figure 3 shows the analysis of the distribution of students according to their perception of different sub-competencies of complex thinking in their area of study. Students in Health Sciences and Humanities and Education had a higher concentration of high values in the perceived achievement of systemic thinking. In contrast, students in the Engineering and Sciences and Business schools had a distribution with lower values in this sub-competency. Notably, the Humanities and Education and Architecture schools had the highest distribution of low perceived achievement values in scientific thinking. Regarding critical thinking, there is a notable high distribution of values of high perceived achievement among the School of Health Sciences students. Similarly, in innovative thinking, the School of Health Sciences also presented a high distribution of students with an elevated perception of this skill.
Table 3 presents the results of the ANOVA analysis of the mean values of students’ perceived achievement in the competency of complex thinking and its sub-competencies. The analysis aimed to determine if significant statistical differences existed between the disciplines in students’ perceived achievement. We used a significance level of p < 0.05. The results showed that there were indeed significant differences between disciplines in the sub-competencies of systemic thinking and innovative thinking, as well as the overall competency of complex thinking.
Table 4 analyzes the perceived achievement of complex thinking in different areas of the School of Engineering and Sciences. Note that students who showed a higher perception of development in complex thinking majored in Digital Transformation (4.66), Data Science (4.56), and Electronic Technologies (4.51). In contrast, the Robotics and Digital Systems majors had the lowest perception of development in this competency (3.88).
Figure 4 shows the students’ perceived achievement of complex thinking in different careers in the School of Engineering and Sciences, showing the mean values and their respective standard deviations.
Table 5 presents the ANOVA analysis to evaluate significant differences in the mean values of perceived achievement in complex thinking by students in different majors in the School of Engineering and Sciences. The analysis results indicate no significant differences (p-value of 0.14) between the careers regarding the perception of achievement in this competency.
Table 6 shows the analysis of students’ perceived achievement of complex thinking in the School of Business. The results highlight that the students in the Business Administration career had the highest perception of achievement (4.50), while the students in Business Intelligence perceived the least development (4.07).
Figure 5 presents the mean values and standard deviations of the perception of achievement in the complex thinking competency among students in the School of Business, broken down by major. Note that Business Administration, Accounting and Finance, and Business Development careers had the highest average values in perceived development of complex thinking.
Table 7 analyzes significant differences in the means of the complex thinking competency among students in different careers at the School of Business. An analysis of variance (ANOVA) examined these differences, with results indicating significant differences in perceived achievement among the students attending this school (p-value of 0.01).
Regarding the careers of the School of Social Sciences and Government, Table 8 reveals that International Relations students had the highest perceived achievement of complex thinking (4.36) compared to Law students (4.22).
Figure 6 shows the mean values and standard deviations of perceived complex thinking competency among students with Social Sciences and Government majors. The International Relations students had the highest perceived achievement (4.36) and the most variability (SD 0.43).
Table 9 shows the t-test on the means of the students’ perceived achievement in the two careers of the School of Social Sciences and Government. The results indicate no significant differences in the perception of this competency (p-value of 0.46).
Table 10 presents the analysis of mean values and standard deviations on the perceived achievement of complex thinking by students of the School of Architecture, Art, and Design. The results indicate that Architecture students had the highest perception (4.31), while Digital Art students had the least (4.07).
Figure 7 complements the results of the previous table. Although the students in the Design major showed a slightly lower perception of complex thinking (4.27) compared to the Architecture students, they had the lowest standard deviation (0.51).
Finally, Table 11 presents the analysis of significant differences in mean values of students in the Architecture, Art, and Design careers concerning the development of complex thinking. The ANOVA analysis shows no significant difference in competency development between the students in the three majors (p-value of 0.19).
These analyses were not done for the Humanities and Education and Health Sciences disciplines because their samples reflected only one professional career.

4. Discussion and Conclusions

This article presented the measurement of graduating students’ perceived achievement of the competency of complex thinking and its sub-competencies in a technological university in Mexico. The sample included students from the six disciplines offered by this institution: Humanities and Education, Social Sciences and Government, Engineering, Health Sciences, Business, and Architecture and Design. The objective was to identify the level of competency perceived by students at the end of their educational process, describe the data behavior of their responses, and identify possible differences between disciplines and majors.
This report highlights nine relevant findings:
  • Students in Health Sciences showed the highest perceived achievement in the overall competency (complex thinking with a mean value of 4.50), while students in Architecture, Art, and Design had the lowest mean (4.22);
  • Regarding the sub-competency of systemic thinking, students in the School of Humanities and Education perceived themselves with the highest achievement (4.54), while students in the School of Architecture, Art, and Design had the lowest mean (4.06). This could be associated with the fact that the training provided by the humanities tends to focus on the identification and analysis of environmental problems, which could influence the students’ greater awareness of systems and their interconnection. However, this assumption would imply that Social Sciences should also yield similar results, which is not the case. In this sense, there is a need for a specific study on this sub-competence to analyze what particular factors could be influencing students’ perception of certain disciplines;
  • Regarding scientific, critical, and innovative thinking, the School of Health Sciences students had the highest mean. It is interesting to note that Health Sciences students are more likely to be trained within the standard positivist scientific paradigm. The influence of this paradigm could be expressed as an overconfidence in scientific skills, which could lead to students developing a better perception of themselves in this sub-competency. This assumption invites the possibility of developing complementary research, in which the perception of health science students can be explored in a concrete way, seeking not only to identify but also to describe the reason for these high results;
  • Students in the School of Humanities and Education showed the lowest perceived achievement of scientific thinking (4.12), students in the School of Social Sciences and Government had the lowest mean (4.35) of critical thinking, and students in Architecture, Art, and Design had the lowest value in innovative thinking (4.25). It is interesting to pay attention to the results for social sciences and architecture, art, and design since their lowest values are in sub-competencies that tend to be more associated with their discipline. One explanation that could be put forward is that since these are cognitive elements more specific to their area of knowledge (critical thinking for social sciences and innovative thinking for architecture, art, and design), their students are more critical and demanding about what they think they know and about the skills they have. It will be interesting to consider further research to explore these results;
  • The study confirmed a statistically significant difference in the results among disciplines for the overall competency and the sub-competencies of systemic thinking and innovative thinking;
  • In the School of Engineering and Sciences, the best perception of complex thinking was in the majors of Digital Transformation (4.66), Data Science (4.56), and Electronic Technologies (4.51). In contrast, Robotics and Digital Systems students perceived the lowest development in this competency (3.88);
  • In the School of Business, the results highlight that Business Administration students show the highest perception of achievement (4.50), while students in Business Intelligence perceived the least development (4.07). On this particular point, it is important to note that the business intelligence career is relatively new and that the participants in this survey are part of the first generation. In this sense, it is understandable that they are more critical with respect to the way they perceive their skills, this being a perception of the way they conceive that this career prepares them for professional challenges and challenges;
  • Regarding the majors in the School of Social Sciences and Government, students in International Relations had the highest perception of complex thinking (4.36) compared to students in Law (4.22). However, the difference was not statistically significant;
  • Finally, regarding the School of Architecture, Art, and Design majors, the results indicate that students in Architecture had the highest development (4.31), while students in Digital Arts perceived themselves with the least (4.07).
Based on these results, it is possible to conclude that, although the differences were not statistically significant in all cases, noticeable differences can be observed, which highlight a differentiated behavior in the perception of the development of complex thinking per the field of study.

4.1. Implications and Future Studies

This research indicates an association between the student’s field of study and their perception of the development of complex thinking and its related sub-competencies. Distinct patterns emerge across disciplines, suggesting variations in how students perceive and develop these competencies upon graduation. As mentioned in the theoretical framework, the competency of complex thinking is highly valued by the job market and contemporary industry, so these results may have implications regarding the opportunities for future graduates and how they face the challenges of their profession. Every educational institution should seek not only the development of competencies and skills but also ensure that this process impacts all students as equitably as possible and guarantee that their processes are as standardized as possible.
In this regard, this study opens the possibility for new research that focuses on each discipline to determine more precisely the process of developing complex thinking in each major. Further studies should not only measure the achieved level but also the improvement through longitudinal measurements that begin when students enter the university and follow until they graduate.
At a practical level, this study provides valuable information for educational institutions interested in developing complex thinking, setting a precedent for those disciplines with deficient competency development that should be strengthened. Furthermore, by identifying disciplines with better results, analyzing their pedagogical practices could help other areas achieve more equitable development. From a theoretical perspective, this study contributes to existing knowledge about the development of complex thinking and its sub-competencies, as well as the perceived achievement of professional education students. Although previous studies exist, few are in Latin American realities and with disciplinary differentiation, which gives these results more value, impact, and originality.

4.2. Limitations

The present study is limited in several ways. First, the research occurred in a single institution, which makes its results not exhaustive, definitive, or generalizable. Also, not having an initial measurement means not knowing whether the participants effectively developed the competency during their professional education or had already achieved it. Thirdly, it has not been possible to guarantee a large sample of all the careers; however, we can say that the sample is representative, although it is in accordance with the number of graduates, which in some cases are very few. A fourth limitation, which is very relevant to point out, refers to the nature of the scale used, which focuses only on the self-perception of the development of competencies. In this sense, there is a possibility that some students may have biased perceptions that are affecting the results, and therefore, this is a limitation of this type of study. It will be necessary in future studies to compare these results with objective data on the measurement of competencies. Despite these limitations, these results are valuable on an exploratory level, and, as mentioned before, they should be expanded with complementary studies and measurements.

Author Contributions

Conceptualization, J.C.V.-P., M.C.-S. and P.S.-B.; Methodology, J.C.V.-P., M.C.-S. and P.S.-B.; Software, M.C.-S.; Validation, M.C.-S.; Formal analysis, J.C.V.-P., M.C.-S. and P.S.-B.; Investigation, J.C.V.-P., M.C.-S. and P.S.-B.; Resources, J.C.V.-P.; Data curation, M.C.-S.; Writing–original draft, J.C.V.-P., M.C.-S. and P.S.-B.; Writing–review & editing, J.C.V.-P., M.C.-S. and P.S.-B.; Visualization, M.C.-S.; Supervision, J.C.V.-P., M.C.-S. and P.S.-B.; Project administration, J.C.V.-P.; Funding acquisition, J.C.V.-P. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Tecnologico de Monterrey, Challenge-Based Research Funding Program 2022, Tecnologico de Monterrey. Project ID # I001-IFE001-C1-T1–E.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of Writing Lab and Research for Complexity, Institute for the Future of Education, Tecnologico de Monterrey (protocol code 163404).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to privacy and ethical reasons.

Acknowledgments

The authors acknowledge the financial and technical support of Writing Lab, Institute for the Future of Education, Tecnologico de Monterrey, Mexico, in the production of this work.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Alkhatib, Omar. 2019. A Framework for Implementing Higher-Order Thinking Skills (Problem-Solving, Critical Thinking, Creative Thinking, and Decision-Making) in Engineering & Humanities. Paper presented at the 2019 Advances in Science and Engineering Technology International Conferences (ASET), Dubai, United Arab Emirates, March 26–April 10. [Google Scholar]
  2. Antonio, Anthony Lising, Mitchell J. Chang, Kenji Hakuta, David A. Kenny, Shana Levin, and Jeffrey F. Milem. 2004. Effects of Racial Diversity on Complex Thinking in College Students. Psychological Science 15: 507–10. [Google Scholar] [CrossRef]
  3. Baena, Jose Jaime, María Soledad Ramírez-Montoya, Diego Mauricio Mazo-Cuervo, and Edgar Omar López-Caudana. 2022. Traits of Complex Thinking: A Bibliometric Review of a Disruptive Construct in Education. Journal of Intelligence 10: 37. [Google Scholar] [CrossRef]
  4. Carlos-Arroyo, Martina, José Carlos Vázquez-Parra, Marco Cruz-Sandoval, and Arantza Echaniz-Barrondo. 2023. Male Chauvinism and Complex Thinking: A Study of Mexican University Students. Societies 13: 104. [Google Scholar] [CrossRef]
  5. Castillo-Martínez, Isolda Margarita, María Soledad Ramírez-Montoya, and Gabriela Torres-Delgado. 2022. Reasoning for complexity competency instrument (e-Complexity): Content validation and expert judgment. Education in the Knowledge Society, Unpublished work. [Google Scholar]
  6. Cheon, Sung Hyeon, Youngsun Lee, and Johnmarshall Reeve. 2019. The interplay between cultural values, self-determined motivation, and complex problem-solving. Journal of Cross-Cultural Psychology 50: 450–65. [Google Scholar]
  7. Cruz-Sandoval, Marco, José Carlos Vázquez-Parra, Martina Carlos-Arroyo, and Juan Alberto Amézquita-Zamora. 2023a. Student perception of the level of development of complex thinking. An approach in university women in Mexico. Journal of Latinos and Education, 1–13. [Google Scholar] [CrossRef]
  8. Cruz-Sandoval, Marco, José Carlos Vázquez-Parra, Martina Carlos-Arroyo, and Marco Vinicio Del Angel-González. 2023b. Complex Thinking and Its Relevance in Professional Training: An Approach to Engineering Students in a Mexican University. International Journal of Engineering Pedagogy (iJEP) 13: 100–19. [Google Scholar] [CrossRef]
  9. Cui, Liyuan, Yaxin Zhu, Jinglou Qu, Liming Tie, Ziqi Wang, and Bo Qu. 2021. Psychometric properties of the critical thinking disposition assessment test amongst medical students in China: A cross-sectional study. BMC Medical Education 21: 1–8. [Google Scholar] [CrossRef]
  10. Drucker, Johanna. 2021. Sustainability and complexity: Knowledge and authority in the digital humanities. Digital Scholarship in the Humanities 26: 86–94. [Google Scholar] [CrossRef]
  11. Forsman, Jonas, Cedric Linder, Rachel Moll, Duncan Fraser, and Staffan Andersson. 2014. A new approach to modelling student retention through an application of complexity thinking. Studies in Higher Education 39: 68–86. [Google Scholar] [CrossRef]
  12. Hintze, Jerry L., and Ray D. Nelson. 1998. Violin Plots: A Box Plot-Density Trace Synergism. The American Statistician 52: 181–84. [Google Scholar] [CrossRef]
  13. Hiver, Phil, Ali H. Al-Hoorie, and Diane Larsen-Freeman. 2021. Toward a transdisciplinary integration of research purposes and methods for complex dynamic systems theory: Beyond the quantitative–qualitative divide. International Review of Applied Linguistics in Language Teaching 60: 7–22. [Google Scholar] [CrossRef]
  14. Horn, Annemarie, Aukelien Scheffelaar, Eduardo Urias, and Marjolein B. M. Zweekhorst. 2022. Training students for complex sustainability issues: A literature review on the design of inter- and transdisciplinary higher education. International Journal of Sustainability in Higher Education 24: 1–27. [Google Scholar] [CrossRef]
  15. Jaaron, Ayham A. M., and Chris J. Backhouse. 2018. Operationalisation of service innovation: A systems thinking approach. The Service Industries Journal 38: 561–83. [Google Scholar] [CrossRef]
  16. Koerber, Susanne, and Christopher Osterhaus. 2019. Individual Differences in Early Scientific Thinking: Assessment, Cognitive Influences, and Their Relevance for Science Learning. Journal of Cognition and Development 20: 510–33. [Google Scholar] [CrossRef]
  17. Melo, Ana Teixeira, Leo Simon Dominic Caves, Anna Dewitt, Evie Clutton, Rory Macpherson, and Philip Garnett. 2020. Thinking (in) complexity: (In) definitions and (mis)conceptions. Systems Research and Behavioral Science 37: 154–69. [Google Scholar] [CrossRef]
  18. Morin, Edgar. 1990. Introducción al Pensamiento Complejo. Ciudad de México: Gedisa. [Google Scholar]
  19. R Core Team. 2017. A Language and Environment for Statistical Computing. R Foundation for Statistical Computing. Obtenido de. Available online: https://www.r-project.org/ (accessed on 15 January 2023).
  20. Ramírez, María Soledad, Inés Álvarez-Icaza, Jorge Sanabria, Edgar Lopez-Caudana, Patricia Esther Alonso-Galicia, and Jhonattan Miranda. 2021. Scaling Complex Thinking for Everyone: A Conceptual and Methodological Framework. Paper presented at the TEEM’21: Ninth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM’21), Barcelona, Spain, October 26–29; pp. 806–11. [Google Scholar] [CrossRef]
  21. RStudio Team. 2022. RStudio: Integrated Development for R (2022.2.2.485). Obtenido de RStudio, PBC. Available online: http://www.rstudio.com/ (accessed on 15 January 2023).
  22. Saienko, Nataliia, Yuliia Olizko, and Anna Cunha. 2021. Perceptions of Fostering Creative Thinking Skills in ESP Classrooms in Ukraine and Portugal. International Journal of Engineering Pedagogy (iJEP) 11: 23–41. [Google Scholar] [CrossRef]
  23. Sherblom, Stephen A. 2017. Complexity-thinking and social science: Self-organization involving human consciousness. New Ideas in Psychology 47: 10–15. [Google Scholar] [CrossRef]
  24. Silva, Cristián. 2020. Art Education for the Development of Complex Thinking Metacompetency: A Theoretical Approach. International Journal of Art & Design Education 39: 242–54. [Google Scholar] [CrossRef]
  25. Tobón, Sergio, and Josemanuel Luna. 2021. Complex Thinking and Sustainable Social Development: Validity and Reliability of the COMPLEX-21 Scale. Sustainability 13: 6591. [Google Scholar] [CrossRef]
  26. Vázquez-Parra, José Carlos, Berenice Alfaro-Ponce, Juan Bacilio Guerrero-Escamilla, and Luisa Morales-Maure. 2023a. Cultural Imaginaries and Complex Thinking: Impact of Cultural Education on the Development of Perceived Achievement of Complex Thinking in Undergraduates. Social Sciences 12: 272. [Google Scholar] [CrossRef]
  27. Vázquez-Parra, José Carlos, Isolda Margarita Castillo-Martínez, María Soledad Ramírez-Montoya, and Antonio Millán. 2022. Development of the Perception of Achievement of Complex Thinking: A Disciplinary Approach in a Latin American Student Population. Education Sciences 12: 289. [Google Scholar] [CrossRef]
  28. Vázquez-Parra, José Carlos, Martina Carlos-Arroyo, and Marco Cruz-Sandoval. 2023b. Social Entrepreneurship and Complex Thinking: Validation of SEL4C Methodology for Scaling the Perception of Achieved Competency. Education Sciences 13: 186. [Google Scholar] [CrossRef]
  29. Vertovec, Steven. 2023. Superdiversity. In Migrations and Social Complexity. Abingdon: Taylor & Francis. [Google Scholar] [CrossRef]
  30. Zepke, Nick. 2011. Understanding teaching, motivation and external influences in student engagement: How can complexity thinking help? Research in Post-Compulsory Education 16: 1–13. [Google Scholar] [CrossRef]
  31. Zhou, Qian. 2021. Development of creative thinking skills through aesthetic creativity in middle school educational music course. Thinking Skills and Creativity 40: 100825. [Google Scholar] [CrossRef]
Figure 1. Complex thinking bar graph: mean values and standard deviations by discipline.
Figure 1. Complex thinking bar graph: mean values and standard deviations by discipline.
Jintelligence 11 00202 g001
Figure 2. Complex thinking boxplot analysis by discipline.
Figure 2. Complex thinking boxplot analysis by discipline.
Jintelligence 11 00202 g002
Figure 3. Sub-competencies of complex thinking: violin plots of sub-competencies by discipline.
Figure 3. Sub-competencies of complex thinking: violin plots of sub-competencies by discipline.
Jintelligence 11 00202 g003
Figure 4. Complex thinking bar graphic. Analysis of means and standard deviations by career in the School of Engineering and Sciences.
Figure 4. Complex thinking bar graphic. Analysis of means and standard deviations by career in the School of Engineering and Sciences.
Jintelligence 11 00202 g004
Figure 5. Complex thinking bar graph: analysis of means and standard deviations by major in the School of Business.
Figure 5. Complex thinking bar graph: analysis of means and standard deviations by major in the School of Business.
Jintelligence 11 00202 g005
Figure 6. Complex thinking bar graph: analysis of means and standard deviations per career in the School of Social Sciences and Government.
Figure 6. Complex thinking bar graph: analysis of means and standard deviations per career in the School of Social Sciences and Government.
Jintelligence 11 00202 g006
Figure 7. Complex thinking bar graph: analysis of means and standard deviations per career in the School of Architecture, Art, and Design.
Figure 7. Complex thinking bar graph: analysis of means and standard deviations per career in the School of Architecture, Art, and Design.
Jintelligence 11 00202 g007
Table 1. Characteristics of the population sample.
Table 1. Characteristics of the population sample.
DisciplineProfessional CareerSample by Professional CareerSample by DisciplinePercentage of Total
Humanities and EducationCommunications31313.7
Health SciencesMedicine55556.6
Social Sciences and GovernmentInternational Relations16253
Law9
Architecture and DesignArchitecture189811.9
Design54
Digital Art26
EngineeringCivil3138846.7
Industry and systems57
Biotechnology58
Data science and mathematics8
Electronics3
Innovation and development22
Mechanical24
Mechanic administrator10
Biomedical30
Mechatronics50
Chemistry5
Robotics and digital systems4
Computer systems30
Computational technologies 37
Digital transformation2
Electronic technologies6
Information technologies11
BusinessInternational Business3423328.1
Business Administration41
Administration and Finance46
Business Creation and Development10
Accounting and Finance23
Business Development6
Organizational development6
Marketing42
Business intelligence25
Total 830100
Table 2. Competency and sub-competencies of complex thinking. Mean values and standard deviation by discipline.
Table 2. Competency and sub-competencies of complex thinking. Mean values and standard deviation by discipline.
CTSystemicScientificCriticalInnovative
OverallMean4.304.444.194.294.31
SD0.460.460.590.520.55
HEMean4.354.544.124.394.40
SD0.440.410.660.460.46
SSGMean4.304.204.254.354.40
SD0.390.550.440.340.43
HScMean4.504.494.444.564.52
SD0.390.450.540.380.42
AADMean4.224.064.264.364.25
SD0.520.630.610.520.53
EScMean4.294.214.284.434.27
SD0.440.550.540.430.51
BusinessMean4.314.164.344.484.27
SD0.500.610.540.490.57
HE = Humanities and Education; SSG = Social Sciences and Government; HSc = Health Sciences; AAD = Architecture, Art and Design; ESc = Engineering and Science.
Table 3. Complex thinking and sub-competencies: Analysis of significant differences between mean values in perceived achievement among disciplines (ANOVA).
Table 3. Complex thinking and sub-competencies: Analysis of significant differences between mean values in perceived achievement among disciplines (ANOVA).
DfSum SqMean SqF ValuePr (>F)
Systemic Thinking 510.732.146.624.67 × 10−6 *
Scientific Thinking52.720.541.790.11
Critical Thinking52.130.422.050.06
Innovative Thinking53.790.752.790.01 *
Complex Thinking52.850.562.630.02 *
* p < 0.05.
Table 4. Mean values and standard deviations of complex thinking in Engineering and Sciences areas.
Table 4. Mean values and standard deviations of complex thinking in Engineering and Sciences areas.
Complex Thinking
Engineering and SciencesMeanSd
Civil4.380.46
Industrial4.200.48
Biotechnology4.350.40
Data Science and Mathematics 4.560.42
Electronics4.400.52
Innovation and Development 4.250.35
Mechanical4.270.49
Mechanical Administration4.260.32
Biomedical4.290.40
Mechatronics4.290.46
Chemical4.260.61
Robotics and Digital Systems 3.880.35
Computer Systems4.450.40
Computational Technologies4.170.51
Digital Transformation4.660.31
Electronic Technologies4.510.44
Information Technologies4.220.33
Table 5. Complex thinking analysis of significant differences between mean values in perceived achievement between careers in the School of Engineering and Sciences (ANOVA).
Table 5. Complex thinking analysis of significant differences between mean values in perceived achievement between careers in the School of Engineering and Sciences (ANOVA).
DfSum SqMean SqF ValuePr (>F)
184.840.26871.360.14
Table 6. Mean values and standard deviations of complex thinking in School of Business areas.
Table 6. Mean values and standard deviations of complex thinking in School of Business areas.
Complex Thinking
Business MeanSd
International Business4.330.59
Business Administration4.500.41
Administration and Finance4.320.48
Business Creation and Development4.100.37
Accounting and Finance4.430.46
Business Development4.430.34
Organizational Development4.150.35
Marketing4.190.47
Business Intelligence4.070.62
Table 7. Complex thinking analysis of significant differences between mean values in the perception of achievement in the careers of the Business School (ANOVA).
Table 7. Complex thinking analysis of significant differences between mean values in the perception of achievement in the careers of the Business School (ANOVA).
DfSum SqMean SqF ValuePr (>F)
94.980.552.3090.01 *
* p < 0.05.
Table 8. Mean values and standard deviations of complex thinking in Social Sciences and Government.
Table 8. Mean values and standard deviations of complex thinking in Social Sciences and Government.
Complex Thinking
Social Sciences and GovernmentMeanSd
Law4.220.35
International Relations4.360.43
Table 9. Complex thinking analysis of significant differences between mean values in the perception of achievement between careers in the School of Social Sciences and Government (t-test).
Table 9. Complex thinking analysis of significant differences between mean values in the perception of achievement between careers in the School of Social Sciences and Government (t-test).
tdfp-Value
−0.7519.650.46
Table 10. Mean values and standard deviations of complex thinking in Architecture, Art, and Design.
Table 10. Mean values and standard deviations of complex thinking in Architecture, Art, and Design.
Complex Thinking
Architecture, Art, and DesignMeanSd
Architecture4.310.52
Digital Art4.070.53
Design4.270.51
Table 11. Complex thinking analysis of significant differences between means in perceived achievement between careers in the School of Architecture, Art, and Design (ANOVA).
Table 11. Complex thinking analysis of significant differences between means in perceived achievement between careers in the School of Architecture, Art, and Design (ANOVA).
DfSum SqMean SqF ValuePr (>F)
20.870.431.650.19
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Vázquez-Parra, J.C.; Cruz-Sandoval, M.; Suárez-Brito, P. Perception of the Level of Competency of Candidates for Graduation: A Multidisciplinary Approach to Complex Thinking. J. Intell. 2023, 11, 202. https://doi.org/10.3390/jintelligence11100202

AMA Style

Vázquez-Parra JC, Cruz-Sandoval M, Suárez-Brito P. Perception of the Level of Competency of Candidates for Graduation: A Multidisciplinary Approach to Complex Thinking. Journal of Intelligence. 2023; 11(10):202. https://doi.org/10.3390/jintelligence11100202

Chicago/Turabian Style

Vázquez-Parra, José Carlos, Marco Cruz-Sandoval, and Paloma Suárez-Brito. 2023. "Perception of the Level of Competency of Candidates for Graduation: A Multidisciplinary Approach to Complex Thinking" Journal of Intelligence 11, no. 10: 202. https://doi.org/10.3390/jintelligence11100202

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop