2. Materials and Methods
The research presented here is divided into three phases:
Prior to the activity,
The activity or gymkhana (team competition game in which the participants must overcome a series of tests that can be of ingenuity, ability, physical, or sports along a route),
After the activity.
Although the activity (Phase 2) is the part in which the objective of this research is put into play, to understand it, it is necessary to contemplate the other two phases.
Thus, in the phase prior to the gymkhana, a training course was held for the teachers who were going to participate in the activity. This training was sponsored by the Center for Training, Innovation, and Educational Resources (CEFIRE) of Alcoy, with a duration of 10 h and with the participation of 28 teachers from a total of 13 secondary schools in Alcoy and other nearby towns, such as Ibi, Muro de Alcoy, Bañeres de Mariola, Biar, Ontinyent, and Castalla. The teachers, although there were practically all specialties, were mostly teachers in the areas of science and technology. The age of the teachers was also very varied, from 28 to 58 years. Their participation in this training was completely voluntary, and they found out about it thanks to the dissemination that the CEFIRE makes of its training actions. In this training, in addition to addressing the technical and management issues necessary to subsequently carry out the gymkhana, strategies and dynamics were discussed with which to work and make students aware of the environmental problems of the city. This course was focused on dealing with the issues of: noise pollution, the preservation of diversity and more specifically of urban flora, uncontrolled dumping of urban solid waste, and other issues on the sustainability of the urban environment. In this way, it was ensured that these teachers would subsequently deal with both the technical and competence issues in digital technology and the environmental dynamics with their respective students. Strategies and dynamics were discussed with which to work and make students aware of the city’s environmental problems.
Additionally, the phase after the completion of the gymkhana had its focus on the evaluation of the activity. For this purpose, an ad hoc questionnaire was prepared and provided to all the participating teachers, so that they could distribute it among the students who participated in the activity.
2.1. Activity
In the days prior to the activity, the teaching staff of the participating centers, and after having been trained in the aforementioned training course, instructed their students in the different applications to be used, in the technical and functional requirements of mobile devices, and in all travel, organizational, and other issues, so that the students could get around the city autonomously on the day of the activity.
The activity takes place during a morning of a school day. The students that day do not have the usual classes and dedicate the whole morning to this activity. Since it is carried out outside the educational centers (in an urban environment: the city of Alcoy), it is considered an extracurricular activity. However, it is an activity that will be evaluated (through rubrics carried out in the previous training) and taken into account by the participating teachers in their respective subjects.
In this, helped by their smartphones, as well as by public transport and making use of augmented reality and social networks, they have to complete a route through 6 different points of the city. At each of these points, they must perform a test and also post a photo or a short video on the social network Instagram [
29]. Said photos and videos must be labeled with the hashtags of the activity: #ALCada22 and #WMCP22 (in the case of this latest edition). Participation in the latest editions, since this gymkhana is held every year, has been quite numerous and has had an average of 9–10 educational centers from Alcoy and other nearby cities (Bañeres de Mariola, Muro de Alcoy, Castalla, Biar, Ibi), as well as a total of 400–500 students participating in each edition.
In the gymkhana, secondary school students, organized in small groups (5–6 students), had to move around the city of Alcoy, with the aim of completing an itinerary with 6 points of interest that were assigned to them by means of cards (6 in total, 1 for each point of interest to visit, including point geolocation data, one question, and a related clue, as shown in
Figure 1). The cards had been distributed at the beginning of the day. Between 9:00 a.m. and 1:00 p.m. of the same day they had to complete this route.
There are a total of 60 different points of interest, each with its own card, which, as they are printed in several sets of 60, allow them to be mixed and randomly distributed 6-by-6 to the groups of participating students, thus generating many possible combinations of different paths. In addition, each group of students had a transport card that allowed them to make, free-of-charge, as many trips as needed by all the people in the group with urban buses and during that day. In order to monitor and control the movements made by the students during the activity, they were monitored at all times by their teachers, since they had an application (Life 360) installed on their mobile devices that allowed them to know their location in real time. Likewise, each participating student was provided with an identification tag for the activity, and the relevant permits had also been requested from both the local police and the national police and civil guard of Alcoy. The students also had the necessary applications installed on their smartphones to carry out a series of tests that they had to carry out, one test at each point of interest, choosing one of the following (see
Table 1) at each point:
The three videos and the three photos resulting from their passage through the 6 points of interest on their route had to be uploaded from open accounts to the social network Instagram and with the labels or hashtags of the day, #ALCada22 and #WMCP22, generating between all participating students a collaborative and geolocated map with images and videos of the entire city of Alcoy, represented by the 60 selected points of interest. The activity in the streets of Alcoy had to end at 1:00 p.m., since at that time, all the participants had to go to a sports center in the center of the city, where once everyone was present, a small closing ceremony was held with the delivery of a small detail to the participants.
As has already been mentioned, once the activity was finished, the participating teachers were asked to invite their students to fill out a short questionnaire to evaluate the activity in the two days following the gymkhana.
2.2. Data Collection Instruments
Ad hoc questionnaire was prepared through Google Forms (as can be seen in
Appendix C), including three socio-demographic questions (sex, age, and school), and 8 students’ perception questions in a five-point Likert scale about: the whole experience (general objective of this research); each of the 6 activities in the 6 points of interest visited (specific objective 2); students’ self-perception regarding improvement of their awareness and concern for environmental problems (specific objective 1). Finally, the questionnaire included three open questions: one for the overall qualitative assessment of the activity by the students and another two in which they had to highlight those aspects that they liked the most and least. The quantitative results were treated with the statistical software IBM SPSS version 25 and the qualitative ones were treated with the ATLAS.ti 9 program.
2.3. Participants
As already indicated, prior to the gymkhana, a training course was held with 28 teachers from 13 educational centers, although in the end, 4 of these teachers, belonging to 4 other centers, did not participate in the gymkhana with their students, making the total number of participating teachers in the end 24 and the number of centers 9.
The participating students were from a total of 331 belonging to 9 secondary schools. Seven of these centers were from the city of Alcoy itself (CE01, CE02, CE03, CE04, CE05, CE06, and CE07), and the other 2 from the nearby cities of Bañeres de Mariola and Muro de Alcoy (CE08 and CE09), as can be seen in
Table 2.
The vast majority of the students participating in the gymkhana had barely heard of the preparation of this SDG activity before. Additionally, the use they made of their smartphones was very limited to the use of WhatsApp and social networks, practically all of them unaware of other uses that can be given to the mobile, such as geolocation, augmented reality, the use of applications to know the position of the urban buses in real time, etc. The previous experience in the use of smartphones for educational use was practically nil. Additionally, they did not know about the trees and plants in their city and had not heard of noise pollution before.
In the evaluation questionnaire, of the total number of students participating in the gymkhana (n = 331), given its voluntary nature, 214 participated (n = 214), 64.6%, which makes it a significant sample, with a level of confidence of 99% and a margin of error of 5.28%. Of the 214 students who participated in the post-activity evaluation questionnaire, it was found that there was a greater presence of women (n = 110, 51.4%), compared to men (n = 96, 44.9%), and a small percentage of non-binary sex, 3.7% (n = 8). Possibly, this last number is not so high and is due to the fact that the students have answered in a non-serious way. The age of the participants ranges between 14 and 17 years (average 15.34 years, mode 15).
Table 3 compares the total number of students who participated with those students who completed the activity evaluation questionnaire.
The participation of the centers in the evaluation questionnaire was not homogeneous, and in three of them (C01, C07, and C08), it was below 50% and it also coincided that they are the same 3 centers that had a participation below the average.
3. Results
3.1. Overall Results
In the global evaluation question of the activity as a whole, using a Likert-type evaluation scale that goes from 1: not at all to 5: a lot, the #ALCada22 activity obtained an average value from the students of 3.35 (deviation typical: 1.147 and variance: 1.316). For the question that collected the degree of improvement in their level of awareness and concern for environmental problems, they obtained a much higher average than that of the activity as a whole (slightly more than 1 point above), with this being 4.37 (standard deviation: 0.573 and variance: 0.328). The average assessment of each of the activities proposed in the gymkhana can be seen in
Table 4, with their corresponding codes, where F01, F02, and F03 correspond to the tests with photos and V01, V02, and V03 to the tests with videos.
From these latest results, it can be deduced that the activity, as a whole, enjoys an average rating higher than those obtained by each of the tests carried out individually. Additionally, within these tests, the two that had the greatest acceptance were the making of a video with some typical dance of Moros and Cristianos, as well as the making of a BookFace. The two tests that are closely related to environmental education and urban environmental sustainability, although they were not the worst valued, were placed in a discreet third and fifth place.
3.2. Results According to the Different Variables
It is interesting to see the results obtained when contemplating the variations that exist in the assessment of both the activity as a whole, and each of the tests were carried out individually. Thus, in
Table 5, we can see this variation according to the sex of the participants and in
Table 6 according to age.
As can be seen in the results of
Table 6, in relation to the low scores obtained in all the categories for the non-binary sex, and as previously mentioned, the answers given have very possibly been made by students who have taken the evaluation questionnaire with little seriousness and have responded in a toxic way, so we are not going to take them into account.
Regarding the differences found between men and women, it is quite notorious to highlight that, in regard to the two tests that interest us on environmental education and for sustainability, it can be observed that, in the case of women, they find a value that presents 37 and 42 tenths less than in the case of men. For the tests of a more artistic and creative nature (such as the BookFace or the recreation videos of typical party dances), it is in the women where scores are obtained that are 10 and 38 tenths higher than those of the men. Additionally, notable, in a negative sense, is the ever-recurring worse assessment, both in men and women, of the test of recitation of poems in the native language. The Student’s t-test has been carried out for all the activity tests, and it is, indeed, verified that the differences are significant between men and women both in the tests in question: noise pollution record (t = 2.049; p = 0.042) and in the plants identification (t = 2.476; p = 0.014), such as the video recording tests of a typical dance (t = −2.329; p = 0.021) and of a video interview (t = −2.178; p = 0.031).
In the videos, although it is confirmed in
Table 6 that, between 14 and 16 years of age, the older the participant, the worse the assessment obtained from said tests; in the case of proofs with photos, one cannot speak of any regularity.
3.3. Qualitative Results
Of the qualitative results, special attention must be paid to those related to the purpose of this research and the tests that had to do with the environmental and sustainable education of the students.
The responses were categorized into different categories, according to their thematic. In general terms, the general evaluation of the activity was clouded by many comments that highlighted the great inconvenience represented by the presence of rain throughout the activity (n = 121) and that, at times, it was very annoying. On the positive side, the development of the digital competence of the students (n = 148) and the carrying out of activities outside the center (n = 135) stood out, for the most part.
Going on to assess those positive aspects indicated by the students, the most outstanding and frequent ones, concerning the topic at hand, were:
Live outside the classroom with other students (n = 76),
Learn interesting things about my city (n = 53),
Learn to use public transport (n = 41),
Know and identify the trees and plants of my city (n = 32),
Identify those areas of my city with the highest noise pollution (n = 27).
Some examples of these comments were:
“What I liked the most was being able to learn in a fun way, outside the center, to identify plants and trees in my city, as well as to measure the levels of noise pollution that we find in the streets.”—ST061
“I really liked the tests, especially those in which we had to use mobile applications to identify trees and measure the noise of cars and motorcycles.”—ST124
4. Discussion
Although the majority of studies carried out on the use of didactic itineraries as a resource for learning coincide in affirming that the use of smartphones, augmented reality, geolocation, and social networks help to improve interest, motivation, and learning among students [
35,
46,
49,
50,
51,
52,
53]; on this occasion, we cannot affirm the same, since a very discreet result was obtained. One of the reasons that explains this poor result, compared to a notable result obtained on a previous occasion with a very similar approach [
35], is the fact that, on the day of the activity, despite having been postponed and rescheduled twice for the same reason, the rain made its appearance, with this being, at some times of the day, quite intense and annoying.
However, it can be celebrated that the assessment that students give to the degree of improvement in their awareness and involvement with the environment and sustainability in an urban environment reached a remarkable value. In similar actions, with secondary school students and the use of mobile phones, changes in opinion and awareness about the socio-environmental challenge were also observed [
54]. Additionally, it can be celebrated that the tests related to this aspect are well-valued, without becoming the most widely accepted, but not the least, either. It is worth noting that, although no notable differences were observed, with respect to the age of the participants, in the case of gender, it was observed that women value tests related to environmental issues worse than men; on the other hand, they value better than men those tests that are more related to creativity and artistic expression.
Another aspect that does not coincide with the studies carried out to date is that it seems that the preference for videos, over taking photos, has been taking place among young people in recent years [
35,
55,
56,
57], which already in this study is not so clear; thus, although there are some tests in which this is confirmed, the same does not happen with the BookFace test (F03), which triumphs over others that involve the making of a video.
It is clear that the use of digital technology and, more specifically, the use of smartphones with augmented reality, geolocation, and social networks allows us to motivate and generate interest between learning and a respect, appreciation, and awareness of a necessary action with the environment. This is made clear by other previous studies [
35,
58,
59], and here, the more than remarkable assessment about the degree of improvement in their level of awareness and concern for environmental problems demonstrates and reaffirms it.
5. Conclusions
The use of gymkhanas or itineraries with mobile devices as a resource to take learning to the street, to the context and the reality closest to the students, that is the city, has always given positive results in all the experiences carried out. Additionally, having a consistent and combined use of digital technologies brings great benefits when it comes to secondary school students, since they live immersed in a world where they are heavily involved in the use of smartphones and social networks. If, in addition to all this, it is intended to improve awareness and appreciation of the environment, making students aware of the problems with which we find ourselves and promoting the production of an action, in addition to awareness, then the results are even more positive.
Activities such as the one carried out here show that urban sustainability is a possible solution close to adolescent students, which, although with evaluations that are not excellent, do allow us to predict that this is the way to train citizens who are prepared to promote a better world, i.e., more sustainable and environmentally friendly. Quite possibly, the non-appearance of the rain, as well as a better preparation of the participating teachers in environmental issues to be dealt with in the activity and in how to propose activities with their students based on the development of participatory and playful skills and strategies, would have allowed for better results.
For future interventions, both the training and planning on the dates to carry out the activity could be improved. Taking learning out of the classroom and making use of the urban environment is something that must continue to be performed and promoted in secondary schools and institutes, in order to allow students to get closer to the reality we live in first-hand and to know how to see those risks and problems that we face today, in order to tackle them in the present and the immediate future.
In future lines of research, it is intended to present the activity with numerous changes, which allow for an improvement in the assessment of the activity, as this will result in greater learning and greater environmental awareness.