Next Article in Journal
The Development of Sustainable Social Farming in Italy: A Case Studies Analysis
Previous Article in Journal
Nano-Priming against Abiotic Stress: A Way Forward towards Sustainable Agriculture
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Determinants of Helpful Hotel Reviews: A Social Influence Perspective

1
Department of Business Administration, Graduate School, Kyung Hee University, 26 Kyungheedae-ro, Dongdaemun-gu, Seoul 02453, Republic of Korea
2
Department of Big Data Analytics, Kyung Hee University, 26 Kyungheedae-ro, Dongdaemun-gu, Seoul 02453, Republic of Korea
3
School of Management, Kyung Hee University, 26 Kyungheedae-ro, Dongdaemun-gu, Seoul 02453, Republic of Korea
*
Author to whom correspondence should be addressed.
Sustainability 2022, 14(22), 14881; https://doi.org/10.3390/su142214881
Submission received: 14 October 2022 / Revised: 8 November 2022 / Accepted: 9 November 2022 / Published: 10 November 2022
(This article belongs to the Section Economic and Business Aspects of Sustainability)

Abstract

:
Online hotel reviews regarding specific experiences and the sensibility of hotel reviewers are important sources of information for consumers who want to book hotels in the future. However, since thousands of reviews are written for one hotel, it is practically impossible for customers to read all the reviews. To alleviate this problem, OTAs (online travel agencies) provide a helpful vote of reviews, helping customers to quickly find helpful reviews without much effort. Therefore, in this study, a ZINB (zero-inflated negative binomial regression) was performed to investigate factors that influence the helpfulness of hotel reviews using the social influence theory. As a result of the analysis, it was found that location, service, and value of the hotel, alongside normative influencing factors and the length of the review (including informational influencing factors), affect the helpfulness of the review regardless of the city. The results of this study are expected to help hotel managers to take remedial action on negative reviews and strengthen the promotion of positive reviews, potentially helping to increase customer satisfaction.

1. Introduction

As the hotel industry is connected to information and communication technology, OTAs (online travel agencies), such as TripAdvisor.com, Expedia.com, and Booking.com, are being activated. Approximately 57% of hotel reservations are made online; therefore, OTAs are essential for the hotel industry. OTAs provide online reviews as well as hotel information, such as rooms, meals, banquet facilities, prices, and hotel ratings in various languages.
In addition to the overall rating, the online hotel review consists of a textual form indicating the rating of cleanliness, location, rooms, service, sleep quality, value, and subjective (positive, neutral, and negative) feedback on the hotel, indicating the customer’s opinion of the hotel [1]. Online reviews of these hotels are directly exposed to the public so that customers who want to use the hotel can easily access them. Therefore, online reviews affect hotel reservations because customers who want to use a hotel can easily compare them with other hotels through online reviews [2,3,4,5]. In other words, online reviews of hotels affect business performance [6,7] and reputation [8], including hotel sales.
However, since thousands of reviews are written for one hotel, it is practically impossible for customers to read all reviews. OTAs provide “helpful votes” of reviews to alleviate this problem, which helps customers to quickly see hotel evaluations without much effort. Therefore, the helpfulness of reviews plays a vital role in enabling customers who want to use the hotel to filter reviews efficiently [9].
Accordingly, many studies have analyzed the factors that influence the helpfulness of reviews on websites such as Amazon.com [10,11,12], Yelp.com [13,14], and TripAdvisor.com [15,16], and found that the helpfulness of reviews is affected by the attributes and behaviors of other reviewers, such as rating and number of friends. However, although many studies have examined the factors that influence the helpfulness of reviews, no studies have determined whether multi-attribute ratings (e.g., ratings for cleanliness, location, rooms, service, sleep quality, and value in hotel reviews) affect the helpfulness of reviews.
Therefore, in this study, the social influence theory was used to find factors influencing the helpfulness of hotel reviews. To this end, we reviewed data from hotels located in New York, Seoul, and Shanghai from TripAdvisor. The reviewed data considers of cleanliness, location, rooms, service, sleep quality, value ratings, review text, helpful votes, and hotel grade. The moderating effect of hotel grade (luxury hotel vs. budget hotel) was investigated by dividing hotels into luxury hotels and budget hotels using hotel ratings.
The results of this study provide strong empirical evidence for evaluating hotel reviews. We also found that there were differences in the multiple attributes affecting review helpfulness according to the grade (i.e., star rating) and geographic location of the hotel. Therefore, the results of this study can make theoretical and practical contributions to the hotel industry.

2. Research Background

2.1. Social Influence Theory

People change their thoughts, feelings, and behaviors by being influenced by people around them and their beliefs and attitudes. In other words, changes in human thinking, emotion, and behavior occur under the influence of others. Social influence theory explains the interpersonal process that changes these group members’ thoughts, feelings, and behavior. Humans are largely affected by normative influence and informational influence of others to change behavior [17]. Normative influence means changing one’s behavior according to one’s specific expectations, attitudes, and behaviors to be liked or recognized by another person. Since humans are social animals, they desire to belong to influential and vital groups rather than living alone. Customers who respond to normative influences tend to meet other people’s expectations through product or service purchases.
On the other hand, informational influence refers to imitating behavior by referring to information obtained by others. In other words, in situations where one cannot trust one’s judgment, people act according to other people’s opinions to make better decisions. Therefore, customers tend to collect information from others and make decisions.
Online reviews affect people who read reviews. Accordingly, many researchers have studied the social influence of online reviews. The authors of [18] investigated the moderating effects of experience goods or search goods to explore factors determining a review’s helpfulness. As a result, they determined that reviewer reputation, identity disclosure, and review depth positively affect the helpfulness of online reviews. Furthermore, they discovered that reviewer identity disclosure has a more significant effect on review helpfulness of experience goods. On the other hand, it was found that the reviewer’s reputation, the review’s degree, and the review’s depth affect the review helpfulness of search goods.
The authors of [19] investigated the effect of activity level and review helpfulness on customer influence. The study found that activity level had a greater influence on customers with high strength of transactional connectivity than customers with low strength, and the impact of customer review helpfulness on influence was stronger for people with high similarity than those with low similarity. The authors of [20] investigated the effect of helpfulness votes on the customer’s perceived helpfulness for the review and whether social influence moderates the relationship between content expression factors and perceived helpfulness. The analysis revealed that reviews with clear positive (or negative) helpfulness votes are more (or less) helpful. In contrast, the helpfulness votes of others reduce the positive effects of structures and the negative effects of spelling errors. The authors of [14] investigated the effect of the order of reviews on the review’s helpfulness from a social influence perspective and found that the order of reviews not only negatively affects the helpfulness of reviews but also weakens the order effect for negative reviews.
Existing studies used review attributes and reviewer attributes to identify determinants of review helpfulness. In particular, only the overall rating was used as a factor for normative influence. However, customers evaluate hotels in multiple dimensions, such as price and location, and other customers use this information to make purchase decisions. Therefore, this study tried to identify the determinants of review helpfulness using the multiple attribute as factors for the normative influence.

2.2. Expectation Disconfirmation Theory

The expectation disconfirmation theory (EDT) is a widely used theory to describe the process of customer satisfaction formation [21]. EDT forms satisfaction or dissatisfaction with the product or service through the following steps [22]. The first step is for the customer to create pre-purchase expectations for a particular product or service. The second step is to evaluate the quality after purchasing a product or service. The third step is to compare the perceived quality with pre-purchase expectations. If the perceived quality is higher than or equal to expectations, the customer is satisfied, but if the perceived quality is lower than expected, the customer is dissatisfied. In the final step, satisfied customers form a willingness to repurchase and spread positive rumors, but dissatisfied customers avoid repurchasing and spread negative rumors.
Therefore, customers have different expectations according to the hotel grade. Customers generally expect high service quality for luxury hotels but relatively low service quality for budget hotels. If the hotel’s service quality is higher than expected, the customer will be satisfied and write a positive review. On the other hand, if the hotel’s service quality is lower than expected, the customer will be dissatisfied and write negative reviews. These reviews influence customers’ decisions to use the hotel in the future.

3. Research Model and Hypothesis Development

In this study, we examine the causal relationship between factors for normative influence (cleanliness, location, rooms, service, sleep quality, and value), factors for informational influence (number of words and sentiment), and review’s helpfulness according to hotel grade.
From this point of view, cleanliness, location, room, service, sleep quality, and value were regarded as normative influencing factors in this study. The number of review words and review sentiment were regarded as informational influencing factors. In addition, this study aims to explain the factors that influence decision-making according to hotel grades using TripAdvisor.com data. Therefore, the model of this study is shown in Figure 1.

3.1. Normative Influencing Factors: Cleanliness, Location, Rooms, Sevice, Sleep Quality, Value

Normative influence is other reviewers’ tendency to conform to previous reviewers’ expectations [14,17,23,24,25]. Therefore, the normative influence refers to the opinions of other reviewers, such as review ratings [2]. The review rating represents the overall satisfaction with a product or service marked with stars (one to five points in numbers) [26]. In other words, reviews with fewer stars mean that reviewers are not satisfied with the product or service, and reviews with more stars mean that they are satisfied with the product or service. Therefore, other customers determine whether a product or service is helpful through the ratings from the previous reviewer [9,10,27].
Many studies have investigated whether review ratings affect helpfulness, and the relationship between review ratings and helpfulness shows largely positive, negative, U-shaped, and inverted U-shaped relationships. For example, [11,28,29] argued that review ratings had a positive effect on helpfulness. However, [30,31] argued that review ratings had a negative effect on helpfulness. On the other hand, [16] argued that the relationship between review rating and helpfulness was a U-shape, and [32] argued that it was an inverted U-shape relationship.
When customers leave a review of the hotel, they evaluate not only the overall rating of the hotel but also six attributes such as cleanliness, location, room, service, sleep quality, and value. The ratings for six attributes contain more specific information about the hotel. For example, it can be inferred that a hotel with a high rating for its location has a good view even if customers do not read the reviews. In addition, customers have various preferences for the six attributes of a hotel. For example, some customers will value the location of a hotel, while others will value the cleanliness of the hotel. Thus, ratings on the six attributes help determine whether a hotel review is as helpful as the overall rating. According to the above discussion, this study proposes the following hypotheses.
H1a. 
The hotel’s cleanliness will significantly affect the review’s helpfulness.
H1b. 
The hotel’s location will significantly affect the review’s helpfulness.
H1c. 
The hotel’s rooms will significantly affect the review’s helpfulness.
H1d. 
The hotel’s service will significantly affect the review’s helpfulness.
H1e. 
The hotel’s sleep quality will significantly affect the review’s helpfulness.
H1f. 
The hotel’s value will significantly affect the review’s helpfulness.

3.2. Informational Influencing Factors: Review Length (Number of Words), Sentiment

Informational influence refers to other reviewers’ tendency to conform to previous reviewers’ opinions based on information, arguments, facts, etc., obtained from previous reviews [14,17,33]. Customers refer to previous reviews of the product or service as it is assumed that the previous reviewer had a better understanding of the product or service [14]. In general, informational influences include argument quality, recommendation framing, etc. [26].
An argument is a piece of information in a review [34], and the quality of the argument is the strength of the message in the review [26,35]. The quality of the argument was measured using the review length, as the number of messages contained in the review helped determine whether the product or service was helpful [10,31,35,36,37,38,39].
Many studies have investigated whether review length affects helpfulness, and the relationship between review length and helpfulness shows a positive or negative relationship. For example, [32] argued that helpfulness decreases as the number of words included in the review of experience and search goods increases. In addition, [13,14,31] argued that increasing the length of the review increases the helpfulness on Yelp.com. The authors of [11] argued that the longer the review length for cell phone, printer, camera, music player, music cd, and video game, the more helpful it is. That is, the review length is related to the richness of hotel information [13]. As longer reviews are more likely to describe the customer’s hotel experience in detail, a longer review helps customers to know more about the hotel. Therefore, in this study, the hypothesis was established as follows.
H2a. 
Review length will significantly affect the review’s helpfulness.
Recommendation framing is defined as positive, neutral, and negative emotions of the message implied in the review [26]. Methods of grasping the emotions of the review are largely LIWC (linguistic inquiry and word count)-based emotion analysis and machine learning-based emotion analysis methods. First, LIWC-based emotion analysis is a method of calculating the ratio of words representing positive emotion and negative emotion within a review and is used in online reviews such as MOOC review [40], hotel booking review [41], restaurant reviews [42] and Amazon product review [43]. Second, machine learning-based emotion analysis is a method of classifying emotions between −1 (negative emotion) and 1 (positive emotion) using an SVM (support vector machine), naive Bayes classifiers, and deep learning, and these methods are mainly performed in algorithmic research.
Customers describe their experiences of the hotel through reviews. In general, customers with good experiences write positive reviews, while customers with bad experiences write negative reviews. As many previous studies have suggested, the review’s sentiment significantly affects its helpfulness [15,44,45]. In other words, because customers have an indirect experience of hotel services through reviews, they share the thoughts and feelings of other customers who have previously used the hotel services. Thus, the more extreme the review sentiment for products and services is, the more helpful it is than neutral emotion. According to the above discussion, this study proposes the following hypotheses.
H2b. 
Review sentiment will significantly affect the review’s helpfulness.

3.3. Moderating Variable: Luxury Hotel vs. Budget Hotel

Hotels can be divided into luxury hotels and budget hotels according to price and room size. When hotels are classified according to their star rating, four or more hotels are called luxury hotels [46,47]. In general, luxury hotel customers expect better hotel services (e.g., room size, information desk open time, foreign language-enabled staff, amenities, etc.) because they pay higher prices than in budget hotels.
Expectation mismatch theory is a theory developed by [22], in which customers are satisfied if the actual performance of a product or service is higher than expected and, conversely, dissatisfied if the actual performance is lower than expected. Therefore, hotel grades (luxury hotel vs. budget hotel) give customers different expectations for hotel services [48]. From this point of view, customers pay more attention to dissatisfaction reviews with the services of luxury hotels than to dissatisfaction reviews with the services of budget hotels and determine whether it helps to select hotels. Therefore, in this study, the normative and informational effects on review helpfulness will be moderated by the hotel grade (luxury hotel vs. budget hotel), and the hypothesis was established as follows.
H3a. 
The effect of cleanliness on the review’s helpfulness is more significant for ethnic hotels than budget hotels.
H3b. 
The effect of location on the review’s helpfulness is more significant for ethnic hotels than budget hotels.
H3c. 
The effect of rooms on the review’s helpfulness is more significant for ethnic hotels than budget hotels.
H3d. 
The effect of service on the review’s helpfulness is more significant for ethnic hotels than budget hotels.
H3e. 
The effect of sleep on the review’s helpfulness is more significant for ethnic hotels than budget hotels.
H3f. 
The effect of value on the review’s helpfulness is more significant for ethnic hotels than budget hotels.
H4a. 
The effect of review length on the review’s helpfulness is more significant for ethnic hotels than budget hotels.
H4b. 
The effect of review sentiment on the review’s helpfulness is more significant for ethnic hotels than budget hotels.

4. Method

4.1. Data Collection

As of September 2021, this study collected review data from hotels in New York, Seoul, and Shanghai from TripAdvisor.com. TripAdvisor.com is the most popular travel information platform with more than 88 million reviews, and more than 900 million tourists use the platform to easily view others opinion of businesses, which can help with planning and booking of holidays.
The number of reviews collected is shown in Table 1. A total of 263,280 reviews were collected, including 227,661 reviews of 348 hotels in New York, 11,819 reviews of 228 hotels in Seoul, and 23,800 reviews of 431 hotels in Shanghai. In New York, there are approximately 654 reviews per hotel. In Seoul, there are approximately 52 reviews per hotel, and in Shanghai, there are approximately 55 reviews per hotel. It can be judged that New York in the United States has a higher average number of reviews than hotels in Seoul and Shanghai because it is a commercial, financial, economic, and cultural center.
Hotels with more than 4 stars are called luxury hotels [46,47], which are generally more expensive than budget hotels [47,49]. Therefore, customers expect a high level of service and facility quality for luxury hotels. Therefore, in this study, hotel ratings (hotel grades) were collected using hotel information from TripAdvisor.com. Table 2 shows the hotel ratings of the collected hotels. Approximately 63.9% in New York, 74.2% in Seoul, and 95.0% in Shanghai are luxury hotels.

4.2. Operational Definition of a Variable

The variables for this study were extracted from the review of TripAdvisor.com, as described in Figure 2. The review shows the hotel’s cleanliness, location, rooms, service, sleep quality ratings, review text, and helpfulness votes.
The description of each variable is summarized in Table 3. Each variable was operatively defined based on reliable existing literature. As independent variables, cleanliness, location, rooms, service, sleep quality, value, review length, and review emotion shown in the review were used. The rating of cleanliness, location, rooms, service, sleep quality, and value was extracted directly from the review data. The review length was extracted from the review using the LIWC program. Review sentiments were extracted using the Python program’s VADER (valence aware dictionary and sentimental reasoner) package. Helpfulness was used as a dependent variable and was extracted directly from the review data. Finally, the moderator variable, the hotel grade, was coded as 1 for luxury hotels (when the hotel grade is 4 stars or more) and 0 for other cases.

4.3. Descriptive Analysis

The descriptive statistics and correlation analysis for the variables in this study are shown in Table 4. The ratings for 6 attributes of hotels in each city is 4 or higher, indicating that customers are overall satisfied with the hotel. The review sentiment is 0.8 or higher, indicating that customers had a positive hotel experience. However, the number of helpful votes is very low, approximately 0.2 per review. This means that most reviews are not helpful. Furthermore, there are relatively high correlations between some variables, so multicollinearity is likely to occur.

4.4. Analyze Data and Test Hypotheses

In this study, the distribution of dependent variables to select a regression analysis model is as follows. First, helpfulness, a dependent variable, is a discrete (countable) variable. Second, the variance of helpfulness is greater than the mean (see Table 4). In general, negative binomial regression is used when the variance of the dependent variable is greater than the mean [54]. Finally, the helpfulness distribution has many extremes of 0, as shown in Figure 3.
Therefore, ZINB (zero-inflated negative binomial regression) was used in this study. In addition, in this study, a 4-step hierarchical regression analysis was conducted to analyze the hotel-grade interaction effect on normative influencing factors (cleanness, location, rooms, service, sleep quality, value) and informational influencing factors (review length, review sentiment). In Step 1, the control variable (city) was considered. In Step 2, the independent variable (cleanness, location, rooms, service, sleep quality, value, review length, and review sentiment) and the moderating variable (hotel grade) were considered. In addition, the interaction term for normative effects was included in Step 3, and the interaction term for informational effects was added in Step 4.
When analyzing the hierarchical moderating effect, the interaction term between the independent variable and the moderating variable can cause multicollinearity between the independent variable and the moderating variable, so VIF (variance inflation factor) was confirmed. As a result, since the VIF is greater than 10, it is performed mean-centering on the independent and moderating variables to minimize the potential problem of multicollinearity. As a result, the VIFs ranged from 1 to 3.2, significantly lower than 10. Therefore, the multicollinearity problem no longer exists.
Model 1 reflects the relationship between helpfulness, the normative influencing factors (cleanness, location, rooms, service, sleep quality, value), and the informational influencing factors (review length, review sentiment), as mentioned in H1a, H1b, H1b, H1a, H1b, H2b, H3c, H3d, H3e, H3f, H4a, and H3b.
Model 1: Helpfulness = β11 × Cleanliness + β12 × Location + β13 × Rooms + β14 × Service + β15 × Sleep Quality + β16 × Value + β17 × Number of Words + β18 × Sentiment + β19 × Cleanliness × Hotel Grade + β20 × Location × Hotel Grade + β21 × Rooms × Hotel Grade + β22 × Service × Hotel Grade + β23 × Sleep Quality × Hotel Grade + β24 × value × Hotel Grade + β25 × Review Length × Hotel Grade + β26 × Sentiment × Hotel Grade + DNewYork + DShanghai + ε1
Table 5 shows the negative binomial regression analysis results for all hotels regardless of city. The effects of normative influencing factors (cleanness, location, rooms, service, sleep quality, value) and informational influencing factors (review length, review sentiment) on review helpfulness were analyzed.
The analysis results are as follows. In the case of New York hotels, it was found that they had a negative (−) effect on the review’s helpfulness compared to Seoul hotels. In addition, as assumed in this study, the normative factors of cleanliness, location, service, and value, the informational influencing factor of review length, and the moderator variable, hotel grade, significantly affect the review’s helpfulness in Steps 2 to 4.
In Step 2, from the perspective of the normative influence, the high rating of the location (β = 0.038, p < 0.001) has a significantly positive (+) effect on the review’s helpfulness. However, the high ratings of cleanliness (β = −0.021, p < 0.05), service (β = −0.026, p < 0.01), and value (β = −0.040, p < 0.001) have significant negative (−) effects on the review’s helpfulness. From the perspective of the informational influence, the longer the review length (β = −0.000, p < 0.001) is, the more significantly the negative (−) effect is. Hotels with a high hotel grade (β = 0.049, p < 0.001), a moderator variable, have a significantly positive (+) effect on the review’s helpfulness. Therefore, this study supports the hypotheses H1a, H1b, H1d, H1f, and H2a. Location × hotel grade interaction (β = 0.060, p < 0.01) has a significantly positive (+) effect on the review’s helpfulness in Step 3 and Step 4. On the other hand, the cleanliness × hotel grade interaction (β = −0.061, p < 0.001) has a significantly negative (−) effect on the review’s helpfulness in Steps 3 and 4. Moreover, the review length × hotel grade (β = 0.001, p < 0.001) has a significant positive (+) effect on the review’s helpfulness in Step 4. Accordingly, H3a, H3b, and H4a are supported, but H3c, H3d, H3e, H3f, and H4b are not supported.
In addition, in this study, a 3-step hierarchical regression analysis was conducted to analyze the hotel-grade interaction effect on normative influencing factors (cleanness, location, rooms, service, sleep quality, and value) and informational influencing factors (review length, and review sentiment). In Step 1, independent variables (cleanness, location, rooms, service, sleep quality, value, review length, and review sentiment) and moderator variables (hotel grade) were considered. In Step 2, interaction terms for normative effects were included. Finally, in Step 3, an interaction term for informational effects was included.
Model 2 reflects the hypothesis relationship between normative influencing factors, informational influencing factors, and review’s helpfulness, as mentioned in Model 1.
Model 2: Helpfulness = β11 × Cleanliness + β12 × Location + β13 × Rooms + β14 × Service + β15 × Sleep Quality + β16 × Value + β17 × Number of Words + β18 × Sentiment + β19 × Cleanliness × Hotel Grade + β20 × Location × Hotel Grade + β21 × Rooms × Hotel Grade + β22 × Service × Hotel Grade + β23 × Sleep Quality × Hotel Grade + β24 × value × Hotel Grade + β25 × Review Length × Hotel Grade + β26 × Sentiment × Hotel Grade + ε1
First, the results of the negative binomial regression analysis for New York hotels are shown in Table 6. Normative influencing factors including cleanliness, location, rooms, service, and value, informational influencing factors including review length and review sentiment among, and the moderator variable, hotel grade, significantly affect the review’s helpfulness in Steps 1 to 3.
In Step 1, from the perspective of the normative influence, the high rating of the location (β = 0.069, p < 0.001) and rooms (β = 0.024, p < 0.05) have a significantly positive (+) effect on the review’s helpfulness. However, the high ratings of cleanliness (β = −0.022, p < 0.05), service (β = −0.040, p < 0.001), and value (β = −0.050, p < 0.001) have significant negative (−) effects on the review’s helpfulness. From the perspective of the informational influence, the longer the review length (β = −0.004, p < 0.001) is, the more significant the negative (−) effect is. Moreover, the more extreme reviews have a significant negative (−) effect on the review’s helpfulness. Hotels with a high hotel grade (β = 0.140, p < 0.001), a moderator variable, have a significantly positive (+) effect on the review’s helpfulness. Therefore, this study supports hypotheses H1a, H1b, H1c, H1d, H1f, H2a, and H2b. Location × hotel grade interaction (β = 0.093, p < 0.001) and value × hotel grade interaction (β = 0.049, p < 0.05) have a significantly positive (+) effect on the review’s helpfulness in Step 2 and Step 3. On the other hand, the cleanliness × hotel grade interaction (β = −0.057, p < 0.05) and rooms × hotel grade interaction have a significantly negative (−) effect on the review’s helpfulness in steps 2 and 3. Moreover, the review length × hotel grade (β = 0.001, p < 0.001) has a significantly positive (+) effect on the review’s helpfulness in Step 3. Accordingly, H3a, H3b, H3c, H3f, and H4a are supported, but H3d, H3e, and H4b are not supported.
Second, the results of the negative binomial regression analysis for Seoul hotels are shown in Table 7. Location in normative influencing factors and review length in informational influencing factors significantly affect the review’s helpfulness in Steps 1 to 3.
In Step 1, from the perspective of normative influence, the high rating of the location (β = 0.131, p < 0.01) has a significantly positive (+) effect on the review’s helpfulness. From the perspective of informational influence, the longer the review length (β = −0.001, p < 0.05) is, the more significant the negative (−) effect is. Therefore, this study supports only hypotheses H1a and H2a. On the other hand, the value × hotel grade interaction (β = 0.093, p < 0.01) has a significantly positive (+) effect on the review’s helpfulness in Step 2 and Step 3, and the service × hotel grade interaction (β = −0.267, p < 0.05) has a significantly negative (−) effect on the review’s helpfulness in Steps 2 and 3. Accordingly, H3d and H3f are supported, but the others are not supported.
Third, the results of the negative binomial regression analysis for Shanghai hotels are shown in Table 8. Only cleanliness in normative influencing factors significantly affects the review’s helpfulness in Steps 1 to 3.
In Step 1, from the perspective of the normative influence, the high rating of the cleanliness (β = 0.131, p < 0.01) has a significantly negative (−) effect on the review’s helpfulness. Moreover, any interaction of normative and informational influence with hotel grade does not affect the review’s helpfulness. Therefore, this study supports only hypothesis H1a.

4.5. Robustness Checking

In this study, we verified the robustness of the proposed method with two regression analyses. The first is a Tobit regression analysis. The Tobit regression analysis, used in many studies, was used to check the robustness of the method [9,55]. The second is 2-stage least squares (2SLS). 2SLS is one of the methods used to solve the endogeneity problem [56,57]. There may be unabsorbed variables that influence both review length and review helpfulness. For example, some reviewers may like to write in detail about the hotel services they used, while others may not. Therefore, short reviews may be less likely to receive helpful votes. We used average review length as an instrument which provides an exogenous source of variation for the endogenous variable (review length).
The robustness check results are shown in Table 9. There was almost no significant difference between the results of the ZINB, the Tobit regression analysis, and the 2SLS, and the main effect remained similar. Therefore, it can be concluded that the analysis results of the proposed research model in this study are generally robust.

4.6. Disscussion

This study investigates the effects of normative and informational influencing factors on review helpfulness based on the social influence theory. First, our study found that normative influencing factors (i.e., cleanliness, location, service, sleep quality) and informative influencing factors (i.e., review length) affect the helpfulness of reviews, regardless of the city’s location. This is consistent with the social influence theory, where customers are influenced by other customers’ human behavior [58]. Furthermore, the effect of normative and informational influencing factors on review helpfulness is moderated by hotel ratings (i.e., luxury hotel vs. budget hotel). This is consistent with the expectation disconfirmation theory, where the higher the price, the better the service customers expect. Therefore, we employed the social influence theory and the expectation disconfirmation theory as a theoretical basis to explain the helpfulness of online reviews for hotels. In particular, among the normative influencing factors, cleanliness, service, and sleep quality were found to have a negative effect on review helpfulness. In fact, according to the signal theory, customers cannot accurately know the service quality of a hotel due to information asymmetry. Therefore, review rating is a good signal to resolve the uncertainty regarding the service quality of the hotel. As negative review ratings mean they are dissatisfied with the quality of hotel service [59], this is an important signal, especially for customers who think that a particular hotel’s service is better than other accommodations. Therefore, the results of this study can be said to be consistent with the results of previous studies where cleanliness, service, and quality of sleep have a negative effect on reviews [60].
Second, our findings revealed that there were differences between normative and informational influencing factors affecting review helpfulness according to the geographic location of hotels. For example, in New York, the determinants of the review’s helpfulness are cleanliness, location, rooms, service, value, review length, and review sentiment. The location and review length for Seoul hotels and cleanliness for Shanghai hotels are the determinants of the review’s helpfulness.
Third, in this study, the moderating effect of hotel grade was confirmed in the relationship between normative influencing factors, informational influencing factors, and the review’s helpfulness. In general, the higher the price of a hotel, the higher the expectation in both luxury hotels and budget hotels. In New York, when analyzing the more expensive hotels compared with budget hotels, the lower the cleanliness and room ratings, the higher the review’s helpfulness. However, higher location and value ratings and longer review lengths have a negative effect on review helpfulness.
Finally, many previous studies have argued that a longer review length has a positive effect on review helpfulness because the information in the review is richer [10,13,14,31,32,35,36,37,38,39]. However, in this study, review length was found to have a negative effect on review helpfulness. In general, if a problem is not related to the consumer’s interest, the motivation for cognitive effort does not occur, but if it is related to profit, the motivation for cognitive effort is apparent [52]. Therefore, when a customer has a negative experience, they actively express their opinion in the review to help others make decisions. Therefore, the longer the review length, the more negative opinions can be, and it can be inferred in which part the negative experience was made through the normative influence factors.

5. Conclusions

5.1. Theoretical Implications

The theoretical contributions of this study are as follows. First, previous studies have explained the review rating, which indicates the overall satisfaction of a hotel, as a normative influencing factor. However, our study examined the influence of multiple attributes, which indicate the detailed service of the hotel as a normative influencing factor, on review helpfulness. As a result of our study, cleanliness, location, service, and sleep quality were found to affect review helpfulness. Therefore, our study contributes to future online review research by extending the normative influencing factors in the online review literature.
Second, although the customer’s evaluation of a hotel differs according to the geographical location of the hotel, previous studies investigated the determinants of review helpfulness for hotels in a single city. Accordingly, this study collected reviews of hotels in New York, Seoul, and Shanghai, and investigated factors affecting the helpfulness of reviews. As a result, it was revealed that the determinants of review helpfulness for hotels in each city were different. Therefore, our study contributes to the online review literature by investigating the determinants of review helpfulness according to the geographic location of the hotel.
Finally, unlike previous studies which analyzed the influence of review ratings on helpfulness according to hotel grade (luxury hotel vs. budget hotel), our study analyzed the influence of multiple attributes on helpfulness according to hotel grade. Therefore, our study contributes to the online review literature by examining the influence of hotel service attributes on review helpfulness according to hotel grade.

5.2. Practical Implications

The practical implications derived from the results of this study are as follows. First, the results of this study can be used as a guideline for predicting meaningful reviews. Hotel managers will help improve negative reviews and enhance the promotion of positive reviews, potentially helping to enhance customer satisfaction. Second, identifying the factors that affect the review’s helpfulness will help strengthen customer satisfaction. In other words, it will help hotel managers take improvement measures on factors that negatively affect the review’s helpfulness and strengthen factors that positively affect the review’s helpfulness. Therefore, it will potentially help to improve the hotel’s profitability. Third, approximately 14% of hotel ratings are affected by travel destinations [61]. In addition, the factors affecting the review’s helpfulness vary depending on the hotel’s geographical location. Therefore, in the case of franchise hotels, it is necessary to provide locally differentiated services. Fourth, the evaluation of the detailed elements of the review reflects the difference in the performance of customers’ expectations and experiences at the hotel quality level. In other words, if the rating is high, the performance is higher than expected, while if the rating is low, the performance is lower than expected. Customers expect better hotel quality the more expensive the hotel is. Therefore, In luxury hotels, the lower the detailed rating of the hotel, the more helpful the review tends to be. Since this can negatively affect customers’ purchase of luxury hotels, luxury hotel managers must improve the service quality dimension of hotels with low ratings.

5.3. Recommendation, Limitations, and Future Research

As a result of this study, it was found that the negative multi-attribute ratings for hotel service affect the helpfulness of reviews. In addition, it was found that there was a difference in the influence of the hotel’s multi-attribute ratings on the helpfulness according to the hotel grade. On this base, future research should develop evaluation criteria of multiple attributes for hotel service and a methodology to evaluate it.
However, this study has the following limitations. First, the evaluation of hotels has different expectations for each customer due to cultural differences. In other words, customers with different cultural backgrounds may have different expectations and perceptions of hotel services. However, since this study only collected English reviews from hotels in New York, Seoul, and Shanghai to analyze the determinants that affect the review’s helpfulness, it is necessary to collect and analyze reviews in various languages, such as Korean and Chinese. Second, since hotel review data were collected from a single travel platform (TripAdvisor.com), there is a limit to generalizing the research results. In future studies, collecting and analyzing data from various travel platforms such as Expedia.com and Booking.com is necessary. Third, in many studies, the determinants of the review’s helpfulness were identified using the review’s attribute data and the reviewer’s attribute data. However, in this study, it was analyzed using only the attribute data of the review. In future studies, it is necessary to add and analyze the reviewer’s attribute data. Finally, in this study, only the data of the ranking top-1000 provided by TripAdvisor were collected, so the proportion of luxury hotels was high. In China, most of the data used in the analysis were from luxury hotels, so there was a limit to being unable to analyze the moderating effect of the hotel grade. Therefore, in future studies, it is necessary to collect and analyze data by expanding the scope of hotels.

Author Contributions

Conceptualization, Y.S. and I.C.; methodology, Y.S.; software, K.K.; validation, J.K.; formal analysis, Y.S.; investigation, K.K.; resources, K.K.; data curation, I.C.; writing—original draft preparation, Y.S.; writing—review and editing, I.C.; visualization, I.C.; supervision, I.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

This research was supported by the BK21 FOUR (Fostering Outstanding Universities for Research) funded by the Ministry of Education (MOE, Korea) and National Research Foundation of Korea (NRF).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Filieri, R.; Raguseo, E.; Vitari, C. What moderates the influence of extremely negative ratings? The role of review and reviewer characteristics. Int. J. Hosp. Manag. 2018, 77, 333–341. [Google Scholar] [CrossRef]
  2. Filieri, R. What makes online reviews helpful? A diagnosticity-adoption framework to explain informational and normative influences in e-WOM. J. Bus. Res. 2015, 68, 1261–1270. [Google Scholar] [CrossRef]
  3. Huang, J.-H.; Chen, Y.-F. Herding in online product choice. Psychol. Mark. 2006, 23, 413–428. [Google Scholar] [CrossRef]
  4. Zhao, X.R.; Wang, L.; Guo, X.; Law, C.H.R. The influence of online reviews to online hotel booking intentions. Int. J. Contemp. Hosp. Manag. 2015, 27, 1343–1365. [Google Scholar] [CrossRef]
  5. Anagnostopoulou, S.C.; Buhalis, D.; Kountouri, I.L.; Manousakis, E.; Tsekrekos, A.E. The impact of online reputation on hotel profitability. Int. J. Contemp. Hosp. Manag. 2019, 32, 20–39. [Google Scholar] [CrossRef] [Green Version]
  6. Phillips, P.; Barnes, S.; Zigan, K.; Schegg, R. Understanding the impact of online reviews on hotel performance: An empirical analysis. J. Travel Res. 2017, 56, 235–249. [Google Scholar] [CrossRef] [Green Version]
  7. YYe, Q.; Law, R.; Gu, B. The impact of online user reviews on hotel room sales. Int. J. Hosp. Manag. 2009, 28, 180–182. [Google Scholar] [CrossRef]
  8. Rose, M.; Blodgett, J.G. Should hotels respond to negative online reviews? Cornell Hosp. Q. 2016, 57, 396–410. [Google Scholar] [CrossRef]
  9. Mudambi, S.M.; Schuff, D. Research Note: What Makes a Helpful Online Review? A Study of Customer Reviews on Amazon.com. MIS Q. 2010, 34, 185–200. [Google Scholar] [CrossRef] [Green Version]
  10. Baek, H.; Ahn, J.; Choi, Y. Helpfulness of Online Consumer Reviews: Readers' Objectives and Review Cues. Int. J. Electron. Commer. 2012, 17, 99–126. [Google Scholar] [CrossRef]
  11. Huang, A.H.; Chen, K.; Yen, D.C.; Tran, T.P. A study of factors that contribute to online review helpfulness. Comput. Hum. Behav. 2015, 48, 17–27. [Google Scholar] [CrossRef]
  12. Lee, S.; Choeh, J.Y. The determinants of helpfulness of online reviews. Behav. Inf. Technol. 2016, 35, 853–863. [Google Scholar] [CrossRef]
  13. Hlee, S.; Lee, J.; Yang, S.-B.; Koo, C. The moderating effect of restaurant type on hedonic versus utilitarian review evaluations. Int. J. Hosp. Manag. 2018, 77, 195–206. [Google Scholar] [CrossRef]
  14. Zhou, S.; Guo, B. The order effect on online review helpfulness: A social influence perspective. Decis. Support Syst. 2016, 93, 77–87. [Google Scholar] [CrossRef]
  15. Chatterjee, S. Drivers of helpfulness of online hotel reviews: A sentiment and emotion mining approach. Int. J. Hosp. Manag. 2020, 85, 102356. [Google Scholar] [CrossRef]
  16. Srivastava, V.; Kalro, A.D. Enhancing the Helpfulness of Online Consumer Reviews: The Role of Latent (Content) Factors. J. Interact. Mark. 2019, 48, 33–50. [Google Scholar] [CrossRef]
  17. Deutsch, M.; Gerard, H.B. A study of normative and informational social influences upon individual judgment. J. Abnorm. Soc. Psychol. 1955, 51, 629. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Lee, S.; Choeh, J. Using the Social Influence of Electronic Word-of-Mouth for Predicting Product Sales: The Moderating Effect of Review or Reviewer Helpfulness and Product Type. Sustainability 2020, 12, 7952. [Google Scholar] [CrossRef]
  19. Mohammadiani, R.P.; Mohammadi, S.; Malik, Z. Understanding the relationship strengths in users' activities, review helpfulness and influence. Comput. Hum. Behav. 2017, 75, 117–129. [Google Scholar] [CrossRef]
  20. Risselada, H.; de Vries, L.; Verstappen, M. The impact of social influence on the perceived helpfulness of online consumer reviews. Eur. J. Mark. 2018, 52, 619–636. [Google Scholar] [CrossRef]
  21. Lankton, N.K.; McKnight, H.D. Examining two expectation disconfirmation theory models: Assimilation and asymmetry effects. J. Assoc. Inf. Syst. 2012, 13, 1. [Google Scholar] [CrossRef] [Green Version]
  22. Oliver, R.L. A cognitive model of the antecedents and consequences of satisfaction decisions. J. Mark. 1980, 17, 460–469. [Google Scholar] [CrossRef]
  23. Burnkrant, R.E.; Cousineau, A. Informational and Normative Social Influence in Buyer Behavior. J. Consum. Res. 1975, 2, 206–215. [Google Scholar] [CrossRef]
  24. Cheung, M.Y.; Luo, C.; Sia, C.L.; Chen, H. Credibility of Electronic Word-of-Mouth: Informational and Normative Determinants of On-line Consumer Recommendations. Int. J. Electron. Commer. 2009, 13, 9–38. [Google Scholar] [CrossRef]
  25. Kaplan, M.F.; Miller, C.E. Group decision making and normative versus informational influence: Effects of type of issue and assigned decision rule. J. Pers. Soc. Psychol. 1987, 53, 306. [Google Scholar] [CrossRef]
  26. Meek, S.; Wilk, V.; Lambert, C. A big data exploration of the informational and normative influences on the helpfulness of online restaurant reviews. J. Bus. Res. 2021, 125, 354–367. [Google Scholar] [CrossRef]
  27. Lee, S.; Lee, S.; Baek, H. Does the dispersion of online review ratings affect review helpfulness? Comput. Hum. Behav. 2021, 117, 106670. [Google Scholar] [CrossRef]
  28. Einar, B.; Havro, L.J.; Moen, O. An Empirical Investigation of Self-Selection Bias and Factors Influencing Review Helpfulness. Int. J. Bus. Manag. 2015, 10, 16. [Google Scholar] [CrossRef] [Green Version]
  29. Quaschning, S.; Pandelaere, M.; Vermeir, I. When Consistency Matters: The Effect of Valence Consistency on Review Helpfulness. J. Comput. Commun. 2014, 20, 136–152. [Google Scholar] [CrossRef]
  30. Kwok, L.; Xie, K.L. Factors contributing to the helpfulness of online hotel reviews: Does manager response play a role? Int. J. Contemp. Hosp. Manag. 2016, 28, 2156–2177. [Google Scholar] [CrossRef]
  31. Guo, B.; Zhou, S. What makes population perception of review helpfulness: An information processing perspective. Electron. Commer. Res. 2016, 17, 585–608. [Google Scholar] [CrossRef]
  32. Ren, G.; Hong, T. Examining the relationship between specific negative emotions and the perceived helpfulness of online reviews. Inf. Process. Manag. 2018, 56, 1425–1438. [Google Scholar] [CrossRef]
  33. Henningsen, D.D.; Henningsen, M.L.M. Examining Social Influence in Information-Sharing Contexts. Small Group Res. 2003, 34, 391–412. [Google Scholar] [CrossRef] [Green Version]
  34. Petty, R.E.; Brinol, P.; Priester, J.R. Mass Media Attitude Change: Implications of the Elaboration Likelihood Model of Persuasion. In Media Effects; Routledge: London, UK, 2009; pp. 141–180. [Google Scholar]
  35. Xu, X.; Yao, Z. Understanding the role of argument quality in the adoption of online reviews: An empirical study integrating value-based decision and needs theory. Online Inf. Rev. 2015, 39, 885–902. [Google Scholar] [CrossRef]
  36. Choi, H.S.; Leon, S. An empirical investigation of online review helpfulness: A big data perspective. Decis. Support Syst. 2020, 139, 113403. [Google Scholar] [CrossRef]
  37. Kim, S.J.; Maslowska, E.; Malthouse, E.C. Understanding the effects of different review features on purchase probability. Int. J. Advert. 2017, 37, 29–53. [Google Scholar] [CrossRef]
  38. Shin, S.; Du, Q.; Ma, Y.; Fan, W.; Xiang, Z. Moderating effects of rating on text and helpfulness in online hotel reviews: An analytical approach. J. Hosp. Mark. Manag. 2020, 30, 159–177. [Google Scholar] [CrossRef]
  39. Wu, C.; Mai, F.; Li, X. The effect of content depth and deviation on online review helpfulness: Evidence from double-hurdle model. Inf. Manag. 2020, 58, 103408. [Google Scholar] [CrossRef]
  40. Geng, S.; Niu, B.; Feng, Y.; Huang, M. Understanding the focal points and sentiment of learners in MOOC reviews: A machine learning and SC-LIWC-based approach. Br. J. Educ. Technol. 2020, 51, 1785–1803. [Google Scholar] [CrossRef]
  41. Park, E.; Kang, J.; Choi, D.; Han, J. Understanding customers' hotel revisiting behaviour: A sentiment analysis of online feedback reviews. Curr. Issues Tour. 2018, 23, 605–611. [Google Scholar] [CrossRef]
  42. Tian, G.; Lu, L.; McIntosh, C. What factors affect consumers’ dining sentiments and their ratings: Evidence from restaurant online review data. Food Qual. Prefer. 2020, 88, 104060. [Google Scholar] [CrossRef]
  43. Zeng, Z.; Zhou, Z.; Mu, X. User review helpfulness assessment based on sentiment analysis. Electron. Libr. 2020, 38, 337–351. [Google Scholar] [CrossRef]
  44. Agnihotri, A.; Bhattacharya, S. Online Review Helpfulness: Role of Qualitative Factors. Psychol. Mark. 2016, 33, 1006–1017. [Google Scholar] [CrossRef] [Green Version]
  45. Zhou, Y.; Yang, S. Roles of Review Numerical and Textual Characteristics on Review Helpfulness Across Three Different Types of Reviews. IEEE Access 2019, 7, 27769–27780. [Google Scholar] [CrossRef]
  46. Mohsin, A.; Lockyer, T. Customer perceptions of service quality in luxury hotels in New Delhi, India: An exploratory study. Int. J. Contemp. Hosp. Manag. 2010, 22, 160–173. [Google Scholar] [CrossRef]
  47. Presbury, R.; Fitzgerald, A.; Chapman, R. Impediments to improvements in service quality in luxury hotels. Manag. Serv. Qual. Int. J. 2005, 15, 357–373. [Google Scholar] [CrossRef]
  48. Becerra, M.; Santaló, J.; Silva, R. Being better vs. being different: Differentiation, competition, and pricing strategies in the Spanish hotel industry. Tour. Manag. 2013, 34, 71–79. [Google Scholar] [CrossRef]
  49. Lu, C.; Berchoux, C.; Marek, M.; Chen, B. Service quality and customer satisfaction: Qualitative research implications for luxury hotels. Int. J. Cult. Tour. Hosp. Res. 2015, 9, 168–182. [Google Scholar] [CrossRef]
  50. Hlee, S. How reviewer level affects review helpfulness and reviewing behavior across hotel classifications: The case of Seoul in Korea. Ind. Manag. Data Syst. 2020, 121, 1191–1215. [Google Scholar] [CrossRef]
  51. Xie, K.L.; Zhang, Z.; Zhang, Z. The business value of online consumer reviews and management response to hotel performance. Int. J. Hosp. Manag. 2014, 43, 1–12. [Google Scholar] [CrossRef]
  52. Lee, M.; Lee, S.A.; Koh, Y. Multisensory experience for enhancing hotel guest experience: Empirical evidence from big data analytics. Int. J. Contemp. Hosp. Manag. 2019, 31, 4313–4337. [Google Scholar] [CrossRef]
  53. Cró, S.; Martins, A.M. Hotel and hostel location in Lisbon: Looking for their determinants. Tour. Geogr. 2017, 20, 504–523. [Google Scholar] [CrossRef]
  54. Long, J.S. Regression Models for Categorical and Limited Dependent Variables. J. Am. Stat. Assoc. 1997, 92, 1655. [Google Scholar]
  55. Zhou, Y.; Yang, S.; Li, Y.; Chen, Y.; Yao, J.; Qazi, A. Does the review deserve more helpfulness when its title resembles the content? Locating helpful reviews by text mining. Inf. Process. Manag. 2019, 57, 102179. [Google Scholar] [CrossRef]
  56. Antonakis, J.; Bendahan, S.; Jacquart, P.; Lalive, R. Causality and endogeneity: Problems and solutions. In The Oxford Handbook of Leadership and Organizations; Oxford Library of Psychology: Oxford, UK, 2014; Volume 1, pp. 93–117. [Google Scholar]
  57. Zaefarian, G.; Kadile, V.; Henneberg, S.C.; Leischnig, A. Endogeneity bias in marketing research: Problem, causes and remedies. Ind. Mark. Manag. 2017, 65, 39–46. [Google Scholar] [CrossRef]
  58. Venkatesh, V.; Thong, J.Y.; Xu, X. Consumer acceptance and use of information technology: Extending the unified theory of acceptance and use of technology. MIS Q. 2012, 36, 157–178. [Google Scholar] [CrossRef] [Green Version]
  59. Filieri, R.; Raguseo, E.; Vitari, C. Extremely negative ratings and online consumer review helpfulness: The moderating role of product quality signals. J. Travel Res. 2021, 60, 699–717. [Google Scholar] [CrossRef]
  60. Chevalier, J.A.; Mayzlin, D. The Effect of Word of Mouth on Sales: Online Book Reviews. J. Mark. Res. 2006, 43, 345–354. [Google Scholar] [CrossRef] [Green Version]
  61. Nakayama, M.; Wan, Y. The cultural impact on social commerce: A sentiment analysis on Yelp ethnic restaurant reviews. Inf. Manag. 2018, 56, 271–279. [Google Scholar] [CrossRef]
Figure 1. Research Model.
Figure 1. Research Model.
Sustainability 14 14881 g001
Figure 2. Illustration of the data variables.
Figure 2. Illustration of the data variables.
Sustainability 14 14881 g002
Figure 3. Distribution of Helpfulness by City. (a) All Cities; (b) New York; (c) Seoul; (d) Shanghai.
Figure 3. Distribution of Helpfulness by City. (a) All Cities; (b) New York; (c) Seoul; (d) Shanghai.
Sustainability 14 14881 g003
Table 1. Number of reviews by city.
Table 1. Number of reviews by city.
CityNumber of HotelsNumber of Reviews
New York348227,661
Seoul22811,819
Shanghai43123,800
Sum1007263,280
Table 2. Number of reviews by hotel grades.
Table 2. Number of reviews by hotel grades.
Hotel
Grade
New YorkSeoulShanghai
FrequencyRatioFrequencyRatioFrequencyRatio
11240.1%30.0%20.0%
1.530.0%90.1%00.0%
242661.9%1761.5%1190.5%
2.56160.3%420.4%400.2%
369,57330.6%271923.0%9053.8%
3.576703.4%990.8%1210.5%
4121,19253.2%322627.3%450718.9%
4.566802.9%60.1%13725.8%
517,5377.7%553946.9%16,73470.3%
Sum227,661100.0%11,819100.0%23,800100.0%
Table 3. Operationalization of variables.
Table 3. Operationalization of variables.
TypeVariablesOperationalizationNotesReference
Independent VariableNormative
Influence
CleanlinessThe review’s cleanliness rating from TripAdvisorRange: [0, 5][50,51]
LocationThe review’s location rating from TripAdvisorRange: [0, 5][50,51]
RoomsThe review’s rooms rating from TripAdvisorRange: [0, 5][50,51]
ServiceThe review’s service rating from TripAdvisorRange: [0, 5][50,51]
Sleep QualityThe review’s sleep quality rating from TripAdvisorRange: [0, 5][50,51]
ValueThe review’s value rating from TripAdvisorRange: [0, 5][50,51]
Informational InfluenceReview LengthNumber of words in the reviewContinuous[9,13,52]
SentimentThe absolute value of the sentiment analysis score extracted from the review using Python’s VADER packagerange [0, 1][15,43]
Moderating VariableHotel GradeHotel grade of 4 or higher (luxury) is 1; otherwise (budget) is 0Range: [0, 1][50,53]
Dependent VariableHelpfulnessNumber of helpfulness votes received by the reviewContinuous[9,16]
Table 4. Descriptive analysis for the variables.
Table 4. Descriptive analysis for the variables.
CityVariablesMinMaxMeanStandard
Deviation
123456789
All
Cities
1. Cleanliness154.430.891
2. Location154.640.680.409 ***1
3. Rooms154.151.030.730 ***0.418 ***1
4. Service154.321.030.662 ***0.420 ***0.654 ***1
5. Sleep Quality154.291.000.654 ***0.409 ***0.715 ***0.607 ***1
6. Value154.071.060.648 ***0.427 ***0.707 ***0.690 ***0.638 ***1
7. Review length64332113.90109.71−0.087 ***−0.081 ***−0.098 ***−0.155 ***−0.106 ***−0.109 ***1
8. Sentiment010.860.200.338 ***0.218 ***0.361 ***0.368 ***0.340 ***0.371 ***0.163 ***1
9. Helpfulness01370.160.56−0.016 ***0.016 ***−0.011 ***−0.008 ***−0.009 ***−0.016 ***−0.089 ***−0.049 ***1
New York1. Cleanliness154.430.901
2. Location154.680.640.429 ***1
3. Rooms154.131.040.731 ***0.447 ***1
4. Service154.331.030.668 ***0.431 ***0.663 ***1
5. Sleep Quality154.281.020.652 ***0.434 ***0.716 ***0.612 ***1
6. Value154.071.080.657 ***0.446 ***0.717 ***0.697 ***0.643 ***1
7. Review length64332110.65106.00−0.091 ***−0.066 ***−0.105 ***−0.156 ***−0.111 ***−0.114 ***1
8. Sentiment010.870.200.345 ***0.227 ***0.371 ***0.376 ***0.348 ***0.382 ***0.159 ***1
9. Helpfulness01370.170.59−0.016 ***0.005 *−0.009 ***−0.012 ***−0.008 ***−0.018 ***−0.093 ***−0.052 ***1
Seoul1. Cleanliness154.430.831
2. Location154.360.850.367 ***1
3. Rooms154.160.940.686 ***0.379 ***1
4. Service154.310.940.608 ***0.390 ***0.612 ***1
5. Sleep Quality154.270.920.649 ***0.358 ***0.692 ***0.578 ***1
6. Value154.040.960.552 ***0.440 ***0.623 ***0.617 ***0.578 ***1
7. Review length82755140.84138.88−0.065 ***−0.070 ***−0.097 ***−0.121 ***−0.104 ***−0.082 ***1
8. Sentiment010.860.200.263 ***0.182 ***0.273 ***0.289 ***0.256 ***0.269 ***0.208 ***1
9. Helpfulness050.120.420.0120.030 ***0.039 ***0.020 *0.026 **0.030 ***−0.063 ***−0.020 *1
Shanghai1. Cleanliness154.470.831
2. Location154.340.880.381 ***1
3. Rooms154.350.880.750 ***0.411 ***1
4. Service154.221.040.637 ***0.401 ***0.634 ***1
5. Sleep Quality154.400.880.681 ***0.389 ***0.710 ***0.596 ***1
6. Value154.140.940.597 ***0.401 ***0.635 ***0.659 ***0.602 ***1
7. Review length82143131.66123.75−0.083 ***−0.090 ***−0.079 ***−0.163 ***−0.091 ***−0.100 ***1
8. Sentiment010.860.200.298 ***0.206 ***0.313 ***0.331 ***0.300 ***0.309 ***0.179 ***1
9. Helpfulness040.060.29−0.013 *0.014 *0.000−0.0050.001−0.001−0.022 ***−0.018 **1
*** p < 0.001, ** p < 0.01, * p < 0.05.
Table 5. Results of zero-inflated negative binomial analysis (all cities).
Table 5. Results of zero-inflated negative binomial analysis (all cities).
VariablesStep 1Step 2Step 3Step 4
Coef.Std. er.z-ValueCoef.Std. er.z-ValueCoef.Std. er.z-ValueCoef.Std. er.z-Value
(Constant)0.2310.0288.400.3940.0507.890.4040.0508.080.3900.0507.77
Step 1: City (ref.: Seoul)
Shanghai0.0310.0400.770.0190.0400.480.0160.0400.390.0080.0400.21
New York−0.4890.029−17.14 ***−0.5070.029−17.59 ***−0.5170.029−17.86 ***−0.5190.029−17.94 ***
Step 2: Main Effect (Independent and Moderator Variable)
Cleanliness −0.0210.010−2.20 *−0.0200.010−2.14 *−0.0200.010−2.09 *
Location 0.0380.0103.77 ***0.0370.0103.62 ***0.0370.0103.66 ***
Rooms 0.0160.0101.600.0170.0101.700.0150.0101.54
Service −0.0260.008−3.20 **−0.0260.008−3.15 ***−0.0260.008−3.20 *
Sleep Quality −0.0010.008−0.08−0.0010.008−0.18 *−0.0020.008−0.18 **
Value −0.0400.009−4.56 ***−0.0390.009−4.46 ***−0.0380.009−4.32
Review Length −0.0000.000−3.98 ***0.000−0.000−4.050 ***−0.0000.000−4.74 **
Sentiment −0.0390.029−1.36−0.0380.029−1.33−0.0380.029−1.31
Hotel Grade 0.0490.0124.04 ***0.0440.0123.58 ***0.0730.0145.17 ***
Step 3: Hotel-grade interaction effects on normative influencing factors
Cleanliness × Hotel Grade −0.0610.020−2.97 ***−0.0640.020−3.13 **
Location × Hotel Grade 0.0600.0212.78 **0.0600.0212.81 **
Rooms × Hotel Grade −0.0160.021−0.75−0.0140.021−0.66
Service × Hotel Grade −0.0070.018−0.40−0.0010.018−0.04
Sleep Quality × Hotel Grade 0.0260.0181.490.0270.0181.53
Value × Hotel Grade −0.0080.019−0.44−0.0110.019−0.57
Step 4: Hotel-grade interaction effects on informational influencing factors
Review Length × Hotel Grade 0.0010.0004.06 ***
Sentiment × Hotel Grade 0.0310.0620.50
Log Likelihood−100,949.8−100,863.2−100,850.1−100,840.9
LR Chi-square507.37 ***680.55 ***706.91725.30 ***
*** p < 0.001, ** p < 0.01, * p < 0.05.
Table 6. Results of zero-inflated negative binomial analysis (New York).
Table 6. Results of zero-inflated negative binomial analysis (New York).
VariablesStep 1Step 2Step 3
Coef.Std. er.z-ValueCoef.Std. er.z-ValueCoef.Std. er.z-Value
(Constant)−0.6890.050−13.90−0.6950.050−14.03−0.7130.050−14.36
Step 1: Main Effect (Independent and Moderator Variable)
Cleanliness−0.0220.010−2.09 *−0.0200.011−1.92−0.0200.011−1.89
Location0.0690.0116.07 ***0.0690.0116.10 ***0.0690.0116.07 ***
Rooms0.0240.0102.34 *0.0260.0102.44 *0.0240.0102.32 *
Service−0.0400.009−4.39 ***−0.0400.009−4.45 ***−0.0410.009−4.45 ***
Sleep Quality−0.0150.009−1.66−0.0160.009−1.76−0.0160.009−1.81
Value−0.0500.009−5.33 ***−0.0500.009−5.36 ***−0.0480.009−5.16 ***
Review Length−0.0040.000−42.68 ***−0.0040.000−42.60 ***−0.0040.000−42.74 ***
Sentiment−0.2520.032−7.96 ***−0.2500.032−7.90 ***−0.2490.032−7.89 ***
Hotel Grade0.1400.01310.82 ***0.1360.01310.50 ***0.1700.01511.62 ***
Step 2: Hotel-grade interaction effects on normative influencing factors
Cleanliness × Hotel Grade −0.0570.022−2.59 *−0.0620.022−2.77 **
Location × Hotel Grade 0.0930.0233.99 ***0.0920.0233.95 ***
Rooms × Hotel Grade −0.0570.022−2.59 **−0.0550.022−2.50 *
Service × Hotel Grade −0.0080.019−0.390.0000.019−0.02
Sleep Quality × Hotel Grade 0.0150.0190.770.0160.0190.86
Value × Hotel Grade 0.0490.0202.47 *0.0460.0202.31 *
Step 3: Hotel-grade interaction effects on informational influencing factors
Review Length ×
Hotel Grade
0.0010.0004.88 ***
Sentiment × Hotel Grade 0.0320.0660.48
Log Likelihood−105,246.6−105,228.9−105,215.6
LR Chi-square2853.85 ***2889.39 ***2915.93 ***
*** p < 0.001, ** p < 0.01, * p < 0.05.
Table 7. Results of zero-inflated negative binomial analysis (Seoul).
Table 7. Results of zero-inflated negative binomial analysis (Seoul).
VariablesStep 1Step 2Step 3
Coef.Std. er.z-ValueCoef.Std. er.z-ValueCoef.Std. er.z-Value
(Constant)−0.8050.223−3.60−0.8810.236−3.73−0.8780.236−3.72
Step 1: Main Effect (Independent and Moderator Variable)
Cleanliness−0.0790.059−1.35−0.0630.059−1.06−0.0640.059−1.09
Location0.1310.0452.90 **0.1330.0472.84 **0.1320.0472.82 **
Rooms0.0850.0591.430.0730.0591.230.0750.0591.26
Service−0.0880.048−1.83−0.0660.049−1.35−0.0640.049−1.30
Sleep Quality−0.0340.053−0.65−0.0420.052−0.79−0.0410.052−0.78
Value0.0650.0501.310.0440.0510.880.0430.0510.84
Review Length−0.0010.000−2.26 *−0.0010.000−2.29 *−0.0010.000−2.29 *
Sentiment−0.1610.163−0.99−0.1410.162−0.87−0.1390.163−0.86
Hotel Grade0.1170.0851.370.1440.0941.540.1320.0941.40
Step 2: Hotel-grade interaction effects on normative influencing factors
Cleanliness × Hotel Grade 0.1900.1281.490.1990.1281.55
Location × Hotel Grade −0.1410.123−1.15−0.1430.123−1.17
Rooms × Hotel Grade 0.0380.1390.270.0330.1400.23
Service × Hotel Grade −0.2670.125−2.13 *−0.2830.126−2.24 *
Sleep Quality × Hotel Grade −0.0650.123−0.53−0.0680.123−0.56
Value × Hotel Grade 0.3530.1272.78 **0.3560.1272.80 **
Step 3: Hotel-grade interaction effects on informational influencing factors
Review Length × Hotel Grade −0.0010.001−1.07
Sentiment × Hotel Grade −0.0200.385−0.05
Log Likelihood−4156.68−4148.868−4148.271
LR Chi-square30.88 ***42.95 ***44.14 ***
*** p < 0.001, ** p < 0.01, * p < 0.05.
Table 8. Results of zero-inflated negative binomial analysis (Shanghai).
Table 8. Results of zero-inflated negative binomial analysis (Shanghai).
VariablesStep 1Step 2Step 3
Coef.Std. er.z-ValueCoef.Std. er.z-ValueCoef.Std. er.z-Value
(Constant)−0.8050.223−3.600.1060.2710.390.0990.2730.36
Step 1: Main Effect (Independent and Moderator Variable)
Cleanliness−0.1770.060−2.98 **−0.1890.060−3.18 **−0.1890.060−3.18 **
Location0.0840.0451.850.0840.0461.850.0840.0461.85
Rooms0.0450.0610.740.0380.0610.620.0380.0610.62
Service−0.0630.047−1.33−0.0610.047−1.31−0.0610.047−1.30
Sleep Quality0.0230.0570.410.0310.0570.540.0310.0570.54
Value0.0890.0531.690.0960.0531.830.0970.0531.83
Review Length0.0000.000−1.380.0000.000−1.390.0000.000−1.38
Sentiment−0.2380.173−1.37−0.2370.173−1.37−0.2370.173−1.37
Hotel Grade−0.1170.158−0.74−0.2720.166−1.64−0.2660.170−1.57
Step 2: Hotel-grade interaction effects on normative influencing factors
Cleanliness × Hotel Grade −0.2880.243−1.18−0.2860.246−1.16
Location × Hotel Grade −0.0520.187−0.28−0.0490.188−0.26
Rooms × Hotel Grade −0.1230.306−0.40−0.1260.325−0.39
Service × Hotel Grade −0.2250.224−1.01−0.2230.227−0.98
Sleep Quality × Hotel Grade 0.0850.1840.460.0860.1840.47
Value × Hotel Grade 0.2530.2451.030.2480.2481.00
Step 3: Hotel-grade interaction effects on informational influencing factors
Review Length ×
Hotel Grade
0.0000.0010.17
Sentiment × Hotel Grade 0.0250.8290.03
Log Likelihood−4751.558−4747.432−4747.414
LR Chi-square23.74 **31.99 ***32.03 *
*** p < 0.001, ** p < 0.01, * p < 0.05.
Table 9. Robustness check results for alternative model specification.
Table 9. Robustness check results for alternative model specification.
VariablesAll CitesNew YorkSeoulShanghai
ZINBTobit2SLSZINBTobit2SLSZINBTobit2SLSZINBTobit2SLS
Cleanliness−0.020 *−0.052 ***−0.009 ***−0.020−0.042 **−0.009 ***−0.064−0.219−0.013 −0.189 **−0.258 **−0.013 ***
Location0.037 ***0.213 ***0.024 ***0.069 ***0.122 ***0.016 ***0.132 **0.1380.012 *0.0840.155 **0.007 **
Rooms0.0150.0100.002 0.024 *0.039 **0.005 **0.0750.1800.015 *0.0380.1280.005
Service−0.026 *−0.029 *−0.003 −0.041 ***−0.051 ***−0.006 ***−0.064−0.019−0.007 −0.061−0.055−0.003
Sleep Quality−0.002 **−0.006−0.001 −0.0160.0060.000 −0.041−0.009−0.002 0.0310.0490.004
Value−0.038−0.078 ***−0.009 ***−0.048 ***−0.068 ***−0.008 ***0.0430.0970.010 0.097−0.0120.001
Review Length−0.000 **−0.007 ***0.000 ***−0.004 ***−0.007 ***−0.001 ***−0.001 *−0.0020.000 ***0.000−0.001 **0.000 ***
Sentiment−0.038−0.566 ***−0.077 ***−0.249 ***−0.598 ***−0.087 *** −0.139−0.497−0.038 −0.237−0.425−0.021 *
Hotel Grade0.073 ***0.085 ***0.002 0.170 ***0.199 ***0.015 ***0.1320.4330.043 ***−0.266−0.561 *−0.023
Cleanliness × Hotel Grade−0.064 **−0.092 **−0.014 ***−0.062 **−0.089 **−0.015 ***0.1990.2110.019 −0.286−0.445−0.022
Location × Hotel Grade0.060 **0.131 ***0.015 ***0.092 ***0.0450.008−0.143−0.271−0.018 −0.049−0.269−0.006
Rooms × Hotel Grade−0.014−0.216 ***−0.025 ***−0.055 *−0.180 ***−0.021 ***0.0330.0930.009 −0.126−0.074−0.006
Service × Hotel Grade−0.001−0.095 ***−0.010 **0.000−0.098 ***−0.012 **−0.283 *−0.446−0.036 **−0.223−0.530−0.019
Sleep Quality × Hotel Grade0.027−0.0090.000 0.0160.0170.002 −0.068−0.244−0.015 0.086−0.1830.003
Value × Hotel Grade−0.0110.220 ***0.023 ***0.046 *0.207 ***0.022 ***0.356 **0.6560.051 ***0.2480.5060.018
Review Length × Hotel Grade0.001 ***0.002 ***0.000 ***0.001 ***0.002 ***0.000 −0.001−0.0020.000 *0.0000.0010.000
Sentiment × Hotel Grade0.0310.1340.016 0.0320.1170.012 −0.020−0.139−0.022 0.025−0.292−0.020
*** p < 0.001, ** p < 0.01, * p < 0.05.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Son, Y.; Kang, K.; Choi, I.; Kim, J. The Determinants of Helpful Hotel Reviews: A Social Influence Perspective. Sustainability 2022, 14, 14881. https://doi.org/10.3390/su142214881

AMA Style

Son Y, Kang K, Choi I, Kim J. The Determinants of Helpful Hotel Reviews: A Social Influence Perspective. Sustainability. 2022; 14(22):14881. https://doi.org/10.3390/su142214881

Chicago/Turabian Style

Son, Yukyung, Kyungmo Kang, Ilyoung Choi, and Jaekyeong Kim. 2022. "The Determinants of Helpful Hotel Reviews: A Social Influence Perspective" Sustainability 14, no. 22: 14881. https://doi.org/10.3390/su142214881

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop