Considering user dynamic preferences for mitigating negative effects of long tail in recommender systems

In 2008, park et al. found that items that received fewer ratings or were recently added to the recommender systems participate less in recommendation lists. They predict long-tail items’ ratings for users by clustering techniques [8].

Malekzadeh and Kaedi present a method that maintains accuracy by personalizing the diversity of recommendation items [4]. In this method, a multi-objective optimization problem is defined that meets the goals of long-tail item participation, diversification, and accuracy.

In another study, Alshammari et al. propose a different approach that uses collaborative and content-based algorithms together to solve the long-tail problem and improve the prediction error of long-tail item ratings [19].

Using users’ sentiments about the items based on posted comments is another approach to solving the long tail problem [20]. Huang et al. try to increase the accuracy of finding similar items by extracting information from the recorded comments for the items.

In another study, the Siamese network (a machine learning method for a limited data set) solved a long tail problem [21]. Building rating predictor models based on neural networks requires much data to have high prediction accuracy. However, the number of ratings recorded for long-tail items is minimal. Therefore, Sreepada et al. use Siamese networks to create a suitable model with insufficient training data.

In another research approach, multi-objective evolutionary optimization algorithms try to solve the long tail problem [1]. Wang et al. define two objective functions to solve the long tail problem: The first one calculates the accuracy of lists, and the second objective function reduces participation of popular items.

In another approach, instead of using the usual methods of recommender systems, methods based on multi-component graphs are used to create recommendation lists [22]. Luke et al. place items, genres, and users in different sections and draw edges based on rating history. Then they traverse the graph using the Markov process. In this method, the probability of selecting items with a lower number of ratings and a bigger average rating is high for traversing.

Karakaya and Aytekin proposed a method based on transposing items graph increase diversity in the recommendations list [23]. Each node represents an item in the graph model, and the edge between the two nodes indicates that the two items co-occur in the recommendation lists. The weight of the edges also indicates the number of repetitions of the two items in the recommendation lists. Then with a prospect, the recommendation list items are replaced with the graphic model items. To solve the long tail problem, the items with a higher number of ratings are less likely to be replaced with other items. These studies solve the long-tail problem with different approaches; however, they consider users’ interests constant. As we review in the next section, user preferences change over time, and we can consider users’ interests in long-tail items dynamic.

Some studies have different methods for considering users’ dynamic preferences in recommender systems. Liu et al. set a time frame for all users that reflects their recent interests. In this study, items are likely to be used in the recommendation list based on categories of items that users have recently rated [15].

Pereira et al. identify users’ dynamic preferences based on their preferences graph and their change in position in the social network graph [16]. In this method, first, all user preferences are extracted over time. If a variance is found between the user preferences, the preferences change will be detected, and the user preferences graph will be updated. After updating the preferences graph, the user’s social network graph is checked, and changes in the user’s social network position and preferences graph are examined.

Rahimpour et al. identify dynamic user preferences by modeling users based on the trends over time. In this method, They cluster users first. Then, the user rate prediction model is then built based on trends of items in the cluster. A user-generated model shows how likely a user is to be interested in popular items in that cluster. In this study, clusters can be changed over time. Therefore, dynamic users’ preferences are modeled using trends, and dynamic clustering [17].

In another study to model the dynamic preferences of users, a network of users is constructed according to their relationships to create recommendation lists for users, and this graph changes over time [24]. Rezaeimehr et al. extract time-based association rules from the users’ community and create recommendation lists accordingly.

Zheng et al. use users’ feelings and changes in their preferences to predict better users’ next travel destination in the travel recommender system [18]. In this method, two time intervals are considered as the most significant part of preferences changes. The first interval is related to the seasons, and the next is related to the holidays. Zheng et al. consider users’ travel preferences according to these intervals.

In another study, Li et al. consider factors for the collaborative filtering algorithm to use the dynamics of users’ preferences for creating recommendation lists [14]. Li et al. predict the rating of items by considering the trends and users’ preferences. In this method, based on the user’s activities, some users are considered similar users. If a user registers a new rating for an item, the list of similar users will be updated based on his recent activities, and Li et al. predict the rating based on new similar users. Although users’ dynamic preferences are used to recommend accurately, they are not used to solve the long tail problem. Also, we will consider users’ age changes for solving this problem better.

The first step predicts the ratings of unknown items for users. Various algorithms related to recommender systems can be helpful for this purpose. We use the user-based collaborative filtering algorithm to find similar users and predict item ratings [25, 26] since, in another part of this work, we will find users of the same age and recommend new items based on users of the same age interests. The similarity of the two users $u$ and $v$ is shown in equation 1.

$I_{u}$ is a subset of items rated by user $u$. Also, $r_{uk}$ indicates the user’s ratings on item $k$, and $\mu_{u}$ indicates the average rating registered by user $u$. In the following equation, $\hat{r}_{uj}$ shows the predicted rating of user $u$ to the item $j$, which is calculated as follows.

In equation 2, $P_{u}(j)$ is a set of closest users to the target user $u$ that have registered ratings for item $j$.

Age prediction plays an important in personalizing and provides valuable information for users’ preferences [27]. In the second step, we predict the user’s age by using machine learning algorithms according to the user’s preferences for items. Therefore, first, we explain what methods and data we use to model the user’s age. Then, we describe the application of age prediction in this research.

In this study, four objectives for optimization have been considered to solve the long tail problem by considering the users’ dynamic preferences. In the rest of this section, we describe the objectives intend to optimize lists.

As the other studies[29, 4, 1], we could use multi-objective optimization algorithms to optimize recommendation lists. Other studies used different algorithms to solve the long tail problem. In this study, to best of our knowledge, it is the first time memetic algorithm is used for solving the long-tail problem.

As shown in Figure 5, many parts of the memetic algorithm are similar to the basic genetic algorithms. However, in the memetic algorithm, after crossover and mutation, a local search is performed. If a better solution is found in the local search, this solution is replaced in the created population [30]. In this study, in order to obtain better recommendation lists, the initial population is improved by using items that produce better results according to the objectives of the problem. We explain the proposed method in the next section.

This paper uses the Movielens dataset, commonly used to evaluate proposed methods of solving long-tail problems in other studies. The Movielens dataset has various versions [31]. We use MovieLens 1M dataset that has 6040 users and 1 million ratings for 3883 items. Also, for acquiring more information about movies, we use IMDB Dataset. From this dataset, we use two types of information: Parental Guide [32], and Motion picture association system [33]. The motion picture association system shows that how much content of a movie is suitable for children. Parental Guide measures the content of movies by 5 factors: (sex & nudity), (violence & gore, profanity), (alcohol & drug & smoking), and (frightening & intense scenes).

Several algorithms have been used for comparison to demonstrate the better performance of the method presented in this study. In general, we can divide the algorithms used for comparison into two general categories. The first category is the baseline algorithms of recommendation systems. In the second category, baseline algorithms are first used; then, optimization methods are used to provide better results according to the problem. We choose algorithms in the second category that solve the long tail items problem. In the following, we will explain these two categories of algorithms.

Studies mitigating the long tail problem have considered different criteria for evaluation. In this study, three criteria have been considered to compare the results.For accuracy metric, we choose precision critrion is defined as 8 [1].

$N_{s}$ is the total number of items recommended to the user. $N_{rs}$ are also relevant items suggested to the user. Relevant items receive ratings that are higher than the user’s average ratings.

The following criterion is aggregate diversity, which takes into account the number of items offered to users. This measurement counts how many the proposed algorithm can recommend different types of movies, especially long-tail items in the recommendation lists [4]. The last criterion is Novelty, which is calculated as 9 [4].

This equation indicates that the more popular the items, the greater the denominator of the fraction per recommendation list, and therefore the lower novelty of the recommendation list.

In this section, the results are compared and analyzed based on the criteria introduced in previous section. Figure 8, 8, and 8 show a comparison of these results.

According to Figure 8, the precision obtained by the proposed method in this study shows a higher value than other studies. Although the method proposed by Wong et al. [1] acquired 89% for precision criterion, its precision is 2% less than our proposed method. In this study, since we consider other users’ preferences of the same age, our method can create lists with better precision. Thus, we can use more long-tail items that obtained high ratings but had limited ratings.

In Figure 8, again, the research of Wang et al. [1] gained a higher value for the novelty criterion. However, the proposed method in this study has obtained higher values for the novelty criterion. In the proposed method, since one of the objectives of the multi-objective problem is to use long-tail items based on the user’s activity, the proposed method tries to recommend long-tail items more than short head items. With this approach, we create recommendation lists in a more personalized way. As users’ interests change over time, this method can personalize recommendation lists more accuratly. Therefore, users who have been in the system for a longer time have a better opportunity to see long-tail items in their recommendation lists, which improves long-term novelty criteria.

In Figure 8 again, the proposed algorithm performs better in the aggregate diversity criterion. Among other algorithms selected to compare the results, Malekzadeh et al. [4] performed better, As increasing the diversity of recommendation lists is considered as one of the goals of the multi-objective algorithm. However, in terms of this criterion, it has not been as successful as the proposed method of this study. By using Equation 7, we try to use items that were not in the previous recommendation lists. This allows us to use a wide range of items. Therefore, in the long term, items that were not in the recommendation lists will be recommended to users, and the aggregate diversity criterion will subsequently improve.