DefinePK hosts the largest index of Pakistani journals, research articles, news headlines, and videos. It also offers chapter-level book search.
Title: PERFORMANCE ANALYSIS OF A HYBRID RECOMMENDER SYSTEM
Authors: Uzair Sultan, Hajra Khan, Yasir Saleem Afridi, Mian Ibad Ali Shah, Muniba Ashfaq, Affera Sultan
Journal: International Journal of Innovations in Science & Technology
Publisher: 50SEA JOURNALS (SMC-PRIVATE) LIMITED
Country: Pakistan
Year: 2024
Volume: 6
Issue: 5
Language: English
Keywords: Machine learningCollaborative FilteringData MiningRecommender SystemHybridization TechniquesEvaluation MetricsMean Absolute Error (MAE)Cross-ValidationTraining Data
In the prevailing information age, human confrontation with extensive information makes it difficult to segregate the relevant content on the basis of choices and priorities. This gives rise to the need for effective recommendation systems that can be incorporated into distinct and diversified domains such as e-commerce, social media, and news media websites and applications. By giving suggestions, these recommender systems efficiently reduce huge information spaces and direct the users toward the items that best match their requirements and preferences. Hence, they play an important role in filtering out the relevant user-specific information. Based on the working principle, recommender systems can be classified into Content-Based Systems, Collaborative Filtering Systems, or P opularity-Based Systems. However, to cope with the problems of cold-start and plasticity that are associated with standalone recommender systems, hybrid recommendation systems are being introduced. This research is therefore focused on the development of a Weighted Hybrid Model that combines the scores of the three standalone recommender models in a linear fashion. The performance of the proposed hybrid model is tested against all three standalone models on an online News dataset. Using a Top-N accuracy metric, it is found that the accuracy of the weighted hybrid model is higher than the standalone Content-Based, Collaborative, and Popularity-Based models against the same dataset. An efficiency of 90% for the Hybrid model was achieved compared to the best-performing standalone model having an efficiency of 53%.
To develop and evaluate a Weighted Hybrid Model that combines Content-Based Filtering, Collaborative Filtering, and Popularity-Based recommender systems to improve recommendation accuracy and address the cold-start problem.
The research proposes a Weighted Hybrid Model that linearly combines the scores of three standalone recommender models: Content-Based Filtering, Collaborative Filtering, and Popularity-Based. The model was developed in Python using a cross-validation technique (Holdout) with 80% of the data for training and 20% for testing. A Kaggle dataset containing 12 months of news articles and user interactions was used. Data pre-processing involved assigning weights to different user interaction types (View, Like, Bookmark, Follow, Comment) and removing users and interactions with low weights. The performance was evaluated using Top-N accuracy metrics, specifically Recall@N.
graph TD;
A[Data Collection: News Dataset] --> B[Data Pre-processing: Interaction Weighting & Filtering];
B --> C[Model Development: Hybrid Model];
C --> D[Combine Content-Based, Collaborative, Popularity Scores];
D --> E[Model Training];
E --> F[Model Evaluation: Recall@N];
F --> G[Results Analysis];
G --> H[Conclusion & Implications];
Standalone recommender systems like Content-Based Filtering and Collaborative Filtering have limitations such as cold-start and plasticity. The proposed hybrid approach effectively mitigates these issues by combining the strengths of multiple models. The integration of a popularity-based model further enhances accuracy and addresses the cold-start problem by leveraging trending items. The research suggests that this hybrid approach can be extended beyond news recommendations to other domains like e-commerce.
The proposed hybrid model, when combined with the popularity-based model, achieved a Recall@10 of 90%. The best-performing standalone model achieved an efficiency (Recall@10) of 53%. The hybrid model demonstrated higher accuracy compared to individual Content-Based, Collaborative, and Popularity-Based models.
A Weighted Hybrid Model combining Content-Based Filtering, Collaborative Filtering, and Popularity-Based recommender systems was successfully developed. This hybrid model significantly improved recommendation accuracy, achieving 90% Recall@10, outperforming individual models. The research highlights the effectiveness of hybridization in addressing the limitations of standalone recommender systems and suggests its applicability to various recommendation domains.
- The hybrid model combined with the popularity-based model achieved a Recall@10 of 90%.
- The best-performing standalone model achieved an efficiency (Recall@10) of 53%.
- The dataset used contained data from approximately 73,000 logged-in users and over 3,000 user interactions before pre-processing.
Loading PDF...
Loading Statistics...