Friday 6 December 2019

Expert ranking techniques for online rated forums

an article by Muhammad Shahzad Faisal (International Islamic University, Islamabad, Pakistan; COMSATS Institute of IT, Attock, Pakistan), Ali Daud (International Islamic University, Islamabad, Pakistan; FCIT, KAU, Jeddah, Saudi Arabia), Abubakr Usman Akram (COMSATS Institute of IT, Attock, Pakistan), Rabeeh Ayaz Abbasi (FCIT, KAU, Jeddah, Saudi Arabia; Quaid-i-Azam University, Islamabad, Pakistan), Naif Radi Aljohani (FCIT, KAU, Jeddah, Saudi Arabia) and Irfan Mehmood (Sejong University, Seoul, Korea) published in Computers in Human Behavior Volume 100 (November 2019)

Highlights

  • Proposal of Exp-PC and REP-FS techniques for ranking experts.
  • Exp-PC considers users consistency in providing quality answers.
  • Usage of large benchmark StackOverflow dataset for evaluation purposes.
  • Performance evaluation in terms of standard ranking performance measures.

Abstract

Web 2.0 or social web applications such as online discussion forums, blogs and Wikipedia have improved knowledge sharing by providing an environment in which users can generate and find their favourite content in, a flexible way. With the passage of time, online discussion forums accumulate a huge amount of content and this can introduce issues of content quality and user credibility.

A poor-quality answer in a discussion forum indicates the presence of unprofessional or unqualified users; therefore, a priority is to find experts or reputable users.

Most of the existing expert-ranking approaches consider basic features, such as the total number of answers provided by a user, but ignore the quality and consistency of the user's answer.

In this paper, expert-ranking techniques using g-index are proposed, and are applied to a StackOverflow forum dataset.

Three techniques are proposed including Exp-PC, Rep-FS and Weighted Exp-PC. Exp-PC is an adaptation of g-index for ranking experts in StackOverflow forum. In Rep-FS, several features like voters reputation, vote ratio are proposed to measure users' expertise while Weighted Exp-PC computes user expertise by combining their Exp-PC and Rep-FS scores.

We measure users' reputation and expertise according to both the quality of their answer and their consistency in providing quality answers.

The experimental results of the proposed expert-ranking techniques, Exp-PC and Weighted Exp-PC in particular, validate that these methods identify genuine experts in a more effective way.


No comments: