A Testbed to Evaluate the Robustness of Reputation Systems in E-Marketplaces

Existing testbeds to evaluate reputation systems are mainly simulation based and are not flexible to perform robustness evaluations against unfair rating attacks. In this paper, we present a novel comprehensive testbed, which can evaluate reputation systems using both simulations and real data. The testbed incorporates sophisticated deception models and unfair rating attack models, and introduces several performance metrics to fully test and compare the effectiveness and robustness of different reputation systems.