首頁>編程相關>其他源碼
下載

JStarCraft RNS

希望路過的同學,順手給JStarCraft框架點個Star,算是對作者的一種鼓勵吧!

目錄

  • 介紹
  • 特性
  • 安裝
    • 安裝JStarCraft Core框架
    • 安裝JStarCraft AI框架
    • 安裝JStarCraft RNS引擎
  • 使用
    • 設定依賴
    • 建置配置器
    • 訓練與評估模型
    • 取得模型
  • 架構
  • 概念
    • 為什麼需要資訊檢索
    • 搜尋與推薦的異同
    • JStarCraft RNS引擎解決什麼問題
    • Ranking任務與Rating任務之間的區別
    • Rating演算法能不能用於Ranking問題
  • 範例
    • JStarCraft RNS引擎與BeanShell腳本交互
    • JStarCraft RNS引擎與Groovy腳本交互
    • JStarCraft RNS引擎與JS腳本交互
    • JStarCraft RNS引擎與Kotlin腳本交互
    • JStarCraft RNS引擎與Lua腳本交互
    • JStarCraft RNS引擎與Python腳本交互
    • JStarCraft RNS引擎與Ruby腳本交互
  • 對比
    • 排序模型對比
    • 評分模型對比
  • 版本
  • 參考
    • 個性化模型說明
    • 數據集說明
  • 協定
  • 作者
  • 致謝
  • 捐贈

介紹

JStarCraft RNS是一個面向資訊檢索領域的輕量級引擎.遵循Apache 2.0協定.

專注於解決資訊檢索領域的基本問題:推薦與搜尋.

提供滿足工業級場景要求的建議引擎設計與實現.

提供滿足工業級場景要求的搜尋引擎設計與實現.

特性

  • 1.跨平台
  • 2.串行與平行計算
  • 3.CPU與GPU硬體加速
  • 4.模型保存裝載
  • 5.豐富的推薦與搜尋演算法
  • 6.豐富的腳本支持
    • Groovy
    • JS
    • Lua
    • MVEL
    • Python
    • Ruby
  • 7.豐富的評估指標
    • 排序指標
    • 評分指標

安裝

JStarCraft RNS要求使用者俱備以下環境:

  • JDK 8或以上
  • Maven 3

安裝JStarCraft-Core框架

git clone https://github.com/HongZhaoHua/jstarcraft-core.git

mvn install -Dmaven.test.skip=true

安裝JStarCraft-AI框架

git clone https://github.com/HongZhaoHua/jstarcraft-ai.git

mvn install -Dmaven.test.skip=true

安裝JStarCraft-RNS引擎

git clone https://github.com/HongZhaoHua/jstarcraft-rns.git

mvn install -Dmaven.test.skip=true

使用

設定依賴

  • 設定Maven依賴
 <dependency>
    <groupId>com.jstarcraft</groupId>
    <artifactId>rns</artifactId>
    <version>1.0</version>
</dependency>
  • 設定Gradle依賴
compile group : ' com.jstarcraft ' , name : ' rns ' , version : ' 1.0 '

建置配置器

 Properties keyValues = new Properties ();
keyValues . load ( this . getClass (). getResourceAsStream ( "/data.properties" ));
keyValues . load ( this . getClass (). getResourceAsStream ( "/recommend/benchmark/randomguess-test.properties" ));
Configurator configurator = new Configurator ( keyValues );

訓練與評估模型

  • 建構排序任務
 RankingTask task = new RankingTask ( RandomGuessModel . class , configurator );
// 训练与评估排序模型
task . execute ();
  • 建構評分任務
 RatingTask task = new RatingTask ( RandomGuessModel . class , configurator );
// 训练与评估评分模型
task . execute ();

取得模型

 // 获取模型
Model model = task . getModel ();

架構

概念

為什麼需要資訊檢索

随着信息技术和互联网的发展,人们逐渐从信息匮乏(Information Underload)的时代走入了信息过载(Information Overload)的时代.

无论是信息消费者还是信息生产者都遇到了挑战:
* 对于信息消费者,从海量信息中寻找信息,是一件非常困难的事情;
* 对于信息生产者,从海量信息中暴露信息,也是一件非常困难的事情;

信息检索的任务就是联系用户和信息,一方面帮助用户寻找对自己有价值的信息,另一方面帮助信息暴露给对它感兴趣的用户,从而实现信息消费者和信息生产者的双赢.

搜尋與推薦的異同

从信息检索的角度:
* 搜索和推荐是获取信息的两种主要手段;
* 搜索和推荐是获取信息的两种不同方式;
    * 搜索(Search)是主动明确的;
    * 推荐(Recommend)是被动模糊的;

搜索和推荐是两个互补的工具.

JStarCraft-RNS引擎解決什麼問題

 JStarCraft-RNS引擎旨在解决推荐与搜索领域的两个核心任务:排序预测(Ranking)和评分预测(Rating).

Ranking任務與Rating任務之間的區別

根据解决基本问题的不同,将算法与评估指标划分为排序(Ranking)与评分(Rating).

两者之间的根本区别在于目标函数的不同.
通俗点的解释:
Ranking算法基于隐式反馈数据,趋向于拟合用户的排序.(关注度)
Rating算法基于显示反馈数据,趋向于拟合用户的评分.(满意度)

Rating演算法能不能用於Ranking問題

关键在于具体场景中,关注度与满意度是否保持一致.
通俗点的解释:
人们关注的东西,并不一定是满意的东西.(例如:个人所得税)

範例

JStarCraft-RNS引擎與BeanShell腳本交互

  • 完整範例

  • 編寫BeanShell腳本訓練與評估模型並儲存到Model.bsh文件

 // 构建配置
keyValues = new Properties();
keyValues.load(loader.getResourceAsStream("data.properties"));
keyValues.load(loader.getResourceAsStream("model/benchmark/randomguess-test.properties"));
configurator = new Configurator(keyValues);

// 此对象会返回给Java程序
_data = new HashMap();

// 构建排序任务
task = new RankingTask(RandomGuessModel.class, configurator);
// 训练与评估模型并获取排序指标
measures = task.execute();
_data.put("precision", measures.get(PrecisionEvaluator.class));
_data.put("recall", measures.get(RecallEvaluator.class));

// 构建评分任务
task = new RatingTask(RandomGuessModel.class, configurator);
// 训练与评估模型并获取评分指标
measures = task.execute();
_data.put("mae", measures.get(MAEEvaluator.class));
_data.put("mse", measures.get(MSEEvaluator.class));

_data;
  • 使用JStarCraft框架從Model.bsh檔案載入並執行BeanShell腳本
 // 获取BeanShell脚本
File file = new File ( ScriptTestCase . class . getResource ( "Model.bsh" ). toURI ());
String script = FileUtils . readFileToString ( file , StringUtility . CHARSET );

// 设置BeanShell脚本使用到的Java类
ScriptContext context = new ScriptContext ();
context . useClasses ( Properties . class , Assert . class );
context . useClass ( "Configurator" , MapConfigurator . class );
context . useClasses ( "com.jstarcraft.ai.evaluate" );
context . useClasses ( "com.jstarcraft.rns.task" );
context . useClasses ( "com.jstarcraft.rns.model.benchmark" );
// 设置BeanShell脚本使用到的Java变量
ScriptScope scope = new ScriptScope ();
scope . createAttribute ( "loader" , loader );

// 执行BeanShell脚本
ScriptExpression expression = new GroovyExpression ( context , scope , script );
Map < String , Float > data = expression . doWith ( Map . class );
Assert . assertEquals ( 0.005825241F , data . get ( "precision" ), 0F );
Assert . assertEquals ( 0.011579763F , data . get ( "recall" ), 0F );
Assert . assertEquals ( 1.2708743F , data . get ( "mae" ), 0F );
Assert . assertEquals ( 2.425075F , data . get ( "mse" ), 0F );

JStarCraft-RNS引擎與Groovy腳本交互

  • 完整範例

  • 編寫Groovy腳本訓練與評估模型並儲存到Model.groovy文件

 // 构建配置
def keyValues = new Properties ();
keyValues . load(loader . getResourceAsStream( " data.properties " ));
keyValues . load(loader . getResourceAsStream( " recommend/benchmark/randomguess-test.properties " ));
def configurator = new Configurator (keyValues);

// 此对象会返回给Java程序
def _data = [:];

// 构建排序任务
task = new RankingTask ( RandomGuessModel . class, configurator);
// 训练与评估模型并获取排序指标
measures = task . execute();
_data . precision = measures . get( PrecisionEvaluator . class);
_data . recall = measures . get( RecallEvaluator . class);

// 构建评分任务
task = new RatingTask ( RandomGuessModel . class, configurator);
// 训练与评估模型并获取评分指标
measures = task . execute();
_data . mae = measures . get( MAEEvaluator . class);
_data . mse = measures . get( MSEEvaluator . class);

_data;
  • 使用JStarCraft框架從Model.groovy檔案載入並執行Groovy腳本
 // 获取Groovy脚本
File file = new File ( ScriptTestCase . class . getResource ( "Model.groovy" ). toURI ());
String script = FileUtils . readFileToString ( file , StringUtility . CHARSET );

// 设置Groovy脚本使用到的Java类
ScriptContext context = new ScriptContext ();
context . useClasses ( Properties . class , Assert . class );
context . useClass ( "Configurator" , MapConfigurator . class );
context . useClasses ( "com.jstarcraft.ai.evaluate" );
context . useClasses ( "com.jstarcraft.rns.task" );
context . useClasses ( "com.jstarcraft.rns.model.benchmark" );
// 设置Groovy脚本使用到的Java变量
ScriptScope scope = new ScriptScope ();
scope . createAttribute ( "loader" , loader );

// 执行Groovy脚本
ScriptExpression expression = new GroovyExpression ( context , scope , script );
Map < String , Float > data = expression . doWith ( Map . class );

JStarCraft-RNS引擎與JS腳本交互

  • 完整範例

  • 編寫JS腳本訓練與評估模型並儲存到Model.js文件

 // 构建配置
var keyValues = new Properties ( ) ;
keyValues . load ( loader . getResourceAsStream ( "data.properties" ) ) ;
keyValues . load ( loader . getResourceAsStream ( "recommend/benchmark/randomguess-test.properties" ) ) ;
var configurator = new Configurator ( [ keyValues ] ) ;

// 此对象会返回给Java程序
var _data = { } ;

// 构建排序任务
task = new RankingTask ( RandomGuessModel . class , configurator ) ;
// 训练与评估模型并获取排序指标
measures = task . execute ( ) ;
_data [ 'precision' ] = measures . get ( PrecisionEvaluator . class ) ;
_data [ 'recall' ] = measures . get ( RecallEvaluator . class ) ;

// 构建评分任务
task = new RatingTask ( RandomGuessModel . class , configurator ) ;
// 训练与评估模型并获取评分指标
measures = task . execute ( ) ;
_data [ 'mae' ] = measures . get ( MAEEvaluator . class ) ;
_data [ 'mse' ] = measures . get ( MSEEvaluator . class ) ;

_data ;
  • 使用JStarCraft框架從Model.js檔案載入並執行JS腳本
 // 获取JS脚本
File file = new File ( ScriptTestCase . class . getResource ( "Model.js" ). toURI ());
String script = FileUtils . readFileToString ( file , StringUtility . CHARSET );

// 设置JS脚本使用到的Java类
ScriptContext context = new ScriptContext ();
context . useClasses ( Properties . class , Assert . class );
context . useClass ( "Configurator" , MapConfigurator . class );
context . useClasses ( "com.jstarcraft.ai.evaluate" );
context . useClasses ( "com.jstarcraft.rns.task" );
context . useClasses ( "com.jstarcraft.rns.model.benchmark" );
// 设置JS脚本使用到的Java变量
ScriptScope scope = new ScriptScope ();
scope . createAttribute ( "loader" , loader );

// 执行JS脚本
ScriptExpression expression = new JsExpression ( context , scope , script );
Map < String , Float > data = expression . doWith ( Map . class );

JStarCraft-RNS引擎與Kotlin腳本交互

  • 完整範例

  • 編寫Kotlin腳本訓練與評估模型並儲存到Model.kt文件

 // 构建配置
var keyValues = Properties ( ) ;
var loader = bindings [ "loader" ] as ClassLoader ;
keyValues . load ( loader . getResourceAsStream ( "data.properties" ) ) ;
keyValues . load ( loader . getResourceAsStream ( "model/benchmark/randomguess-test.properties" ) ) ;
var option = Option ( keyValues ) ;

// 此对象会返回给Java程序
var _data = mutableMapOf < String , Float > ( ) ;

// 构建排序任务
var rankingTask = RankingTask ( RandomGuessModel :: class . java , option ) ;
// 训练与评估模型并获取排序指标
val rankingMeasures = rankingTask . execute ( ) ;
_data [ "precision" ] = rankingMeasures . getFloat ( PrecisionEvaluator :: class . java ) ;
_data [ "recall" ] = rankingMeasures . getFloat ( RecallEvaluator :: class . java ) ;

// 构建评分任务
var ratingTask = RatingTask ( RandomGuessModel :: class . java , option ) ;
// 训练与评估模型并获取评分指标
var ratingMeasures = ratingTask . execute ( ) ;
_data [ "mae" ] = ratingMeasures . getFloat ( MAEEvaluator :: class . java ) ;
_data [ "mse" ] = ratingMeasures . getFloat ( MSEEvaluator :: class . java ) ;

_data ;
  • 使用JStarCraft框架從Model.kt檔案載入並執行Kotlin腳本
 // 获取Kotlin脚本
File file = new File ( ScriptTestCase . class . getResource ( "Model.kt" ). toURI ());
String script = FileUtils . readFileToString ( file , StringUtility . CHARSET );

// 设置Kotlin脚本使用到的Java类
ScriptContext context = new ScriptContext ();
context . useClasses ( Properties . class , Assert . class );
context . useClass ( "Option" , MapOption . class );
context . useClasses ( "com.jstarcraft.ai.evaluate" );
context . useClasses ( "com.jstarcraft.rns.task" );
context . useClasses ( "com.jstarcraft.rns.model.benchmark" );
// 设置Kotlin脚本使用到的Java变量
ScriptScope scope = new ScriptScope ();
scope . createAttribute ( "loader" , loader );

// 执行Kotlin脚本
ScriptExpression expression = new KotlinExpression ( context , scope , script );
Map < String , Float > data = expression . doWith ( Map . class );

JStarCraft-RNS引擎與Lua腳本交互

  • 完整範例

  • 編寫Lua腳本訓練與評估模型並儲存到Model.lua文件

 -- 构建配置
local keyValues = Properties . new ();
keyValues : load ( loader : getResourceAsStream ( " data.properties " ));

keyValues : load ( loader : getResourceAsStream ( " recommend/benchmark/randomguess-test.properties " ));
local configurator = Configurator . new ({ keyValues });

-- 此对象会返回给Java程序
local _data = {};

-- 构建排序任务
task = RankingTask . new ( RandomGuessModel , configurator );
-- 训练与评估模型并获取排序指标
measures = task : execute ();
_data [ " precision " ] = measures : get ( PrecisionEvaluator );
_data [ " recall " ] = measures : get ( RecallEvaluator );

-- 构建评分任务
task = RatingTask . new ( RandomGuessModel , configurator );
-- 训练与评估模型并获取评分指标
measures = task : execute ();
_data [ " mae " ] = measures : get ( MAEEvaluator );
_data [ " mse " ] = measures : get ( MSEEvaluator );

return _data ;
  • 使用JStarCraft框架從Model.lua檔案載入並執行Lua腳本
 // 获取Lua脚本
File file = new File ( ScriptTestCase . class . getResource ( "Model.lua" ). toURI ());
String script = FileUtils . readFileToString ( file , StringUtility . CHARSET );

// 设置Lua脚本使用到的Java类
ScriptContext context = new ScriptContext ();
context . useClasses ( Properties . class , Assert . class );
context . useClass ( "Configurator" , MapConfigurator . class );
context . useClasses ( "com.jstarcraft.ai.evaluate" );
context . useClasses ( "com.jstarcraft.rns.task" );
context . useClasses ( "com.jstarcraft.rns.model.benchmark" );
// 设置Lua脚本使用到的Java变量
ScriptScope scope = new ScriptScope ();
scope . createAttribute ( "loader" , loader );

// 执行Lua脚本
ScriptExpression expression = new LuaExpression ( context , scope , script );
LuaTable data = expression . doWith ( LuaTable . class );

JStarCraft-RNS引擎與Python腳本交互

  • 完整範例

  • 編寫Python腳本訓練與評估模型並儲存到Model.py文件

 # 构建配置
keyValues = Properties ()
keyValues . load ( loader . getResourceAsStream ( "data.properties" ))
keyValues . load ( loader . getResourceAsStream ( "recommend/benchmark/randomguess-test.properties" ))
configurator = Configurator ([ keyValues ])

# 此对象会返回给Java程序
_data = {}

# 构建排序任务
task = RankingTask ( RandomGuessModel , configurator )
# 训练与评估模型并获取排序指标
measures = task . execute ()
_data [ 'precision' ] = measures . get ( PrecisionEvaluator )
_data [ 'recall' ] = measures . get ( RecallEvaluator )

# 构建评分任务
task = RatingTask ( RandomGuessModel , configurator )
# 训练与评估模型并获取评分指标
measures = task . execute ()
_data [ 'mae' ] = measures . get ( MAEEvaluator )
_data [ 'mse' ] = measures . get ( MSEEvaluator )
  • 使用JStarCraft框架從Model.py檔案載入並執行Python腳本
 // 设置Python环境变量
System . setProperty ( "python.console.encoding" , StringUtility . CHARSET . name ());

// 获取Python脚本
File file = new File ( PythonTestCase . class . getResource ( "Model.py" ). toURI ());
String script = FileUtils . readFileToString ( file , StringUtility . CHARSET );

// 设置Python脚本使用到的Java类
ScriptContext context = new ScriptContext ();
context . useClasses ( Properties . class , Assert . class );
context . useClass ( "Configurator" , MapConfigurator . class );
context . useClasses ( "com.jstarcraft.ai.evaluate" );
context . useClasses ( "com.jstarcraft.rns.task" );
context . useClasses ( "com.jstarcraft.rns.model.benchmark" );
// 设置Python脚本使用到的Java变量
ScriptScope scope = new ScriptScope ();
scope . createAttribute ( "loader" , loader );

// 执行Python脚本
ScriptExpression expression = new PythonExpression ( context , scope , script );
Map < String , Double > data = expression . doWith ( Map . class );

JStarCraft-Ruby

  • 完整範例

  • 編寫Ruby腳本訓練與評估模型並儲存到Model.rb文件

 # 构建配置
keyValues = Properties . new ( )
keyValues . load ( $loader . getResourceAsStream ( "data.properties" ) )
keyValues . load ( $loader . getResourceAsStream ( "model/benchmark/randomguess-test.properties" ) )
configurator = Configurator . new ( keyValues )

# 此对象会返回给Java程序
_data = Hash . new ( )

# 构建排序任务
task = RankingTask . new ( RandomGuessModel . java_class , configurator )
# 训练与评估模型并获取排序指标
measures = task . execute ( )
_data [ 'precision' ] = measures . get ( PrecisionEvaluator . java_class )
_data [ 'recall' ] = measures . get ( RecallEvaluator . java_class )

# 构建评分任务
task = RatingTask . new ( RandomGuessModel . java_class , configurator )
# 训练与评估模型并获取评分指标
measures = task . execute ( )
_data [ 'mae' ] = measures . get ( MAEEvaluator . java_class )
_data [ 'mse' ] = measures . get ( MSEEvaluator . java_class )

_data ;
  • 使用JStarCraft框架從Model.rb檔案載入並執行Ruby腳本
 // 获取Ruby脚本
File file = new File ( ScriptTestCase . class . getResource ( "Model.rb" ). toURI ());
String script = FileUtils . readFileToString ( file , StringUtility . CHARSET );

// 设置Ruby脚本使用到的Java类
ScriptContext context = new ScriptContext ();
context . useClasses ( Properties . class , Assert . class );
context . useClass ( "Configurator" , MapConfigurator . class );
context . useClasses ( "com.jstarcraft.ai.evaluate" );
context . useClasses ( "com.jstarcraft.rns.task" );
context . useClasses ( "com.jstarcraft.rns.model.benchmark" );
// 设置Ruby脚本使用到的Java变量
ScriptScope scope = new ScriptScope ();
scope . createAttribute ( "loader" , loader );

// 执行Ruby脚本
ScriptExpression expression = new RubyExpression ( context , scope , script );
Map < String , Double > data = expression . doWith ( Map . class );
Assert . assertEquals ( 0.005825241096317768D , data . get ( "precision" ), 0D );
Assert . assertEquals ( 0.011579763144254684D , data . get ( "recall" ), 0D );
Assert . assertEquals ( 1.270874261856079D , data . get ( "mae" ), 0D );
Assert . assertEquals ( 2.425075054168701D , data . get ( "mse" ), 0D );

對比

排序模型對比

  • 基準模型
名稱數據集訓練(毫秒)預測(毫秒) AUC MAP MRR NDCG Novelty Precision Recall
MostPopular filmtrust 43 273 0.92080 0.41246 0.57196 0.51583 11.79295 0.33230 0.62385
RandomGuess filmtrust 38 391 0.51922 0.00627 0.02170 0.01121 91.94900 0.00550 0.01262
  • 協同模型
名稱數據集訓練(毫秒)預測(毫秒) AUC MAP MRR NDCG Novelty Precision Recall
AoBPR filmtrust 12448 253 0.89324 0.38967 0.53990 0.48338 21.13004 0.32295 0.56864
AspectRanking filmtrust 177 58 0.85130 0.15498 0.42480 0.26012 37.36273 0.13302 0.31292
BHFreeRanking filmtrust 5720 4257 0.92080 0.41316 0.57231 0.51662 11.79567 0.33276 0.62500
BPR filmtrust 4228 137 0.89390 0.39886 0.54790 0.49180 21.46738 0.32268 0.57623
BUCMRanking filmtrust 2111 1343 0.90782 0.39794 0.55776 0.49651 13.08073 0.32407 0.59141
CDAE filmtrust 89280 376 0.91880 0.40759 0.56855 0.51089 11.82466 0.33051 0.61967
CLiMF filmtrust 48429 140 0.88293 0.37395 0.52407 0.46572 19.38964 0.32049 0.54605
DeepFM filmtrust 69264 99 0.91679 0.40580 0.56995 0.50985 11.90242 0.32719 0.61426
EALS filmtrust 850 185 0.86132 0.31263 0.45680 0.39475 20.08964 0.27381 0.46271
FISMAUC filmtrust 2338 663 0.91216 0.40032 0.55730 0.50114 12.07469 0.32845 0.60294
FISMRMSE filmtrust 4030 729 0.91482 0.40795 0.56470 0.50920 11.91234 0.33044 0.61107
GBPR filmtrust 14827 150 0.92113 0.41003 0.57144 0.51464 11.87609 0.33090 0.62512
HMM game 38697 11223 0.80559 0.18156 0.37516 0.25803 16.01041 0.14572 0.22810
ItemBigram filmtrust 12492 61 0.88807 0.33520 0.46870 0.42854 17.11172 0.29191 0.53308
ItemKNNRanking filmtrust 2683 250 0.87438 0.33375 0.46951 0.41767 20.23449 0.28581 0.49248
LDA filmtrust 696 161 0.91980 0.41758 0.58130 0.52003 12.31348 0.33336 0.62274
LambdaFMStatic game 25052 27078 0.87064 0.27294 0.43640 0.34794 16.47330 0.13941 0.35696
LambdaFMWeight game 25232 28156 0.87339 0.27333 0.43720 0.34728 14.71413 0.13742 0.35252
LambdaFMDynamic game 74218 27921 0.87380 0.27288 0.43648 0.34706 13.50578 0.13822 0.35132
ListwiseMF filmtrust 714 161 0.90820 0.40511 0.56619 0.50521 15.53665 0.32944 0.60092
PLSA filmtrust 1027 116 0.89950 0.41217 0.57187 0.50597 16.01080 0.32401 0.58557
RankALS filmtrust 3285 182 0.85901 0.29255 0.51014 0.38871 25.27197 0.22931 0.42509
RankCD product 1442 8905 0.56271 0.01253 0.04618 0.02682 55.42019 0.01548 0.03520
RankSGD filmtrust 309 113 0.80388 0.23587 0.42290 0.32081 42.83305 0.19363 0.35374
RankVFCD product 54273 6524 0.58022 0.01784 0.06181 0.03664 62.95810 0.01980 0.04852
SLIM filmtrust 62434 91 0.91849 0.44851 0.61083 0.54557 16.67990 0.34019 0.63021
UserKNNRanking filmtrust 1154 229 0.90752 0.41616 0.57525 0.51393 12.90921 0.32891 0.60152
VBPR product 184473 15304 0.54336 0.00920 0.03522 0.01883 45.05101 0.01037 0.02266
WBPR filmtrust 20705 183 0.78072 0.24647 0.33373 0.30442 17.18609 0.25000 0.35516
WRMF filmtrust 482 158 0.90616 0.43278 0.58284 0.52480 15.17956 0.32918 0.60780
RankGeoFM FourSquare 368436 1093 0.72708 0.05485 0.24012 0.11057 37.50040 0.07866 0.08640
SBPR filmtrust 41481 247 0.91010 0.41189 0.56480 0.50726 15.67905 0.32440 0.59699
  • 內容模型
名稱數據集訓練(毫秒)預測(毫秒) AUC MAP MRR NDCG Novelty Precision Recall
EFMRanking dc_dense 2066 2276 0.61271 0.01611 0.04631 0.04045 53.26140 0.02387 0.07357
TFIDF musical_instruments 942 1085 0.52756 0.01067 0.01917 0.01773 72.71228 0.00588 0.03103

評分模型對比

  • 基準模型
名稱數據集訓練(毫秒)預測(毫秒) MAE MPE MSE
ConstantGuess filmtrust 137 45 1.05608 1.00000 1.42309
GlobalAverage filmtrust 60 13 0.71977 0.77908 0.85199
ItemAverage filmtrust 59 12 0.72968 0.97242 0.86413
ItemCluster filmtrust 471 41 0.71976 0.77908 0.85198
RandomGuess filmtrust 38 8 1.28622 0.99597 2.47927
UserAverage filmtrust 35 9 0.64618 0.97242 0.70172
UserCluster filmtrust 326 45 0.71977 0.77908 0.85199
  • 協同模型
名稱數據集訓練(毫秒)預測(毫秒) MAE MPE MSE
AspectRating filmtrust 220 5 0.65754 0.97918 0.71809
ASVDPlusPlus filmtrust 5631 8 0.71975 0.77921 0.85196
BiasedMF filmtrust 92 6 0.63157 0.98387 0.66220
BHFreeRating filmtrust 6667 76 0.71974 0.77908 0.85198
BPMF filmtrust 25942 52 0.66504 0.98465 0.70210
BUCMRating filmtrust 1843 30 0.64834 0.99102 0.67992
CCD product 15715 9 0.96670 0.93947 1.62145
FFM filmtrust 5422 6 0.63446 0.98413 0.66682
FMALS filmtrust 1854 5 0.64788 0.96032 0.73636
FMSGD filmtrust 3496 10 0.63452 0.98426 0.66710
GPLSA filmtrust 2567 7 0.67311 0.98972 0.79883
IRRG filmtrust 40284 6 0.64766 0.98777 0.73700
ItemKNNRating filmtrust 2052 27 0.62341 0.95394 0.67312
LDCC filmtrust 8650 84 0.66383 0.99284 0.70666
LLORMA filmtrust 16618 82 0.64930 0.96591 0.76067
MFALS filmtrust 2944 5 0.82939 0.94549 1.30547
NMF filmtrust 1198 8 0.67661 0.96604 0.83493
PMF filmtrust 215 7 0.72959 0.98165 0.99948
RBM filmtrust 19551 270 0.74484 0.98504 0.88968
RFRec filmtrust 16330 54 0.64008 0.97112 0.69390
SVDPlusPlus filmtrust 452 26 0.65248 0.99141 0.68289
URP filmtrust 1514 25 0.64207 0.99128 0.67122
UserKNNRating filmtrust 1121 135 0.63933 0.94640 0.69280
RSTE filmtrust 4052 10 0.64303 0.99206 0.67777
SocialMF filmtrust 918 13 0.64668 0.98881 0.68228
SoRec filmtrust 1048 10 0.64305 0.99232 0.67776
SoReg filmtrust 635 8 0.65943 0.96734 0.72760
TimeSVD filmtrust 11545 36 0.68954 0.93326 0.87783
TrustMF filmtrust 2038 7 0.63787 0.98985 0.69017
TrustSVD filmtrust 12465 22 0.61984 0.98933 0.63875
AssociationRule filmtrust 2628 195 0.90853 0.41801 0.57777
PersonalityDiagnosis filmtrust 45 642 0.72964 0.76620 1.03071
PRankD filmtrust 3321 170 0.74472 0.22894 0.32406
SlopeOne filmtrust 135 28 0.63788 0.96175 0.71057
  • 內容模型
名稱數據集訓練(毫秒)預測(毫秒) MAE MPE MSE
EFMRating dc_dense 659 8 0.61546 0.85364 0.78279
HFT musical_instruments 162753 13 0.64272 0.94886 0.81393
TopicMFAT musical_instruments 6907 7 0.61896 0.98734 0.72545
TopicMFMT musical_instruments 6323 7 0.61896 0.98734 0.72545

版本

參考

個性化模型說明

  • 基準模型
名稱問題說明/論文
RandomGuess Ranking Rating隨機猜測
MostPopular Ranking最受歡迎
ConstantGuess Rating常量猜測
GlobalAverage Rating全域平均
ItemAverage Rating物品平均
ItemCluster Rating物品聚類
UserAverage Rating用戶平均
UserCluster Rating使用者聚類
  • 協同模型
名稱問題說明/論文
AspectModel Ranking Rating Latent class models for collaborative filtering
BHFree Ranking Rating Balancing Prediction and Recommendation Accuracy: Hierarchical Latent Factors for Preference Data
BUCM Ranking Rating Modeling Item Selection and Relevance for Accurate Recommendations
ItemKNN Ranking Rating基於物品的協同過濾
UserKNN Ranking Rating基於使用者的協同過濾
AoBPR Ranking Improving pairwise learning for item recommendation from implicit feedback
BPR Ranking BPR: Bayesian Personalized Ranking from Implicit Feedback
CLiMF Ranking CLiMF: learning to maximize reciprocal rank with collaborative less-is-more filtering
EALS Ranking Collaborative filtering for implicit feedback dataset
FISM Ranking FISM: Factored Item Similarity Models for Top-N Recommender Systems
GBPR Ranking GBPR: Group Preference Based Bayesian Personalized Ranking for One-Class Collaborative Filtering
HMMForCF Ranking A Hidden Markov Model Purpose: A class for the model, including parameters
ItemBigram Ranking Topic Modeling: Beyond Bag-of-Words
LambdaFM Ranking LambdaFM: Learning Optimal Ranking with Factorization Machines Using Lambda Surrogates
LDA Ranking Latent Dirichlet Allocation for implicit feedback
ListwiseMF Ranking List-wise learning to rank with matrix factorization for collaborative filtering
PLSA Ranking Latent semantic models for collaborative filtering
RankALS Ranking Alternating Least Squares for Personalized Ranking
RankSGD Ranking Collaborative Filtering Ensemble for Ranking
SLIM Ranking SLIM: Sparse Linear Methods for Top-N Recommender Systems
WBPR Ranking Bayesian Personalized Ranking for Non-Uniformly Sampled Items
WRMF Ranking Collaborative filtering for implicit feedback datasets
Rank-GeoFM Ranking Rank-GeoFM: A ranking based geographical factorization method for point of interest recommendation
SBPR Ranking Leveraging Social Connections to Improve Personalized Ranking for Collaborative Filtering
AssociationRule Ranking A Recommendation Algorithm Using Multi-Level Association Rules
PRankD Ranking Personalised ranking with diversity
AsymmetricSVD++ Rating Factorization Meets the Neighborhood: a Multifaceted Collaborative Filtering Model
AutoRec Rating AutoRec: Autoencoders Meet Collaborative Filtering
BPMF Rating Bayesian Probabilistic Matrix Factorization using Markov Chain Monte Carlo
CCD Rating Large-Scale Parallel Collaborative Filtering for the Netflix Prize
FFM Rating Field Aware Factorization Machines for CTR Prediction
GPLSA Rating Collaborative Filtering via Gaussian Probabilistic Latent Semantic Analysis
IRRG Rating Exploiting Implicit Item Relationships for Recommender Systems
MFALS Rating Large-Scale Parallel Collaborative Filtering for the Netflix Prize
NMF Rating Algorithms for Non-negative Matrix Factorization
PMF Rating PMF: Probabilistic Matrix Factorization
RBM Rating Restricted Boltzman Machines for Collaborative Filtering
RF-Rec Rating RF-Rec: Fast and Accurate Computation of Recommendations based on Rating Frequencies
SVD++ Rating Factorization Meets the Neighborhood: a Multifaceted Collaborative Filtering Model
URP Rating User Rating Profile: a LDA model for rating prediction
RSTE Rating Learning to Recommend with Social Trust Ensemble
SocialMF Rating A matrix factorization technique with trust propagation for recommendation in social networks
SoRec Rating SoRec: Social recommendation using probabilistic matrix factorization
SoReg Rating Recommender systems with social regularization
TimeSVD++ Rating Collaborative Filtering with Temporal Dynamics
TrustMF Rating Social Collaborative Filtering by Trust
TrustSVD Rating TrustSVD: Collaborative Filtering with Both the Explicit and Implicit Influence of User Trust and of Item Ratings
PersonalityDiagnosis Rating A brief introduction to Personality Diagnosis
SlopeOne Rating Slope One Predictors for Online Rating-Based Collaborative Filtering
  • 內容模型
名稱問題說明/論文
EFM Ranking Rating Explicit factor models for explainable recommendation based on phrase-level sentiment analysis
TF-IDF Ranking詞頻-逆文檔頻率
HFT Rating Hidden factors and hidden topics: understanding rating dimensions with review text
TopicMF Rating TopicMF: Simultaneously Exploiting Ratings and Reviews for Recommendation

數據集說明

  • Amazon Dataset
  • Bibsonomy Dataset
  • BookCrossing Dataset
  • Ciao Dataset
  • Douban Dataset
  • Eachmovie Dataset
  • Epinions Dataset
  • Foursquare Dataset
  • Goodbooks Dataset
  • Gowalla Dataset
  • HetRec2011 Dataset
  • Jest Joker Dataset
  • Large Movie Review Dataset
  • MovieLens Dataset
  • Newsgroups Dataset
  • Stanford Large Network Dataset
  • Serendipity 2018 Dataset
  • Wikilens Dataset
  • Yelp Dataset
  • Yongfeng Zhang Dataset

協定

JStarCraft RNS遵循Apache 2.0協議,一切以其為基礎的衍生作品均屬於衍生作品的作者.

作者

作者洪鑷樺
E-mail [email protected], [email protected]

致謝

特別感謝LibRec團隊與推薦系統QQ群(274750470)在推薦方面提供的支持與幫助.

特別感謝陸徐剛在搜尋方面提供的支持與幫助.

捐贈

特別感謝杭州橙子資訊科技有限公司對JStarCraft專案的捐贈.

展開
附加信息
相關應用
爲您推薦
相關資訊 全部