Solr之自动聚类。

淩亂°似流年 2024-02-18 16:08 58阅读 0赞

Solr使用Carrot2完成了聚类功能，能够把检索到的内容自动分类，Carrot2聚类示例：

> ![20171027170026758][]

要想Solr支持聚类功能，首先要把Solr发行包中的dist/solr-clustering-4.2.0.jar，复制到\\solr\\contrib\\analysis-extras\\lib下，然后打开sonlrconfig.xml进行添加配置：

> <lst name = "engine">
> 
> > <str name = "name">default</str>
> > 
> > <str name = "carrot.algorithm">org.carrot2.clustering.lingo.LingoClusteringAlgorithm</str>
> > 
> > <str name = "LingoClusteringAlgorithm.desiredClusterCountBase">30</str> 
> > 
> > <str name = "LingoClusteringAlgorithm.clusterMergingThreshold">0.70</str> 
> > 
> > <str name = "LingoClusteringAlgorithm.scoreWeight">0</str> 
> > 
> > <str name = "LingoClusteringAlgorithm.labelAssigner">org.carrot2.clustering.lingo.SimpleLabelAssigner</str> <! -- org.carrot2.clustering.lingo.UniqueLabelAssigner -->
> > 
> > <str name = "LingoClusteringAlgorithm.phraseLabelBoost">1.5</str> 
> > 
> > <str name = "LingoClusteringAlgorithm.phraseLengthPenaltyStart">8</str> 
> > 
> > <str name = "LingoClusteringAlgorithm.phraseLengthPenaltyShop">8</str> 
> > 
> > <str name = "TermDocumentMatrixReducer.factorizationQuality">HIGH</str>   
> > .......  
> > 
> 
> </lst>

</searchComponent>

配好了聚类组件后，下面配置requestHandler：

> <lst name = "default">
> 
> > <str name = "echoParams">explicit</str>
> > 
> > <bool name = "clustering">true</bool>
> > 
> > <str name = "clustering.engine">default</str>
> > 
> > <bool name = "clustering.results">default</bool>
> > 
> > <str name = "carrot.title">category\_s</str>
> > 
> > <str name = "carrot.snippet">content</str>
> > 
> > <str name = "carrot.url">path</str>
> > 
> > <str name = "carrot.produceSummary">true</str>  
> > 
> 
> </lst>
> 
> <arr name = "last-components">
> 
> > <str>clustering</str>  
> > 
> 
> </arr>  
>

</requestHandler>

有两个参数要注意carrot.title，carrot.snippet是聚类的比较计算字段，这两个参数必须是stored="true"，carrot.title的权重要高于carrot.snippet，如果只有一个做计算的字段carrot.snippet可以去掉（是去掉不是值为空）。设完了用下面的URL就可以查询了。

> http://localhost:8080/skyCore/clustering?q=\*3A\*&wt=xml&indent=true  
>

[20171027170026758]: https://image.dandelioncloud.cn/pgy_files/images/2024/01/29/cc87352cfff048d684f0f7397360b7cf.png