Projects tagged ‘lucene’ and ‘solr’

MiniG is a webmail written as an alternative to IMP for the OBM groupware solution. MiniG interface uses google web toolkit to provide a full ajax interface similar to GMail. OBM is an open source ... [More] alternative to exchange based on postfix, cyrus imap and openldap. [Less]

VuFind is a library resource portal designed and developed for libraries by libraries. The goal of VuFind is to enable your users to search and browse through all of your library's resources by ... [More] replacing the traditional OPAC to include: * Catalog Records * Digital Library Items * Institutional Repository * Institutional Bibliography * Other Library Collections and Resources VuFind is completely modular so you can implement just the basic system, or all of the components. And since it's open source, you can modify the modules to best fit your needs or you can add new modules to extend your resource offerings. [Less]

1、mmseg4j 用 Chih-Hao Tsai 的 MMSeg 算法(http://technology.chtsai.org/mmseg/ )实现的中文分词器，并实现 lucene 的 analyzer 和 solr 的TokenizerFactory ... [More] 以方便在Lucene和Solr中使用。 2、MMSeg 算法有两种分词方法：Simple和Complex，都是基于正向最大匹配。Complex 加了四个规则过虑。官方说：词语的正确识别率达到了 98.41%。mmseg4j 已经实现了这两种分词算法。 1.5版的分词速度simple算法是 1100kb/s左右、complex算法是 700kb/s左右，（测试机：AMD athlon 64 2800+ 1G内存 xp）。 1.6版在complex基础上实现了最多分词(max-word)。“很好听” -> "很好|好听"; “中华人民共和国” -> "中华|华人|共和|国"; “中国人民银行” -> "中国|人民|银行"。 1.7-beta 版, 目前 complex 1200kb/s左右, simple 1900kb/s左右, 但内存开销了50M左右. 上几个版都是在10M左右. mmseg4j实现的功能详情请看： http://mmseg4j.googlecode.com/svn/trunk/CHANGES.txt http://mmseg4j.googlecode.com/svn/branches/mmseg4j-1.7/CHANGES.txt http://mmseg4j.googlecode.com/svn/branches/mmseg4j-1.6/CHANGES.txt 3、在 com.chenlb.mmseg4j.example包里的类示例了三种分词效果。 4、在 com.chenlb.mmseg4j.analysis包里扩展lucene analyzer。MMSegAnalyzer默认使用max-word方式分词(还有：ComplexAnalyzer, SimplexAnalyzer, MaxWordAnalyzer)。 5、在 com.chenlb.mmseg4j.solr包里扩展solr tokenizerFactory。 在 solr的 schema.xml 中定义 field type如： dicPath 指定词库位置（每个MMSegTokenizerFactory可以指定不同的目录，当是相对目录时，是相对 solr.home 的目录），mode 指定分词模式（simple|complex|max-word，默认是max-word）。 6、运行，词典用mmseg.dic.path属性指定、在classpath 目录下或在当前目录下的data目录，默认是 classpath/data 目录。如果使用 mmseg4j-with-dic.jar 包可以不指定词库目录（如果指定也可以，它们也可以被加载）。 java -jar mmseg4j-core-1.8-with-dic.jar 这里是字符串。 java -cp .;mmseg4j-1.6.jar -Dmmseg.dic.path=./other-dic com.chenlb.mmseg4j.example.Simple 这里是字符串。 java -cp .;mmseg4j-1.6.jar com.chenlb.mmseg4j.example.MaxWord 这里是字符串 7、一些字符的处理 英文、俄文、希腊、数字（包括①㈠⒈）的分出一连串的。目前版本没有处理小数字问题， 如ⅠⅡⅢ是单字分，字库(chars.dic)中没找到也单字分。 8、词库(强制使用 UTF-8)： data/chars.dic 是单字与语料中的频率，一般不用改动，1.5版本中已经加到mmseg4j的jar里了，我们不需要关心它，当然你在词库目录放这个文件可以覆盖它。 data/units.dic 是单字的单位，默认读jar包里的，你也可以自定义覆盖它，这功能是试行，如果不喜欢它，可以空的units.dic文件(放到你的词库目录下)覆盖它。 data/words.dic 是词库文件，一行一词，当然你也可以使用自己的，1.5版本使用 sogou 词库，1.0的版本是用 rmmseg 带的词库。 data/wordsxxx.dic 1.6版支持多个词库文件，data 目录（或你定义的目录）下读到"words"前缀且".dic"为后缀的文件。如：data/words-my.dic。 9、MMseg4jHandler(1.8以后支持): 添加 MMseg4jHandler 类，可以在solr中用url的方式来控制加载检测词库。参数： dicPath 是指定词库的目录，特性与MMSegTokenizerFactory中的dicPath一样（相对目录是，是相对 solr.home）。 check 是指是否检测词库，其值是true 或 on。 reload 是否尝试加载词库，其值是 true 或 on。此值为 true，会忽视 check 参数。 solrconfig.xml： dic 此功能可以让外置程序做相关的控制，如：尝试加载词库，然后外置程序决定是否重做索引。 在 solr 1.3/1.4 与 lucene 2.3/2.4/2.9 测试过，官方博客 http://blog.chenlb.com/category/mmseg4j ， 如果发现问题或bug与我联系 chenlb2008#gmail.com 。 1.7.2 与 1.6.2 开始核心的程序与 lucene 和 solr 扩展分开打包，方便兼容低版本的 lucene，低版本（<= lucene 2.2）的 lucene 扩展请仿照 MMSegTokenizer.java。 有任何疑问、建议，欢迎到论坛 http://groups.google.com/group/mmseg4j/topics?hl=zh_CN 讨论。 可以在 http://code.google.com/p/mmseg4j/issues/list 提出 Bug 或 希望 mmseg4j 有的功能。 历史版本： 1.0.2 http://mmseg4j.googlecode.com/svn/branches/mmseg4j-1.0/ 1.5 http://mmseg4j.googlecode.com/svn/branches/mmseg4j-1.5/ 1.6.2 http://mmseg4j.googlecode.com/svn/branches/mmseg4j-1.6/ 1.7.3 http://mmseg4j.googlecode.com/svn/branches/mmseg4j-1.7/ [Less]

Gisgraphy is a free and open source framework. Its goal is to provide tools to use free GIS Data on the Web. Actually it manage Geonames and OpenStreetMap (34 million entries). it provides an importer ... [More] to inject the data into a strongly typed Postgres / Postgis database and use them via webservices : worldwide geocoding, worldwide reverse geocoding, fulltext and find nearby.Results can be output in XML, Atom, RSS, JSON, PHP, Ruby, and Python. Here are the main functionalities : Importers for Openstreetmap data in csv format Importers from geonames CSV files, reporting of inconsistencies and a report when import is complete. Just give the country(ies) you wish to import and / or the placetypes, and Gisgraphy download the files and import them with all the alternateNames (optional), and sync the database with the fulltext search engine REST Web Services Full text search (based on Lucene / Solr with default filters optimized for city search (case insensitivity, separator characters stripping, ..) via an Java API or a webservice An admin interface Fully replicated / scalable / high performance / cached services Findnearby function (with limits, pagination, restrict to a specific country and/or language and other useful options) via a Java API or a Web Service Search for zipcode or name Several output formats supported : XML, json, php, ruby, python, ATOM, GEORSS... Dojo widgets / prototype / Ajax to ease search but can be use it even if javascript is not enabled on the client side Plateform / language independent because of webservices Provides all the countries flags in svg and png format more... Note that Gisgraphy is under the LGPL license V3 and the Geonames data are under the creative commons attributions license [Less]

php_solr is a lightweight php client library for the Lucene-based enterprise search server Apache Solr.

Marjory is a webservice for indexing and searching for documents, utilizing a full-text search engine. It is somewhat similar to Solr, but is written in PHP and the underlying architecture allows ... [More] for using search engines other than Lucene (no other adaptor is implemented yet, though). Marjory is based on the Zend Framework and uses Zend_Search_Lucene as the default search engine. Initial development was sponsored by Jimdo, a company offering web-based tools to create free websites. [Less]

Fez is an open source project to produce and maintain a highly flexible web interface to FEDORA for any Library or Institution to configure and publish or archive documents of any type sustainably.

A lucene extension to provide a geographical boundary to searching. The main design is to provide a 'local search' functionality to lucene and solr users

SOLROM stands for Solr Object Mapper. It is a lightweight framework for mapping Java objects to/from a Solr search index. SOLROM relies on annotations only, so there are no XML configuration files involved.

This project aims to provide a set of java search API's. These API's are largely based on projects like Lucene, Compass, SOLR and others.