nhirakawa / Bm25
Licence: mit
A Python implementation of the BM25 ranking function.
Stars: ✭ 159
Programming Languages
python
139335 projects - #7 most used programming language
Projects that are alternatives of or similar to Bm25
evildork
Evildork targeting your fiancee👁️
Stars: ✭ 46 (-71.07%)
Mutual labels: search-engine, information-retrieval
Lucene Solr
Apache Lucene and Solr open-source search software
Stars: ✭ 4,217 (+2552.2%)
Mutual labels: search-engine, information-retrieval
query-wellformedness
25,100 queries from the Paralex corpus (Fader et al., 2013) annotated with human ratings of whether they are well-formed natural language questions.
Stars: ✭ 80 (-49.69%)
Mutual labels: search-engine, information-retrieval
Vectorsinsearch
Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Searching with Vectors' talk from Haystack 2019 (US). Builds upon my conceptual search and semantic search work from 2015
Stars: ✭ 71 (-55.35%)
Mutual labels: search-engine, information-retrieval
solr
Apache Solr open-source search software
Stars: ✭ 651 (+309.43%)
Mutual labels: search-engine, information-retrieval
Sparkler
Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
Stars: ✭ 362 (+127.67%)
Mutual labels: search-engine, information-retrieval
Search Engine
A math-aware search engine.
Stars: ✭ 278 (+74.84%)
Mutual labels: search-engine, information-retrieval
Relevancyfeedback
Dice.com's relevancy feedback solr plugin created by Simon Hughes (Dice). Contains request handlers for doing MLT style recommendations, conceptual search, semantic search and personalized search
Stars: ✭ 19 (-88.05%)
Mutual labels: search-engine, information-retrieval
Resin
Hardware-accelerated vector-based search engine. Available as a HTTP service or as an embedded library.
Stars: ✭ 529 (+232.7%)
Mutual labels: search-engine, information-retrieval
patzilla
PatZilla is a modular patent information research platform and data integration toolkit with a modern user interface and access to multiple data sources.
Stars: ✭ 71 (-55.35%)
Mutual labels: search-engine, information-retrieval
Rated Ranking Evaluator
Search Quality Evaluation Tool for Apache Solr & Elasticsearch search-based infrastructures
Stars: ✭ 134 (-15.72%)
Mutual labels: search-engine, information-retrieval
Conceptualsearch
Train a Word2Vec model or LSA model, and Implement Conceptual Search\Semantic Search in Solr\Lucene - Simon Hughes Dice.com, Dice Tech Jobs
Stars: ✭ 245 (+54.09%)
Mutual labels: search-engine, information-retrieval
lucene
Apache Lucene open-source search software
Stars: ✭ 1,009 (+534.59%)
Mutual labels: search-engine, information-retrieval
Aquiladb
Drop in solution for Decentralized Neural Information Retrieval. Index latent vectors along with JSON metadata and do efficient k-NN search.
Stars: ✭ 222 (+39.62%)
Mutual labels: search-engine, information-retrieval
Pisa
PISA: Performant Indexes and Search for Academia
Stars: ✭ 489 (+207.55%)
Mutual labels: search-engine, information-retrieval
Haystack
🔍 Haystack is an open source NLP framework that leverages Transformer models. It enables developers to implement production-ready neural search, question answering, semantic document search and summarization for a wide range of applications.
Stars: ✭ 3,409 (+2044.03%)
Mutual labels: search-engine, information-retrieval
Sf1r Lite
Search Formula-1——A distributed high performance massive data engine for enterprise/vertical search
Stars: ✭ 158 (-0.63%)
Mutual labels: search-engine, information-retrieval
Olefile
olefile is a Python package to parse, read and write Microsoft OLE2 files (also called Structured Storage, Compound File Binary Format or Compound Document File Format), such as Microsoft Office 97-2003 documents, vbaProject.bin in MS Office 2007+ files, Image Composer and FlashPix files, Outlook messages, StickyNotes, several Microscopy file formats, McAfee antivirus quarantine files, etc.
Stars: ✭ 142 (-10.69%)
Mutual labels: parse
Tutorial Utilizing Kg
Resources for Tutorial on "Utilizing Knowledge Graphs in Text-centric Information Retrieval"
Stars: ✭ 148 (-6.92%)
Mutual labels: information-retrieval
BM25
A Python implementation of the BM25 ranking function.
Implementation
There are 4 main modules of the program: parser, query processor, ranking function, and data structures. The parser module parses the query file and the corpus file to produce a list and a dictionary, respectively. The query processor takes each query in the query list and scores the documents based on the terms. The ranking function is an implementation of the BM25 ranking function; it uses the natural logarithm in its calculations. Finally, the data structures module contains an inverted index and a document length table. The inverted index use a dictionary to map each word to a dictionary; this secondary dictionary maps each document id to the word frequency in the outer dictionary. The document length table contains the length of each document, and also has a function to calculate the average document length of the collection.
How To Run
To run, simply run $ python main.py in the src folder.
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].