155 Open source projects that are alternatives of or similar to awesome-pretrained-models-for-information-retrieval

CIKM'21: JPQ substantially improves the efficiency of Dense Retrieval with 30x compression ratio, 10x CPU speedup and 2x GPU speedup.

SIGIR'21: Optimizing DR with hard negatives and achieving SOTA first-stage retrieval performance on TREC DL Track.

Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.

HDLTex: Hierarchical Deep Learning for Text Classification

Simple NLP in Rust with Python bindings

Python interface to the Anserini IR toolkit built on Lucene

Accelerated deep learning R&D

A curated list of NLP resources for Hungarian

PatZilla is a modular patent information research platform and data integration toolkit with a modern user interface and access to multiple data sources.

A Java client for the Sypht API

NeuralQA: A Usable Library for Question Answering on Large Datasets with BERT

Keyword extraction using TextRank algorithm after pre-processing the text with lemmatization, filtering unwanted parts-of-speech and other techniques.

Topic Modelling for Humans

Train a Word2Vec model or LSA model, and Implement Conceptual Search\Semantic Search in Solr\Lucene - Simon Hughes Dice.com, Dice Tech Jobs

Deep neural network to extract intelligent information from invoice documents.

25,100 queries from the Paralex corpus (Fader et al., 2013) annotated with human ratings of whether they are well-formed natural language questions.

The Cognitive Foundry is an open-source Java library for building intelligent systems using machine learning

My (slightly modified) Keras implementation of RankNet and PyTorch implementation of LambdaRank.

🏴‍☠️ Information Gathering tool 🏴‍☠️ DNS / Subdomains / Ports / Directories enumeration

Code repo for SIGIR 2021 paper "Few-Shot Conversational Dense Retrieval"

Semantic Entity Retrieval Toolkit

An Open-Source Package for Information Retrieval.

Dice Solr Plugins from Simon Hughes Dice.com

Financial Domain Question Answering with pre-trained BERT Language Model

High performance tokenizers for natural language processing and other related tasks

Learning to Rank in TensorFlow

Web Service for E-Discovery Analytics

Search Formula-1——A distributed high performance massive data engine for enterprise/vertical search

Official code for WACV 2021 paper - Compositional Learning of Image-Text Query for Image Retrieval

Terrier IR Platform

Content Based Image Retrieval Techniques (e.g. knn, svm using MatLab GUI)

Resources for Tutorial on "Utilizing Knowledge Graphs in Text-centric Information Retrieval"

Trinity IR Infrastructure

Entity-Duet Neural Ranking Model

No description or website provided.

Search Quality Evaluation Tool for Apache Solr & Elasticsearch search-based infrastructures

Drop in solution for Decentralized Neural Information Retrieval. Index latent vectors along with JSON metadata and do efficient k-NN search.

My solution to the Natural Language Processing course made by Dan Jurafsky, Chris Manning in Winter 2012.

Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval" https://arxiv.org/abs/2112.07577

🔍 Haystack is an open source NLP framework that leverages Transformer models. It enables developers to implement production-ready neural search, question answering, semantic document search and summarization for a wide range of applications.

Burp Extender plugin that generates a sitemap of a website using Wayback Machine

pytrec_eval is an Information Retrieval evaluation tool for Python, based on the popular trec_eval.

A simple tutorial of Lucene for LIS 501 Introduction to Text Mining students at the University of Wisconsin-Madison (Fall 2021).

A library of inverted index data structures

A Collection of BM25 Algorithms in Python

Flexible classic and NeurAl Retrieval Toolkit

⚡ A fast embedded library for approximate nearest neighbor search

Forte is a flexible and powerful NLP builder FOR TExt. This is part of the CASL project: http://casl-project.ai/

Word Embeddings for Information Retrieval

pyndri is a Python interface to the Indri search engine.

A keyphrase extractor for Persian

Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Searching with Vectors' talk from Haystack 2019 (US). Builds upon my conceptual search and semantic search work from 2015

K-NRM: End-to-End Neural Ad-hoc Ranking with Kernel Pooling

Unofficial Gaana API

Solutions of the various test exams of the Information Retrieval course

Vietnamese question answering system with BERT

Books worth spreading

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

Apache Solr open-source search software

Crawlzone is a fast asynchronous internet crawling framework for PHP.