230 Open source projects that are alternatives of or similar to IR-exercises

Tools and recipes to train deep learning models and build services for NLP tasks such as text classification, semantic search ranking and recall fetching, cross-lingual information retrieval, and question answering etc.

Books worth spreading

Information Gathering Instagram.

A library of inverted index data structures

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

Burp Extender plugin that generates a sitemap of a website using Wayback Machine

Extract subdomains from SSL certificates in HTTPS sites.

Flexible classic and NeurAl Retrieval Toolkit

Scrape any website, article or RSS/Atom Feed with ease!

Search Formula-1——A distributed high performance massive data engine for enterprise/vertical search

allRank is a framework for training learning-to-rank neural models based on PyTorch.

Forte is a flexible and powerful NLP builder FOR TExt. This is part of the CASL project: http://casl-project.ai/

Automatically modelling and distilling knowledge within AI. In other words, summarising the AI research firehose.

Trinity IR Infrastructure

Examples of Solr configuration entries for Solr plugins and Conceptual Search\Semantic Search from Simon Hughes Dice.com

pyndri is a Python interface to the Indri search engine.

⛔ [NOT MAINTAINED] A web interface for cdQA and other question answering systems.

Terrier IR Platform

Learning Intents behind Interactions with Knowledge Graph for Recommendation, WWW2021

Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Searching with Vectors' talk from Haystack 2019 (US). Builds upon my conceptual search and semantic search work from 2015

Efficient and effective query auto-completion in C++.

A Collection of BM25 Algorithms in Python

📑 Neural Search

Unofficial Gaana API

No description or website provided.

Resources for Tutorial on "Utilizing Knowledge Graphs in Text-centric Information Retrieval"

The goal of this project is to implement a basic information retrieval system using Python, NLTK and GenSIM.

Vietnamese question answering system with BERT

Tika-Similarity uses the Tika-Python package (Python port of Apache Tika) to compute file similarity based on Metadata features.

Official code for WACV 2021 paper - Compositional Learning of Image-Text Query for Image Retrieval

This repository contains the Domain Discovery Tool (DDT) project. DDT is an interactive system that helps users explore and better understand a domain (or topic) as it is represented on the Web.

CIKM'21: JPQ substantially improves the efficiency of Dense Retrieval with 30x compression ratio, 10x CPU speedup and 2x GPU speedup.

Entity-Duet Neural Ranking Model

A package for interleaving / multileaving ranking generation in go

Python Keyphrase Extraction module

Labeled LDA in Python

Word Embeddings for Information Retrieval

Provides a common interface to many IR ranking datasets.

API to let user fetch the events that happen(ed) on a specific date

Large, curated set of benchmark datasets for evaluating automatic keyphrase extraction algorithms.

Search Quality Evaluation Tool for Apache Solr & Elasticsearch search-based infrastructures

Fielded Sequential Dependence Model (code and runs)

A large scale feature extraction tool for text-based machine learning

Personalized Query Completion

Drop in solution for Decentralized Neural Information Retrieval. Index latent vectors along with JSON metadata and do efficient k-NN search.

Track any ip address with IP-Tracker. IP-Tracker is developed for Linux and Termux. you can retrieve any ip address information using IP-Tracker.

A curated list of papers dedicated to neural text (semantic) matching.

The Web IR / NLP Group (WING)'s public reading group at the National University of Singapore.

My solution to the Natural Language Processing course made by Dan Jurafsky, Chris Manning in Winter 2012.

SIGIR'21: Optimizing DR with hard negatives and achieving SOTA first-stage retrieval performance on TREC DL Track.

A Lucene toolkit for replicable information retrieval research

A tutorial series by Preferred.AI

K-NRM: End-to-End Neural Ad-hoc Ranking with Kernel Pooling

PISA: Performant Indexes and Search for Academia

My Keras implementation of the Deep Semantic Similarity Model (DSSM)/Convolutional Latent Semantic Model (CLSM) described here: http://research.microsoft.com/pubs/226585/cikm2014_cdssm_final.pdf.

Source code for: On the Effect of Low-Frequency Terms on Neural-IR Models, SIGIR'19

Train a Word2Vec model or LSA model, and Implement Conceptual Search\Semantic Search in Solr\Lucene - Simon Hughes Dice.com, Dice Tech Jobs

My (slightly modified) Keras implementation of RankNet and PyTorch implementation of LambdaRank.

Learning to Rank in TensorFlow

🏴‍☠️ Information Gathering tool 🏴‍☠️ DNS / Subdomains / Ports / Directories enumeration