All Projects → UDLF → UDLF

UDLF / UDLF

Licence: GPL-2.0 license
An Unsupervised Distance Learning Framework for Multimedia Retrieval

Programming Languages

C++
36643 projects - #6 most used programming language
Makefile
30231 projects

Projects that are alternatives of or similar to UDLF

cottontaildb
Cottontail DB is a column store aimed at multimedia retrieval. It allows for classical boolean as well as vector-space retrieval (nearest neighbour search) used in similarity search using a unified data and query model.
Stars: ✭ 16 (-60%)
Mutual labels:  multimedia, retrieval
RETRO-pytorch
Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
Stars: ✭ 473 (+1082.5%)
Mutual labels:  retrieval
RSS-to-Telegram-Bot
A Telegram RSS bot that cares about your reading experience
Stars: ✭ 482 (+1105%)
Mutual labels:  multimedia
emacs-application-framework
EAF, an extensible framework that revolutionizes the graphical capabilities of Emacs
Stars: ✭ 2,454 (+6035%)
Mutual labels:  multimedia
awesome-pretrained-models-for-information-retrieval
A curated list of awesome papers related to pre-trained models for information retrieval (a.k.a., pretraining for IR).
Stars: ✭ 278 (+595%)
Mutual labels:  reranking
EPCDepth
[ICCV 2021] Excavating the Potential Capacity of Self-Supervised Monocular Depth Estimation
Stars: ✭ 105 (+162.5%)
Mutual labels:  unsupervised
palladian
Palladian is a Java-based toolkit with functionality for text processing, classification, information extraction, and data retrieval from the Web.
Stars: ✭ 32 (-20%)
Mutual labels:  retrieval
ffmpegd
FFmpeg websocket server for ffmpeg-commander.
Stars: ✭ 37 (-7.5%)
Mutual labels:  multimedia
tf retrieval baseline
A Tensorflow retrieval (space embedding) baseline. Metric learning baseline on CUB and Stanford Online Products.
Stars: ✭ 39 (-2.5%)
Mutual labels:  retrieval
shrec17
Supplementary code for SHREC 2017 RGB-D Object-to-CAD Retrieval track
Stars: ✭ 27 (-32.5%)
Mutual labels:  retrieval
awesome-puredata
A list of Pure Data libraries, abstractions, projects and presentations
Stars: ✭ 36 (-10%)
Mutual labels:  multimedia
image embeddings
Using efficientnet to provide embeddings for retrieval
Stars: ✭ 107 (+167.5%)
Mutual labels:  retrieval
cineast
Cineast is a multi-feature content-based mulitmedia retrieval engine. It is capable of retrieving images, audio- and video sequences as well as 3d models based on edge or color sketches, textual descriptions and example objects.
Stars: ✭ 51 (+27.5%)
Mutual labels:  retrieval
beir
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
Stars: ✭ 738 (+1745%)
Mutual labels:  retrieval
conan-sfml
[OBSOLETE] The recipe is now in https://github.com/bincrafters/community
Stars: ✭ 13 (-67.5%)
Mutual labels:  multimedia
vlc
VLC media player - All pull requests are ignored, please follow https://wiki.videolan.org/Sending_Patches_VLC/
Stars: ✭ 10,341 (+25752.5%)
Mutual labels:  multimedia
awesome-visual-localization-papers
The relocalization task aims to estimate the 6-DoF pose of a novel (unseen) frame in the coordinate system given by the prior model of the world.
Stars: ✭ 60 (+50%)
Mutual labels:  retrieval
smk
SMK - Simple multimedia kit - C++ WebAssembly
Stars: ✭ 89 (+122.5%)
Mutual labels:  multimedia
ebml-go
A pure Go implementation of bi-directional EBML encoder/decoder
Stars: ✭ 60 (+50%)
Mutual labels:  multimedia
HumanRecognition
Person Recognition System on PIPA dataset
Stars: ✭ 28 (-30%)
Mutual labels:  multimedia

Unsupervised Distance Learning Framework

Access the official software webpage >>

Authors: Lucas Pascotti Valem and Daniel Carlos Guimarães Pedronette

Dept. of Statistic, Applied Math. and Computing, Universidade Estadual Paulista (UNESP), Rio Claro, Brazil


Overview

A framework of unsupervised distance learning methods for image and multimedia retrieval tasks. Currently, ten different unsupervised learning methods are implemented (RDPAC, BFSTree, LHRR, ContextRR, Correlation Graph, CPRR, Rk Graph Dist., ReckNNGraph, RL-Recom, and RL-Sim*).

Get Started

An easy guide for your first use can be found in the software official webpage.

Binaries

Binaries are available for download in the release page.

Compilation

This project can be compiled by any C++ compiler that supports the C++2011 standard. We recommend g++ 4.8.4 or later. There is a Makefile that can be used to compile the code. A executable called udlf will be generate inside the bin/ directory.

Execution

The executable is called in the terminal:

  • Linux and MacOS: ./udlf [config.ini]

  • Windows: call udlf.exe [config.ini]

NOTE: The binary must be executed inside the bin/ directory.

The configuration file specifies everything about the execution: the desired task, method being used, dataset information, input files, output files, evaluation settings, and other details. When the binary is executed, it searchs for a config.ini file in its current directory. The user can also specify a different configuration file that can be passed as a parameter: ./udlf my_conf.ini. The software considers only a single configuration file per execution.

NOTE: Complete examples of input files for distinct datasets are available here.

After the execution, a log.txt is generated:

 - GENERAL INFORMATION -
 --------------------------------------
 Task:             UDL
 Method:           CPRR
 Dataset Size:     1400
 Image List File:  desc/lists/mpeg7.txt
 Image Class File: desc/classes/mpeg7.txt
 Input File:       desc/matrices/mpeg7/cfd.txt
 Input Format:     MATRIX DIST
 Output File:      output/output
 Output Format:    RK ALL
 --------------------------------------
 - METHOD PARAMETERS -
 --------------------------------------
 PARAM_CPRR_K = 20
 PARAM_CPRR_L = 400
 PARAM_CPRR_T = 2
 --------------------------------------
 - EVALUATION RESULTS -
 --------------------------------------
 * Efficiency: Total Time of the Algorithm Execution: 0.0438 s
 * Effectiveness:
 Before:
	 P@20		0.7559
	 Recall@40	0.8444
	 MAP		0.8064
 After:
	 P@20		0.8979
	 Recall@40	0.9477
	 MAP		0.9215
 Relative Gains:
	 P@20		18.7866%
	 Recall@40	12.2404%
	 MAP		14.2707%
 --------------------------------------
 Log generated at 2017/1/26 16:37:24

The results can be exported in different formats. Below you can see some examples of ranked lists that were exported as a html page. The query images are presented in green borders and wrong results in red borders. The first line represents the original retrieval results and the second line, the results after the algorithm execution.

corel5k

mpeg7

oxford17flowers

soccer

NOTE: The above examples consider the datasets Corel5k, MPEG-7, Oxford17Flowers, and Soccer; respectively.

Documentation

The documentation is available in the software wiki.

Contributing

We appreciate suggestions, ideas and contributions. If you want to contribute, feel free to contact us. Github pull requests should be avoided because they are not part of our review process. To report small bugs, you can use the issue tracker provided by GitHub.

Cite

If you use this software, please cite

@inproceedings{Valem:2017:UDL:3078971.3079017,
   author = {Valem, Lucas Pascotti and Pedronette, Daniel Carlos Guimar\~{a}es},
   title = {An Unsupervised Distance Learning Framework for Multimedia Retrieval},
   booktitle = {Proceedings of the 2017 ACM on International Conference on Multimedia Retrieval},
   series = {ICMR '17},
   year = {2017},
   isbn = {978-1-4503-4701-3},
   location = {Bucharest, Romania},
   pages = {107--111},
   numpages = {5},
   url = {http://doi.acm.org/10.1145/3078971.3079017},
   doi = {10.1145/3078971.3079017},
   acmid = {3079017},
   publisher = {ACM},
   address = {New York, NY, USA},
}

Contact

Lucas Pascotti Valem: [email protected] or [email protected]

Daniel Carlos Guimarães Pedronette: [email protected]

Acknowledgments

The authors are grateful to São Paulo Research Foundation - FAPESP (grants 2013/08645-0, and 2014/04220-8).

License

This project is licensed under GPLv2. See details.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].