All Projects → HicServices → RDMP

HicServices / RDMP

Licence: GPL-3.0 license
Research Data Management Platform (RDMP) is an open source application for the loading,linking,anonymisation and extraction of datasets stored in relational databases.

Programming Languages

C#
18002 projects
TSQL
950 projects

Projects that are alternatives of or similar to RDMP

refinery
Refinery is a tool to extract and transform semi-structured data from Excel spreadsheets of different layouts in a declarative way.
Stars: ✭ 30 (+50%)
Mutual labels:  extraction
framework
Solu Framework is a full featured, ORM-backed, isomorphic framework using RPython, Pouch/CouchDB and React.
Stars: ✭ 20 (+0%)
Mutual labels:  relational-databases
AlgebraicRelations.jl
Relational Algebra, now with more algebra!
Stars: ✭ 31 (+55%)
Mutual labels:  relational-databases
datascience
Keeping track of activities around research data
Stars: ✭ 29 (+45%)
Mutual labels:  research-data-management
unfurl
Extract rich metadata from URLs
Stars: ✭ 41 (+105%)
Mutual labels:  extraction
extraction
Tree Extraction for JavaScript Object Graphs
Stars: ✭ 70 (+250%)
Mutual labels:  extraction
rs datasets
Tool for autodownloading recommendation systems datasets
Stars: ✭ 22 (+10%)
Mutual labels:  research-data-management
CXLinkageSheetDemo
一个同时支持横向和纵向滚动的表格框架 CXLinkageSheetView,适用于一些数据展示页面
Stars: ✭ 78 (+290%)
Mutual labels:  linkage
browser-automation-api
Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.
Stars: ✭ 24 (+20%)
Mutual labels:  extraction
rake
A Java library for Rapid Automatic Keyword Extraction (RAKE) 🍂
Stars: ✭ 23 (+15%)
Mutual labels:  extraction
datajoint-python
Relational data pipelines for the science lab
Stars: ✭ 140 (+600%)
Mutual labels:  relational-databases
trackeddy
Tracking eddy algorithm:
Stars: ✭ 42 (+110%)
Mutual labels:  extraction
db seeder
Relational database data generator..
Stars: ✭ 36 (+80%)
Mutual labels:  relational-databases
activerecord-setops
Union, Intersect, and Difference set operations for ActiveRecord (also, SQL's UnionAll).
Stars: ✭ 21 (+5%)
Mutual labels:  relational-databases
glowing-bear
🐻 The modern cohort selection and analysis interface
Stars: ✭ 27 (+35%)
Mutual labels:  cohort-selection
generaptr
Generaptr is a node package that helps when starting up a project by generating boilerplate code for Express api.
Stars: ✭ 16 (-20%)
Mutual labels:  relational-databases
spiced-final-project
Career explorer platform developed in React.js in 6 days.
Stars: ✭ 14 (-30%)
Mutual labels:  relational-databases
ti recover
Appcelerator Titanium APK source code recovery tool
Stars: ✭ 17 (-15%)
Mutual labels:  extraction
Niffler
Niffler: A DICOM Framework for Machine Learning and Processing Pipelines.
Stars: ✭ 52 (+160%)
Mutual labels:  anonymisation
Rnightlights
R package to extract data from satellite nightlights.
Stars: ✭ 45 (+125%)
Mutual labels:  extraction

logoResearch Data Management Platform

Build status Total alerts NuGet Badge Coverage Status

RDMP is a free, open source software application for cohort building, loading, linking, anonymisation and extraction of datasets stored in relational databases (SQL Server, MySQL, Postgres and Oracle). It was designed from the bottom up to support with data provenance, preserving domain knowledge and configuration management workflows.

RDMP does not require your data be moved or transformed prior to processing and is integrates into existing SQL based extraction practices.

image

Install

Signed release binaries for the RDMP client and Command Line Interface (CLI) are in the available in the GitHub releases section.

Build

Building on Windows

You can build RDMP from the command line using dotnet build or through an IDE e.g. Visual Studio or Visual Studio Code (Requires dotnet5 SDK).

The Windows client:

dotnet build
cd Application\ResearchDataManagementPlatform\bin\Debug\net6.0-windows\win-x64
./ResearchDataManagementPlatform.exe

The console client:

dotnet build
cd Tools\rdmp\bin\Debug\net6.0\
./rdmp.exe --help

Building on Linux

Only the console client can be built/run in Linux

cd Tools/rdmp
dotnet build
cd bin/Debug/net6.0
./rdmp --help

Tests

To run tests you will need an instance of SQL Server. These instructions use localdb which is included in visual studio.

If using a docker container or alternate sql server instance then substitute your host name in place of (localdb)\MSSQLLocalDB

dotnet build
./Tools/rdmp/bin/Debug/net6.0/rdmp.exe install "(localdb)\MSSQLLocalDB" TEST_ -d

echo "ServerName: (localdb)\MSSQLLocalDB" > ./Tests.Common/TestDatabases.txt
echo "Prefix: TEST_" >> ./Tests.Common/TestDatabases.txt

dotnet build

dotnet test ./scripts/run-all-tests.proj -c Release -p:BuildInParallel=false

For a more indepth guide to CI testing see How to set up your test environment in Tests.md.

Contributing

We welcome all contributions including:

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].