GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → open2c → coolpuppy

open2c / coolpuppy

Licence: MIT License
A versatile tool to perform pile-up analysis on Hi-C data in .cool format.

Programming Languages

python
139335 projects - #7 most used programming language
shell
77523 projects

Labels

genomicscontact-matrixhi-csparse-matrixpileup

Projects that are alternatives of or similar to coolpuppy

TADLib
A Library to Explore Chromatin Interaction Patterns for Topologically Associating Domains
Stars: ✭ 23 (-45.24%)
Mutual labels:  genomics, contact-matrix, hi-c
genomedisco
Software for comparing contact maps from HiC, CaptureC and other 3D genome data.
Stars: ✭ 23 (-45.24%)
Mutual labels:  contact-matrix, hi-c
hickit
TAD calling, phase imputation, 3D modeling and more for diploid single-cell Hi-C (Dip-C) and general Hi-C
Stars: ✭ 79 (+88.1%)
Mutual labels:  genomics, hi-c
instaGRAAL
Large genome reassembly based on Hi-C data, continuation of GRAAL
Stars: ✭ 32 (-23.81%)
Mutual labels:  genomics, hi-c
mustache
Multi-scale Detection of Chromatin Loops from Hi-C and Micro-C Maps using Scale-Space Representation
Stars: ✭ 38 (-9.52%)
Mutual labels:  genomics, hi-c
full spectrum bioinformatics
An open-access bioinformatics text
Stars: ✭ 26 (-38.1%)
Mutual labels:  genomics
cloud-genomics
Introduction to Cloud Computing for Genomics
Stars: ✭ 13 (-69.05%)
Mutual labels:  genomics
sparse-hyper
Code for the paper "Learning sparse transformations through backpropagation"
Stars: ✭ 43 (+2.38%)
Mutual labels:  sparse-matrix
FALDO
Feature Annotation Location Description Ontology
Stars: ✭ 28 (-33.33%)
Mutual labels:  genomics
higlass-docker
Builds a docker container wrapping higlass-server and higlass-client in nginx
Stars: ✭ 21 (-50%)
Mutual labels:  hi-c
switchde
Inference of switch-like differential expression along single-cell trajectories
Stars: ✭ 19 (-54.76%)
Mutual labels:  genomics
netSmooth
netSmooth: A Network smoothing based method for Single Cell RNA-seq imputation
Stars: ✭ 23 (-45.24%)
Mutual labels:  genomics
monolish
monolish: MONOlithic LInear equation Solvers for Highly-parallel architecture
Stars: ✭ 166 (+295.24%)
Mutual labels:  sparse-matrix
cell-ontology
An ontology of cell types
Stars: ✭ 75 (+78.57%)
Mutual labels:  genomics
sparse dot
Python wrapper for Intel Math Kernel Library (MKL) matrix multiplication
Stars: ✭ 38 (-9.52%)
Mutual labels:  sparse-matrix
mcscan
Command-line program to wrap dagchainer and combine pairwise results into multi-alignments in column format
Stars: ✭ 18 (-57.14%)
Mutual labels:  genomics
mapcomp
Genetic Map Comparison
Stars: ✭ 18 (-57.14%)
Mutual labels:  genomics
chromap
Fast alignment and preprocessing of chromatin profiles
Stars: ✭ 93 (+121.43%)
Mutual labels:  genomics
MAGMA Celltyping
Find causal cell-types underlying complex trait genetics
Stars: ✭ 41 (-2.38%)
Mutual labels:  genomics
reg-gen
Regulatory Genomics Toolbox: Python library and set of tools for the integrative analysis of high throughput regulatory genomics data.
Stars: ✭ 64 (+52.38%)
Mutual labels:  genomics
View All Similar Projects ➔

coolpup.py

DOI PyPI version Build Status Code style: black Docs status

.cool file pile-ups with python.

Introduction

.cool format

A versatile tool to perform pile-up analysis on Hi-C data in .cool format (https://github.com/mirnylab/cooler). And who doesn't like cool pupppies?

.cool is a modern and flexible format to store Hi-C data. It uses HDF5 to store a sparse representation of the Hi-C data, which allows low memory requirements when dealing with high resolution datasets. Another popular format to store Hi-C data, .hic, can be converted into .cool files using hic2cool (https://github.com/4dn-dcic/hic2cool).

See for details:

Abdennur, N., and Mirny, L. (2019). Cooler: scalable storage for Hi-C data and other genomically-labeled arrays. Bioinformatics. 10.1093/bioinformatics/btz540

What are pileups?

This is the idea of how pileups work to check whether certain regions tend to interacts with each other:

Pileup schematic

What's not shown here is normalization to the expected values. This can be done in two ways: either using a provided file with expected values of interactions at different distances (output of cooltools compute-expected), or directly from Hi-C data by dividing the pileups over randomly shifted control regions. If neither expected normalization approach is used (just set --nshifts 0), this becomes essentially identical to the APA approach (Rao et al., 2014), which can be used for averaging strongly interacting regions, e.g. annotated loops. For weaker interactors, decay of contact probability with distance can hide any focal enrichment that could be observed otherwise.

coolpup.py is particularly well suited performance-wise for analysing huge numbers of potential interactions, since it loads whole chromosomes into memory one by one (or in parallel to speed it up) to extract small submatrices quickly. Having to read everything into memory makes it relatively slow for small numbers of loops, but performance doesn't decrease until you reach a huge number of interactions.

Getting started

Installation

All requirements apart are available from PyPI or conda.

Before installing everything you need to obtain cython using either pip or conda. Then for coolpuppy (and other dependencies) simply do:

pip install coolpuppy

or

pip install https://github.com/open2c/coolpuppy/archive/master.zip

to get the latest version from GitHub. This will make coolpup.py callable in your terminal, and importable in python as coolpuppy.

Usage

Some examples to get you started are available here: Examples

A guide walkthrough to pile-up analysis is available here (WIP): Walkthrough

Docs for the command line interface are available here: CLI docs

Currently, coolpup.py doesn't support inter-chromosomal pileups, but this is an addition that is planned for the future.

Plotting results

For flexible plotting, I suggest to use matplotlib or another library. However simple plotting capabilities are included in this package. Just run plotpup.py with desired options and list all the output files of coolpup.py you'd like to plot.

Citing coolpup.py

Ilya M Flyamer, Robert S Illingworth, Wendy A Bickmore (2020). Coolpup.py: versatile pile-up analysis of Hi-C data. Bioinformatics, 36, 10, 2980–2985.

https://academic.oup.com/bioinformatics/article/36/10/2980/5719023

doi: 10.1093/bioinformatics/btaa073

This tool has been used in the following publications

Please let me know if I've missed any and you'd like your paper ot be mentioned here!

McLaughlin, K., Flyamer, I.M., Thomson, J.P., Mjoseng, H.K., Shukla, R., Williamson, I., Grimes, G.R., Illingworth, R.S., Adams, I.R., Pennings, S., et al. (2019). DNA Methylation Directs Polycomb-Dependent 3D Genome Re-organization in Naive Pluripotency. Cell Reports 29, 1974-1985.e6.

https://www.sciencedirect.com/science/article/pii/S2211124719313312?via%3Dihub

Boyle, S., Flyamer, I.M., Williamson, I., Sengupta, D., Bickmore, W.A., and Illingworth, R.S. (2019). A Central Role for Canonical PRC1 in Shaping the 3D Nuclear Landscape. Genes & Development 2020

http://genesdev.cshlp.org/content/early/2020/05/21/gad.336487.120.abstract

Rhodes, J.D.P., Feldmann, A., Hernández-Rodríguez, B., Díaz, N., Brown, J.M., Fursova, N.A., Blackledge, N.P., Prathapan, P., Dobrinic, P., Huseyin, M.K., et al. (2020). Cohesin Disrupts Polycomb-Dependent Chromosome Interactions in Embryonic Stem Cells. Cell Reports 30, 820-835.e10.

https://www.sciencedirect.com/science/article/pii/S2211124719317140?via%3Dihub

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].