All Projects → TheAstroFactory → Pydis

TheAstroFactory / Pydis

Licence: mit
A simple longslit spectroscopy pipeline in Python

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Pydis

prose
A python framework to process FITS images. Built for Astronomy.
Stars: ✭ 21 (-43.24%)
Mutual labels:  pipeline, astronomy
bifrost
A stream processing framework for high-throughput applications.
Stars: ✭ 48 (+29.73%)
Mutual labels:  pipeline, astronomy
Vector
A reliable, high-performance tool for building observability data pipelines.
Stars: ✭ 8,736 (+23510.81%)
Mutual labels:  pipeline
Jenkins Library
Shared Library for Jenkine Pipeline
Stars: ✭ 32 (-13.51%)
Mutual labels:  pipeline
Git Push Deploy
Simple Automated CI/CD Pipeline for GitHub and GitLab Projects
Stars: ✭ 21 (-43.24%)
Mutual labels:  pipeline
Quagmir
A python-based isomiR quantification and analysis pipeline
Stars: ✭ 9 (-75.68%)
Mutual labels:  pipeline
Mu
A full-stack DevOps on AWS framework
Stars: ✭ 948 (+2462.16%)
Mutual labels:  pipeline
Segmentation
Catalyst.Segmentation
Stars: ✭ 27 (-27.03%)
Mutual labels:  pipeline
Apogee
Tools for dealing with APOGEE data
Stars: ✭ 34 (-8.11%)
Mutual labels:  astronomy
Spew
Automatic Packaging and Distribution of Bioinformatics Pipelines
Stars: ✭ 21 (-43.24%)
Mutual labels:  pipeline
Nlppln
NLP pipeline software using common workflow language
Stars: ✭ 31 (-16.22%)
Mutual labels:  pipeline
Steppy Toolkit
Curated set of transformers that make your work with steppy faster and more effective 🔭
Stars: ✭ 21 (-43.24%)
Mutual labels:  pipeline
Ppipe
A simple and lightweight Rust library for making iterator pipelines concurrent
Stars: ✭ 13 (-64.86%)
Mutual labels:  pipeline
Datakit
Connect processes into powerful data pipelines with a simple git-like filesystem interface
Stars: ✭ 951 (+2470.27%)
Mutual labels:  pipeline
Brunch
🍴 Web applications made easy. Since 2011.
Stars: ✭ 6,801 (+18281.08%)
Mutual labels:  pipeline
Nodespider
[DEPRECATED] Simple, flexible, delightful web crawler/spider package
Stars: ✭ 33 (-10.81%)
Mutual labels:  pipeline
Gitscience
A curated list of science- and engineering related repositories on GitHub and in neighboring counties
Stars: ✭ 8 (-78.38%)
Mutual labels:  astronomy
Gollum
An n:m message multiplexer written in Go
Stars: ✭ 883 (+2286.49%)
Mutual labels:  pipeline
Pytorch Toolbelt
PyTorch extensions for fast R&D prototyping and Kaggle farming
Stars: ✭ 942 (+2445.95%)
Mutual labels:  pipeline
Mlj.jl
A Julia machine learning framework
Stars: ✭ 982 (+2554.05%)
Mutual labels:  pipeline

PyDIS DOI

Build Status Documentation Status

An easy to use reduction package for one dimensional longslit spectroscopy using Python.

The goal of pyDIS is to provide a turn-key solution for reducing and understanding longslit spectroscopy, which could ideally be done in real time. Currently we are using many simple assumptions to get a quick-and-dirty solution, and modeling the workflow after the robust industry standards set by IRAF. Additionally, we have only used data from the low/medium resolution APO 3.5-m "Dual Imaging Spectrograph" (DIS). Therefore, many instrument specific assumptions are being made. So far PyDIS has also been successfully used (with hacking/modification) on data from MMT and DCT. If you use PyDIS, please send me feedback!

Some background motivation on why I made this package is given here.

Examples

See the examples page on the Wiki for a few worked examples of reducing DIS data, or the step-by-step manual reduction guide for a detailed tutorial on reducing 1-d spectroscopy data with pyDIS.

Motivation

Really slick tools exist for on-the-fly photometry analysis. However, no turn-key, easy to use spectra toolkit for Python (without IRAF or PyRAF) was available (that we were aware of). Here are some mission statements:

  • Being able to extract and see data in real time at the telescope would be extremely helpful!
  • This pipeline doesn't have to give perfect results to be very useful
  • Don't try to build a One Size Fits All solution for every possible instrument or science case. We cannot beat IRAF at it's own game. IRAF is the industry standard
  • The pipeline does need to handle:
    • Flats
    • Biases
    • Spectrum Tracing
    • Wavelength Calibration using HeNeAr arc lamp spectra
    • Sky Subtraction
    • Extraction
    • basic Flux Calibration
  • The more hands-free the better, a full reduction script needs to be available
  • A fully interactive mode (a la IRAF) should be available for each task

So far pyDIS can do a rough job of all the reduction tasks for single point sources objects! We are seeking more data to test it against, to help refine the solution and find bugs. Here is one example of a totally hands-free reduced M dwarf spectrum versus the manual IRAF reduction:

Imgur

This spectrum took a few seconds to reduce, and is good enough for a quick-look! There are definitely errors in the wavelength, and small offsets in the flux calibration. A (terrible) brute-force wavelength solution, and sometimes fickle flux calibration are being used here. With some minimal parameter tweaking and manual lamp-line identifications the results are even better!

How to Help

  • Check out the Issues page if you think you can help code, or want to requst a feature!
  • If you have some data already reduced in IRAF that you trust and would be willing to share, let us know!
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].