All Projects → joegasewicz → Pytask Io

joegasewicz / Pytask Io

Licence: gpl-3.0
Python Async Task Queue

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Pytask Io

Aiocache
Asyncio cache manager for redis, memcached and memory
Stars: ✭ 496 (+512.35%)
Mutual labels:  asyncio, redis
Rqueue
Rqueue aka Redis Queue [Task Queue, Message Broker] for Spring framework
Stars: ✭ 76 (-6.17%)
Mutual labels:  task-manager, redis
Flower
Real-time monitor and web admin for Celery distributed task queue
Stars: ✭ 5,036 (+6117.28%)
Mutual labels:  redis, task-queue
Aiotasks
A Celery like task manager that distributes Asyncio coroutines
Stars: ✭ 375 (+362.96%)
Mutual labels:  asyncio, coroutines
Fennel
A task queue library for Python and Redis
Stars: ✭ 24 (-70.37%)
Mutual labels:  asyncio, redis
Ring
Python cache interface with clean API and built-in memcache & redis + asyncio support.
Stars: ✭ 404 (+398.77%)
Mutual labels:  asyncio, redis
Netdiscovery
NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。
Stars: ✭ 573 (+607.41%)
Mutual labels:  coroutines, redis
Korio
Korio: Kotlin cORoutines I/O : Virtual File System + Async/Sync Streams + Async TCP Client/Server + WebSockets for Multiplatform Kotlin 1.3
Stars: ✭ 282 (+248.15%)
Mutual labels:  coroutines, redis
Lofty
Coroutines, stack traces and smart I/O for C++11, inspired by Python and Golang.
Stars: ✭ 5 (-93.83%)
Mutual labels:  asyncio, coroutines
Arq
Fast job queuing and RPC in python with asyncio and redis.
Stars: ✭ 695 (+758.02%)
Mutual labels:  asyncio, redis
Lmstfy
Implements task queue in Golang which based on Redis storage
Stars: ✭ 373 (+360.49%)
Mutual labels:  redis, task-queue
Rq
Simple job queues for Python
Stars: ✭ 8,065 (+9856.79%)
Mutual labels:  redis, task-queue
Huey
a little task queue for python
Stars: ✭ 3,761 (+4543.21%)
Mutual labels:  redis, task-queue
Groupco
PHP的服务化框架。适用于Api、Http Server、Rpc Server;帮助原生PHP项目转向微服务化。出色的性能与支持高并发的协程相结合
Stars: ✭ 473 (+483.95%)
Mutual labels:  coroutines, redis
Celery
Distributed Task Queue (development branch)
Stars: ✭ 18,378 (+22588.89%)
Mutual labels:  task-manager, redis
Taskq
Golang asynchronous task/job queue with Redis, SQS, IronMQ, and in-memory backends
Stars: ✭ 555 (+585.19%)
Mutual labels:  redis, task-queue
Aiotutorial
code snippets for asyncio tutorial
Stars: ✭ 257 (+217.28%)
Mutual labels:  asyncio, coroutines
Awesome Asyncio
A curated list of awesome Python asyncio frameworks, libraries, software and resources
Stars: ✭ 3,279 (+3948.15%)
Mutual labels:  asyncio, coroutines
Gevent
Coroutine-based concurrency library for Python
Stars: ✭ 5,656 (+6882.72%)
Mutual labels:  asyncio, coroutines
Asynq
Asynq: simple, reliable, and efficient distributed task queue in Go
Stars: ✭ 934 (+1053.09%)
Mutual labels:  redis, task-queue

PyPI Read the Docs GitHub

Pytask IO

Asynchronous Tasks Library using asyncio

An Asyncio based task queue that is designed to be super easy the use!

Read the docs: Documentation

PyTask IO

Install

pip install pytask-io

docker run redis  # Rabbit MQ coming soon...

Usage

    from pytask_io import PyTaskIO
    
    # Starts the task runner
    pytask = PytaskIO(
        store_port=6379,
        store_host="localhost",
        db=0,
        workers=1,
    )
    
    # Start the PytaskIO task queue on a separate thread.
    pytask.run()
    
    # Handle a long running process, in this case a send email function
    metadata = pytask.add_task(send_email, title, body)
    
    # Try once to get the results of your email sometime in the future
    result = pytask.get_task(metadata)
    
    # Later we can use the `metadata` result to pass to `add_task`
    result = pytask.poll_for_task(metadata, tries=100, interval=60)
    
    # Stop PytaskIO completely (This will not affect any units of work that haven't yet executed)
    pytask.stop()

Compatible task types

PyTaskIO will always return back the task meta data. Do not embed Python objects of type frame, generator, traceback & context objects. In this case you will get back the exception thrown when PyTaskIO attempts to execute the serialization.

Authors

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

Please make sure to update tests as appropriate.

License

MIT

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].