All Projects → pagarme → sqs-quooler

pagarme / sqs-quooler

Licence: MIT license
A complete queue consumer for SQS

Programming Languages

javascript
184084 projects - #8 most used programming language
Dockerfile
14818 projects

Projects that are alternatives of or similar to sqs-quooler

Simpleue
PHP queue worker and consumer - Ready for AWS SQS, Redis, Beanstalkd and others.
Stars: ✭ 124 (+439.13%)
Mutual labels:  sqs, consumer
k8s-sqs-autoscaler
Kubernetes pod autoscaler based on queue size in AWS SQS
Stars: ✭ 70 (+204.35%)
Mutual labels:  sqs
mq-go
SQS Consumer Server for Go
Stars: ✭ 28 (+21.74%)
Mutual labels:  sqs
Rin
Rin is a Redshift data Importer by SQS messaging.
Stars: ✭ 27 (+17.39%)
Mutual labels:  sqs
sqsiphon
No description or website provided.
Stars: ✭ 19 (-17.39%)
Mutual labels:  sqs
go-localstack
Go Wrapper for using localstack
Stars: ✭ 56 (+143.48%)
Mutual labels:  sqs
ontopic
Display SNS messages on your terminal
Stars: ✭ 20 (-13.04%)
Mutual labels:  sqs
sns-sqs-big-payload
Amazon SNS/SQS client library that enables sending and receiving messages with payload larger than 256KiB via Amazon S3.
Stars: ✭ 40 (+73.91%)
Mutual labels:  sqs
rejected
rejected is a consumer framework for RabbitMQ
Stars: ✭ 56 (+143.48%)
Mutual labels:  consumer
standards-maintenance
This repository houses the interactions, consultations and work management to support the maintenance of baselined components of the Consumer Data Right API Standards and Information Security profile.
Stars: ✭ 32 (+39.13%)
Mutual labels:  consumer
rabbitmq-consumer
A configurable RabbitMQ consumer made in Rust, useful for a stable and reliable CLI commands processor.
Stars: ✭ 25 (+8.7%)
Mutual labels:  consumer
toiler
Toiler is a AWS SQS long-polling thread-based message processor.
Stars: ✭ 15 (-34.78%)
Mutual labels:  sqs
lambdakiq
ActiveJob on SQS & Lambda
Stars: ✭ 131 (+469.57%)
Mutual labels:  sqs
ember-contextual-services
Services in Ember are scoped to the app as a whole and are singletons. Sometimes you don't want that. :) This addon provides ephemeral route-based services.
Stars: ✭ 20 (-13.04%)
Mutual labels:  consumer
php-kafka-lib
PHP Kafka producer / consumer library with PHP Avro support, based on php-rdkafka
Stars: ✭ 38 (+65.22%)
Mutual labels:  consumer
django-eb-sqs-worker
Django Background Tasks for Amazon Elastic Beanstalk
Stars: ✭ 27 (+17.39%)
Mutual labels:  sqs
blaster
Web hooks for message queues
Stars: ✭ 14 (-39.13%)
Mutual labels:  sqs
wtsqs
Simplified Node AWS SQS Worker Wrapper
Stars: ✭ 18 (-21.74%)
Mutual labels:  sqs
Liquid-Application-Framework
Liquid Application Framework documentation, useful links and sample project
Stars: ✭ 467 (+1930.43%)
Mutual labels:  sqs
aws-sqs-sns-client
AWS SNS SQS client UI
Stars: ✭ 26 (+13.04%)
Mutual labels:  sqs

SQS Quooler

Build Status npm

🚶🚶🚶🚶 An abstraction of Amazon's SQS SDK. It provides an easier to use interface than that of Amazon's SDK.

Installation

npm install --save sqs-quooler

Usage

Connecting to the queue

Note aws-sdk still needs to be imported. SQS Quooler is just a wrapper.

const { SQS, Credentials } = require('aws-sdk')
const { Queue } = require('sqs-quooler')

const sqs = new SQS({
  region: 'your aws region',
  endpoint: 'your aws endpoint',
  // Credentials can be used with YOPA as below
  // credentials: new Credentials({
  //   accessKeyId: 'x',
  //   secretAccessKey: 'x',
  // }),
})

const myQueue = new Queue({
  sqs,
  endpoint: 'your aws endpoint + queue name',
  concurrency: 1, // MaxNumberOfMessages
})

Pushing items to the queue

myQueue.push (data: any) : Promise

Data sent via .push will be stringified before it's sent to SQS.

myQueue.push({
  data: 'test',
})

Removing items from the queue

myQueue.remove (message: object) : Promise

Message object should have a ReceiptHandle property, to identify the message.

myQueue.remove({
  ...
  ReceiptHandle: 'receipt handle',
  ...
})

Changing message visibility

myQueue.changeMessageVisibility (parameters: object) : Promise

Parameters object should have a ReceiptHandle property, to identify the message, and a VisibilityTimeout property to determine in how many seconds the item will return to the queue.

myQueue.changeMessageVisibility({
  ...
  ReceiptHandle: 'receipt handle',
  VisibilityTimeout: 0, // returns immediately to the queue
  ...
})

Retrieving items from the queue

myQueue.startProcessing (handler: function, options: object) : Promise

Handler function should accept 2 arguments, the first one being the parsed message Body value, and the second one being the whole message object. It will be called once for every message found in the queue (depending on the queue's concurrency).

The options object is optional and accept the following properties:

  • keepMessages (boolean): To avoid deleting the message after processing it. Default is false.
  • messageAttributesNames (string array): The value which will be sent to the receiveMessage SQS method at the MessageAttributeNames property. Default value is ['All'].
  • attributeNames (string array): A list of attributes that need to be returned along with each message, within the Attributes property. Default value is ['All'].

After the handler returns (if it returns a Promise, SQS Quooler will wait for it to resolve), the item is automatically deleted from the queue. If your handler throws an error, or returns a rejected Promise, the item will not be removed from the queue.

myQueue.startProcessing((body, message) => {
  // body: {
  //   data: 'test',
  // }

  // message: {
  //   Body: '{"data":"test"}',
  //   ReceiptHandle: 'receipt handle',
  //   MessageAttributes: {
  //     custom_attribute: {
  //       StringValue: 'custom_attribute value',
  //       StringListValues: [],
  //       BinaryListValues: [],
  //       DataType: 'String'
  //     }
  //   }
  //   ...
  // }
})

Stop processing the queue

myQueue.stopProcessing () : Promise

myQueue.stopProcessing()

Purge the queue

myQueue.purge () : Promise

Deletes all messages in a queue

myQueue.purge()

License

You can check out the full license here

This project is licensed under the terms of the MIT license.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].