Cake 3.x How to setup a queue technology for jobs and news feeds?

manpreet Best Answer 2 years ago

I am using Cake 3.x

I need to have the following things set up.

1. A job queue to queue jobs that require long processing in the background
2. A feed (like Facebook Feed) that informs various users of what's happening within the app

This is what I have in terms of requirements:

Job Queue

This needs to be persistent and reliable. Meaning to say if the server suddenly rebooted, any jobs queued but not yet executed will still be there waiting to be processed upon reboot.

News Feed / Activity Stream

This need not be persistent and can be delayed. Just like Facebook. Basically it's to display events that have happened.

Something like

User1 commented on your post. (2 seconds ago)
User2 liked your post. (3 mins ago)
User2 & User1 favorited your post (5 mins ago)

What Queue should I use within context of a Cake3 web app?

What queue technology should I use for

1. job queue (persistence required, order of the jobs is also important)
2. news feed / activity stream (no need for persistence, order is not important)

within the context of a Cake 3.x web app?

I am a newbie to queue technology. I am happy to use even cloud computing queue services like Amazon Message Queuing Service (SQS).

I would prefer a solution that works well with CakePHP 3.x architecture. Perhaps a CakePHP plugin?

I am also okay to setup 2 different queue technologies to satisfy the 2 different requirements.