Databases
StackOverflow2013
Postsdbo
POMassTransit RabbitMQ Node distribution
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POMassTransit RabbitMQ Node distribution
    primarykey
    data
    text
    <p>I'm investigating using MassTransit with RabbitMQ in our application as an ESB. The main benefit I'm looking for is adding durable asynchronous messaging processing to the incoming data stream.</p> <p>Our application profile has two parts:</p> <p>Incoming data stream</p> <ul> <li>One way messaging</li> <li>Processed asynchronously</li> <li>10k+ messages per minute</li> </ul> <p>Website activity</p> <ul> <li>Two way</li> <li>Ideally use c# async await language features but requires data in both directions</li> <li>&lt; 100 per minute</li> </ul> <p>The web app messaging isn't a necessity but would be nice to follow the same mechanism to full abstract away data access through the ESB.</p> <p><strong>Questions:</strong></p> <p>From what I've read; an ESB node should not know or care about any other node on the bus, it should just do it's own work and send messages onto the bus, waiting for replies if/when required. To me that means each web / app server would have it's own local clustered queue. Is this assumption correct?</p> <p>If that is correct; how would I programmatically add machines to the cluster? Are there any gotchas I need to be aware of?</p> <p>If this is not correct; how would I manage the queue cluster? Creating a dedicated cluster has it's own problems such as DNS entries, load-balancing for redundancy / offline nodes, etc</p> <p>I'm down with the functionality ESBs can add along with MassTransit's implementation however I am a little clouded with the logistics of the best practices of where / how to set it up in a durable configuration.</p> <p>Thanks for any feedback &amp; advice</p> <p><strong>Update</strong> We are utilising EC2 for machine infrastructure, in particular we use availability zones to minimise any data center outages. With this configuration we have 3 zones, each zone has a web server, app server and db server (Couchbase). We also utilise EC2's load balancers to share load between the zones.</p> <p>@Travis: Do you have any experience / advice of using MT / RMQ within Amazon's EC2?</p>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. USMike
    1. USMike
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    2. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POMassTransit RabbitMQ Node distribution
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. POMassTransit RabbitMQ Node distribution
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. POMassTransit RabbitMQ Node distribution
      1. This table or related slice is empty.
      1. VTUpMod
    1. COI don't have any experience with EC2 and RabbitMQ. We have a private data center for our software. Clustered RabbitMQ instances sound like what you need though. Then your application only am cares about the central location of your RabbitMQ cluster. App parts won't care about where they live.
      singulars
      1. POMassTransit RabbitMQ Node distribution
      1. USTravis
    2. COYeah, that is the same point I've arrived at too. I'll be looking at a mirrored clustered configuration to use HA message durability. I need to figure out if it's worth trying a grid approach where RabbitMQ will be installed on each machine that will host a process that interacts with the cluster, or if a hub and spoke approach with dedicated messaging servers behind a load balancer (as your example) would be best. Thanks for your input @Travis.
      singulars
      1. POMassTransit RabbitMQ Node distribution
      1. USMike
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload