Questions tagged [messaging]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
-2 votes
1 answer
64 views

Creating a promise based API, from a message based API

I'm building some software that behind the scenes needs to communicate with hardware via a "message" API, over a named pipe. For example, I can send this message: <?xml version="1.0&...
user avatar
  • 115
-1 votes
2 answers
79 views

Transactional and eventual consistency together -- which operations MUST be transactionally consistent?

I find a lot of resources regarding strong consistency versus eventual consistency, and when to choose one or the other. I'm wondering how and when you would have both together. Consider this specific ...
user avatar
  • 15
0 votes
0 answers
34 views

For a SpringBoot REST API + React frontend independent CORS project, best method to implement messaging between users?

I have been looking into adding the messaging functionality to my application and I have been struggling to figure out the best approach to take. Everything seems very heavy and complex, I have been ...
user avatar
0 votes
1 answer
99 views

What limits throughput for a single topic in Kafka, Pulsar, RabbitMQ?

I am trying to assess which of Apache Kafka, RabbitMQ, and Apache Pulsar will meet my throughput requirements for a system with multiple producers and multiple consumers for a single topic. How can ...
user avatar
0 votes
0 answers
81 views

Exposing an event source as an interface, but where the source may expose events individually or as a collection

I am using a publish-subscribe event broker, and am constructing libraries to help people interact with this broker consistently. One of the things I would like to design is some kind of IEventSource ...
user avatar
  • 281
3 votes
2 answers
586 views

How do big messaging apps keep users connected

So let's take the Facebook Messenger app for example. When you send a message it instantly gets sent to the other user you are writing to.I believe they use some kind of WebSockets to send these ...
user avatar
1 vote
1 answer
93 views

Propogating db queries from a host that cannot initiate communication

We have jobs running on-premises, many of which directly query our (on-prem) database. At the start of these jobs a new record is created in the database, and the record id is returned so that it may ...
user avatar
1 vote
0 answers
77 views

Topics best practices - AWS SNS and others

I'm designing a medium size project that will have few decoupled microservices. I want to avoid costly architecture mistakes at the very beginning. What I'm wondering (I googled and didn't found any ...
user avatar
0 votes
0 answers
137 views

Duplicate business logic check on Microservices Patterns

I'm reading now "Microservices Patterns" by Chris Richardson. At chapter 5 "Designing business logic in a microservice architecture" the author present the Ticket aggregate and its ...
user avatar
  • 169
-1 votes
1 answer
112 views

How do social media platforms stay up-to-date with messages and posts? [closed]

This is a question I have always wondered Is it as simple as repetitive pinging of a server in a seperate thread or is it more complicated than that? I am only talking about the app version not the ...
user avatar
-1 votes
2 answers
569 views

Common library for classes and communication between microservices?

I have been working on a project that is being built around a microservices architecture. We are thinking on using a message broker, such as RabbitMQ, for both synchronous (via RPC) and asynchronous ...
user avatar
2 votes
1 answer
248 views

AMQP messaging: How to generate documentation for consumers?

My application publishes various messages (e.g., telemetry, changed-events, ...) to a RabbitMQ message-broker. The users have no access to the source-code and therefore, will need a separate ...
user avatar
1 vote
0 answers
220 views

Notification System Design for Multi User Application

I have a requirement to design a notification system for multi-user(~1000 users) application, here are the high level requirements. System event gets triggered on specific operations. On event ...
user avatar
  • 111
3 votes
3 answers
473 views

Avoiding infinite loops in SOA / Enterprise Integration messaging

Thinking within a Service Oriented Architecture / Microservices / Enterprise Integration framework how does one avoid infinite loops when publishing messages between systems, especially when one has ...
user avatar
  • 139
0 votes
0 answers
51 views

Experiences with coarse grained and fine grained message designs in an ECST pattern

I am currently facing a dilemma in the design of a message oriented distributed system following an Event Carried State Transfer pattern. This is essentially a "near real time ETL" used to ...
user avatar
  • 281
1 vote
3 answers
165 views

Is shared message types a design smell?

I recently encountered a microservice architecture with 50+ services communicating with messaging using publish/subscribe on a topic. I have previously worked with event based systems where each ...
user avatar
  • 415
0 votes
0 answers
43 views

Designing sane messaging paradigm for concurrent updates

We have a weird use-case that I need to support in my application and needed some opinions on how to design it. At a basic level the application allows users to work on a "list" of "tweets" she cares ...
user avatar
0 votes
1 answer
204 views

Message bus: should an event handler trigger other commands?

Given I have a message bus that can handle commands and events. A command handler can dispatch an event. But should an event handler be able to dispatch another command? Or should event handlers only ...
user avatar
2 votes
3 answers
137 views

How do you resolve a byte[] into a class instance in a way that doesn't couple the serialization/deserialization contexts together

Consider that you've got a POJO that you intend to serialize and send through a socket. You can use whatever serialization strategy you wish (JSON, XML, protobuf, ..., etc) to serialize the actual ...
user avatar
  • 131
0 votes
3 answers
145 views

Keeping up logical order in a messaging environment

My setting is the following (Please assume that this points are entirely rock solid unchangeable, some for good reasons some: "just because"): In a super scalable microservice environment i receive ...
user avatar
  • 207
0 votes
2 answers
69 views

Microservices communications content

So I was watching Jimmy Bogard giving a talk on Effective Microservice Communications (Power Point available on his GitHub). One thing he mentions is that the messages between the services should be ...
user avatar
0 votes
1 answer
149 views

Architecture question about Instant Messaging Platform with MQTT

I'm starting a project to build an instant messaging application for mobile devices. Although not the complete list of components these are the main data flows I'm concerned about: Mobile app ...
user avatar
1 vote
0 answers
26 views

Consumer triggered entity data agregation

I am currently using RabbitMQ to aggregate the output of various data sources. Functionally the process is the following: The user enters a product name. The request is sent to the different sources ...
user avatar
  • 119
0 votes
0 answers
233 views

Design Decision - MassTransit or NetMQ

We work in a traveling company. We sell tickets for domestic flights, international flights, trains, and buses. Currently, each of these products has its own team members and they use different ...
user avatar
0 votes
0 answers
60 views

Is one to one mapping necessary between Write Applications and Read Applications

Introduction: We have a bunch of micro services (about 40) to serve our customers. To facilitate scaling and audit-ability of selected few micro services we have decided to redesign them using CQRS ...
user avatar
2 votes
2 answers
342 views

Pros and cons of consuming events in batches

Suppose I have a message broker that allows consumers to specify a batch size. What are the advantages and disadvantages of consuming events in batches compared to consume them one by one? The ...
user avatar
  • 249
0 votes
1 answer
459 views

buffering messages and send after reconnect

I'm looking for a solution for this, buffering messages in an array and send them after web-socket reconnect. I can check the socket client and push messages to an array when connection is lost and ...
user avatar
-1 votes
2 answers
108 views

Using Apache Kafka for rare events [closed]

There are multiple microservices which are responsible for storing data dependent from user, e.g. user preferences on some products, user orders, etc. There is a scenario when user is deleted from ...
user avatar
  • 111
0 votes
1 answer
644 views

What's the use of event sourcing and asynchronous message queues for sending commands

In short: Out of order commands end up with out of order events, so does the ordering of the events matter in such situations? Since we are uncertain about the order of commands when an asynchronous ...
user avatar
  • 209
0 votes
0 answers
42 views

Notification system on app using Firebase

I have to build an app that manages orders between customers who submit the orders and riders who deliver them. Riders work in shifts, so when a customer submits an order, only the riders that are ...
user avatar
0 votes
0 answers
577 views

Using signalR for streaming alongside a microservice architecture

I have a cluster of micro services with an exposed search API serving a client app. I want to "stream" in real time the aggregated results of a complex search. The search will be kicked of by the ...
user avatar
2 votes
2 answers
94 views

Syncing two Notifications and Merging them Into One

I am running into this issue: Suppose that there are two independent services, A and B, and both process messages from C. Suppose that I have a service X that needs to know if a message m from C was ...
user avatar
  • 309
2 votes
1 answer
170 views

How to design document exchange system

I am trying to come up with a design of document exchange system. System should be for business-to-business communication. Description: There will be possibly 100+ clients(consumers) - they will have ...
user avatar
0 votes
1 answer
660 views

Scheduling operations in a micro service

I'm trying to realize a service that executes operations at a certain time, those operations are specified by another service by messaging, here's the scenario: The service A receives a request to ...
user avatar
0 votes
1 answer
126 views

Passing Keys instead of Messages

Recently I stood up a Redis server and tested the idea of storing application 'states' that only existed in our application and were never stored in our database. Don't know if we will ultimately do ...
user avatar
7 votes
1 answer
2k views

How is caching used within messaging apps?

I'm actually studying about web development. I was just asking why a lot of web apps and chats(Whatsapp, Telegram, Discord, and a lot, a lot more!) are using cache. I mean, after learning cache ...
user avatar
2 votes
3 answers
2k views

Message Broker in Client-Server-Applications

I'm currently planning an architecture for a system that should consist of multiple microservices. We definitely want to make use of a message broker (probably RabbitMQ). A simplified diagram of my ...
user avatar
  • 141
1 vote
1 answer
1k views

Design scalable solution with queue

Assuming the following scenario: A web application that receives inputs from the user and process the inputs through an algorithm which takes between 5 to 25 minutes (depending on the inputs) and ...
user avatar
  • 179
1 vote
1 answer
980 views

RabbitMQ: how to achieve scalable one-to-one communication?

I'm trying to use RabbitMQ for two-way one-to-one communication between clients and servers. So, Client 1 should be able to communicate only with Server 1, and vice versa: The servers stay always ...
user avatar
  • 161
-5 votes
1 answer
161 views

What happens to media files when a WhatsApp user recalls the message? [closed]

WhatsApp has the "Delete For Everyone" feature that makes it easy to delete messages you did not intend to send to the other user. For text messages, this recall is easy, but what about Video, Photo ...
user avatar
0 votes
4 answers
1k views

How to guarantee HTTP message delivery in fault tolerant way

When an application A communicates with an external/3rd party system B, there is always a chance that B is down. Say that A raises an event that should be sent as a message to B via HTTP, what is the ...
user avatar
  • 726
0 votes
1 answer
119 views

Security and performance considerations when creating chat system on a Flask backend

I am building a website with the Flask framework. One functionality of the site will be that users can send messages to each other. I created a prototype of this using Flask WTF forms. The basic ...
user avatar
  • 1,627
6 votes
1 answer
4k views

CQRS-Event Sourcing: how to process events in the expected order inside the read model

I'm looking for some insights about how to handle the read model in a CQRS Event Sourcing application, in order to do the best to ensure data consistency. The missing point is how to be sure (...
user avatar
-2 votes
3 answers
580 views

Platform independant ways of passing messages between executibles

I am working on an a data collector which could be called an API of some sorts, which is based on .Net Core 2.1 . It's job is to receive and pull (ask for) data from data collectors(executable, DLL,...
user avatar
4 votes
2 answers
2k views

CQRS async query from command handler

In a CQRS/async microservices context, I have a command handler e.g. SendOrderConfirmationEmailCommandHandler implemented in a communications service. This depends on information from the orders ...
user avatar
  • 141
2 votes
2 answers
636 views

RabbitMQ as backbone for services written in different languages

I'm seeking advice from people using RabbitMQ to connect services written in different languages. Currently my organization is using RabbitMQ exclusively with C# and it's all working quite well. In ...
user avatar
  • 397
3 votes
0 answers
668 views

Designing CRUD Messaging communication

There are endless resources on creating CRUD for REST resources but I can't find much on doing the same for Messaging. Given two services A and B where A receives incoming requests that initiates the ...
user avatar
  • 415
2 votes
1 answer
354 views

How to convey object hierarchy when object is converted to json for updates?

I have some classes being serialized via frugal (this is an open source extension of Thrift). The primary reason this is relevant is that the serialization process is out of my control and needs to ...
user avatar
  • 12k
1 vote
1 answer
3k views

How can I handle multi-producer to particular single-consumer in Kafka?

I'm evaluating the Kafka. It provides some nice features which I want to use, especially durability be default and the access to past messages for new consumers, whenever the consumer wants to reach ...
user avatar
  • 157
3 votes
0 answers
147 views

How to broadcast message to all non connected clients

I plan to have server which consumes all data sent from clients. I want to use messaging system (RabbitMQ) to avoid all troubles with discovering services, recoveries and so on. Client just publish ...
user avatar
  • 157