Questions tagged [messaging]
The messaging tag has no usage guidance.
92
questions
-2
votes
1
answer
64
views
Creating a promise based API, from a message based API
I'm building some software that behind the scenes needs to communicate with hardware via a "message" API, over a named pipe.
For example, I can send this message:
<?xml version="1.0&...
- 115
-1
votes
2
answers
79
views
Transactional and eventual consistency together -- which operations MUST be transactionally consistent?
I find a lot of resources regarding strong consistency versus eventual consistency, and when to choose one or the other.
I'm wondering how and when you would have both together. Consider this specific ...
- 15
0
votes
0
answers
34
views
For a SpringBoot REST API + React frontend independent CORS project, best method to implement messaging between users?
I have been looking into adding the messaging functionality to my application and I have been struggling to figure out the best approach to take. Everything seems very heavy and complex, I have been ...
0
votes
1
answer
99
views
What limits throughput for a single topic in Kafka, Pulsar, RabbitMQ?
I am trying to assess which of Apache Kafka, RabbitMQ, and Apache Pulsar will meet my throughput requirements for a system with multiple producers and multiple consumers for a single topic.
How can ...
- 109
0
votes
0
answers
81
views
Exposing an event source as an interface, but where the source may expose events individually or as a collection
I am using a publish-subscribe event broker, and am constructing libraries to help people interact with this broker consistently.
One of the things I would like to design is some kind of IEventSource ...
- 281
3
votes
2
answers
586
views
How do big messaging apps keep users connected
So let's take the Facebook Messenger app for example. When you send a message it instantly gets sent to the other user you are writing to.I believe they use some kind of WebSockets to send these ...
1
vote
1
answer
93
views
Propogating db queries from a host that cannot initiate communication
We have jobs running on-premises, many of which directly query our (on-prem) database. At the start of these jobs a new record is created in the database, and the record id is returned so that it may ...
- 19
1
vote
0
answers
77
views
Topics best practices - AWS SNS and others
I'm designing a medium size project that will have few decoupled microservices.
I want to avoid costly architecture mistakes at the very beginning.
What I'm wondering (I googled and didn't found any ...
0
votes
0
answers
137
views
Duplicate business logic check on Microservices Patterns
I'm reading now "Microservices Patterns" by Chris Richardson.
At chapter 5 "Designing business logic in a microservice architecture" the author present the Ticket aggregate and its ...
- 169
-1
votes
1
answer
112
views
How do social media platforms stay up-to-date with messages and posts? [closed]
This is a question I have always wondered
Is it as simple as repetitive pinging of a server in a seperate thread or is it more complicated than that?
I am only talking about the app version not the ...
- 19
-1
votes
2
answers
569
views
Common library for classes and communication between microservices?
I have been working on a project that is being built around a microservices architecture. We are thinking on using a message broker, such as RabbitMQ, for both synchronous (via RPC) and asynchronous ...
- 235
2
votes
1
answer
248
views
AMQP messaging: How to generate documentation for consumers?
My application publishes various messages (e.g., telemetry, changed-events, ...) to a RabbitMQ message-broker. The users have no access to the source-code and therefore, will need a separate ...
1
vote
0
answers
220
views
Notification System Design for Multi User Application
I have a requirement to design a notification system for multi-user(~1000 users) application, here are the high level requirements.
System event gets triggered on specific operations.
On event ...
- 111
3
votes
3
answers
473
views
Avoiding infinite loops in SOA / Enterprise Integration messaging
Thinking within a Service Oriented Architecture / Microservices / Enterprise Integration framework how does one avoid infinite loops when publishing messages between systems, especially when one has ...
- 139
0
votes
0
answers
51
views
Experiences with coarse grained and fine grained message designs in an ECST pattern
I am currently facing a dilemma in the design of a message oriented distributed system following an Event Carried State Transfer pattern. This is essentially a "near real time ETL" used to ...
- 281
1
vote
3
answers
165
views
Is shared message types a design smell?
I recently encountered a microservice architecture with 50+ services communicating with messaging using publish/subscribe on a topic. I have previously worked with event based systems where each ...
- 415
0
votes
0
answers
43
views
Designing sane messaging paradigm for concurrent updates
We have a weird use-case that I need to support in my application and needed some opinions on how to design it.
At a basic level the application allows users to work on a "list" of "tweets" she cares ...
- 109
0
votes
1
answer
204
views
Message bus: should an event handler trigger other commands?
Given I have a message bus that can handle commands and events. A command handler can dispatch an event. But should an event handler be able to dispatch another command? Or should event handlers only ...
- 109
2
votes
3
answers
137
views
How do you resolve a byte[] into a class instance in a way that doesn't couple the serialization/deserialization contexts together
Consider that you've got a POJO that you intend to serialize and send through a socket.
You can use whatever serialization strategy you wish (JSON, XML, protobuf, ..., etc) to serialize the actual ...
- 131
0
votes
3
answers
145
views
Keeping up logical order in a messaging environment
My setting is the following (Please assume that this points are entirely rock solid unchangeable, some for good reasons some: "just because"):
In a super scalable microservice environment i receive ...
- 207
0
votes
2
answers
69
views
Microservices communications content
So I was watching Jimmy Bogard giving a talk on Effective Microservice Communications (Power Point available on his GitHub). One thing he mentions is that the messages between the services should be ...
0
votes
1
answer
149
views
Architecture question about Instant Messaging Platform with MQTT
I'm starting a project to build an instant messaging application for mobile devices.
Although not the complete list of components these are the main data flows I'm concerned about:
Mobile app ...
- 101
1
vote
0
answers
26
views
Consumer triggered entity data agregation
I am currently using RabbitMQ to aggregate the output of various data sources.
Functionally the process is the following:
The user enters a product name.
The request is sent to the different sources ...
- 119
0
votes
0
answers
233
views
Design Decision - MassTransit or NetMQ
We work in a traveling company.
We sell tickets for domestic flights, international flights, trains, and buses.
Currently, each of these products has its own team members and they use different ...
- 109
0
votes
0
answers
60
views
Is one to one mapping necessary between Write Applications and Read Applications
Introduction: We have a bunch of micro services (about 40) to serve our customers.
To facilitate scaling and audit-ability of selected few micro services we have decided to redesign them using CQRS ...
- 1,336
2
votes
2
answers
342
views
Pros and cons of consuming events in batches
Suppose I have a message broker that allows consumers to specify a batch size. What are the advantages and disadvantages of consuming events in batches compared to consume them one by one?
The ...
- 249
0
votes
1
answer
459
views
buffering messages and send after reconnect
I'm looking for a solution for this, buffering messages in an array and send them after web-socket reconnect. I can check the socket client and push messages to an array when connection is lost and ...
-1
votes
2
answers
108
views
Using Apache Kafka for rare events [closed]
There are multiple microservices which are responsible for storing data dependent from user, e.g. user preferences on some products, user orders, etc. There is a scenario when user is deleted from ...
- 111
0
votes
1
answer
644
views
What's the use of event sourcing and asynchronous message queues for sending commands
In short: Out of order commands end up with out of order events, so does the ordering of the events matter in such situations?
Since we are uncertain about the order of commands when an asynchronous ...
- 209
0
votes
0
answers
42
views
Notification system on app using Firebase
I have to build an app that manages orders between customers who submit the orders and riders who deliver them. Riders work in shifts, so when a customer submits an order, only the riders that are ...
0
votes
0
answers
577
views
Using signalR for streaming alongside a microservice architecture
I have a cluster of micro services with an exposed search API serving a client app. I want to "stream" in real time the aggregated results of a complex search. The search will be kicked of by the ...
- 1
2
votes
2
answers
94
views
Syncing two Notifications and Merging them Into One
I am running into this issue:
Suppose that there are two independent services, A and B, and both process messages from C.
Suppose that I have a service X that needs to know if a message m from C was ...
- 309
2
votes
1
answer
170
views
How to design document exchange system
I am trying to come up with a design of document exchange system.
System should be for business-to-business communication.
Description:
There will be possibly 100+ clients(consumers) - they will have ...
- 29
0
votes
1
answer
660
views
Scheduling operations in a micro service
I'm trying to realize a service that executes operations at a certain time, those operations are specified by another service by messaging, here's the scenario:
The service A receives a request to ...
- 133
0
votes
1
answer
126
views
Passing Keys instead of Messages
Recently I stood up a Redis server and tested the idea of storing application 'states' that only existed in our application and were never stored in our database. Don't know if we will ultimately do ...
- 23
7
votes
1
answer
2k
views
How is caching used within messaging apps?
I'm actually studying about web development.
I was just asking why a lot of web apps and chats(Whatsapp, Telegram, Discord, and a lot, a lot more!) are using cache.
I mean, after learning cache ...
- 83
2
votes
3
answers
2k
views
Message Broker in Client-Server-Applications
I'm currently planning an architecture for a system that should consist of multiple microservices. We definitely want to make use of a message broker (probably RabbitMQ).
A simplified diagram of my ...
- 141
1
vote
1
answer
1k
views
Design scalable solution with queue
Assuming the following scenario:
A web application that receives inputs from the user and process the inputs through an algorithm which takes between 5 to 25 minutes (depending on the inputs) and ...
- 179
1
vote
1
answer
980
views
RabbitMQ: how to achieve scalable one-to-one communication?
I'm trying to use RabbitMQ for two-way one-to-one communication between clients and servers. So, Client 1 should be able to communicate only with Server 1, and vice versa:
The servers stay always ...
- 161
-5
votes
1
answer
161
views
What happens to media files when a WhatsApp user recalls the message? [closed]
WhatsApp has the "Delete For Everyone" feature that makes it easy to delete messages you did not intend to send to the other user.
For text messages, this recall is easy, but what about Video, Photo ...
- 85
0
votes
4
answers
1k
views
How to guarantee HTTP message delivery in fault tolerant way
When an application A communicates with an external/3rd party system B, there is always a chance that B is down.
Say that A raises an event that should be sent as a message to B via HTTP, what is the ...
- 726
0
votes
1
answer
119
views
Security and performance considerations when creating chat system on a Flask backend
I am building a website with the Flask framework. One functionality of the site will be that users can send messages to each other.
I created a prototype of this using Flask WTF forms. The basic ...
- 1,627
6
votes
1
answer
4k
views
CQRS-Event Sourcing: how to process events in the expected order inside the read model
I'm looking for some insights about how to handle the read model in a CQRS Event Sourcing application, in order to do the best to ensure data consistency.
The missing point is how to be sure (...
- 643
-2
votes
3
answers
580
views
Platform independant ways of passing messages between executibles
I am working on an a data collector which could be called an API of some sorts, which is based on .Net Core 2.1 .
It's job is to receive and pull (ask for) data from data collectors(executable, DLL,...
4
votes
2
answers
2k
views
CQRS async query from command handler
In a CQRS/async microservices context, I have a command handler e.g. SendOrderConfirmationEmailCommandHandler implemented in a communications service.
This depends on information from the orders ...
- 141
2
votes
2
answers
636
views
RabbitMQ as backbone for services written in different languages
I'm seeking advice from people using RabbitMQ to connect services written in different languages. Currently my organization is using RabbitMQ exclusively with C# and it's all working quite well. In ...
- 397
3
votes
0
answers
668
views
Designing CRUD Messaging communication
There are endless resources on creating CRUD for REST resources but I can't find much on doing the same for Messaging.
Given two services A and B where A receives incoming requests that initiates the ...
- 415
2
votes
1
answer
354
views
How to convey object hierarchy when object is converted to json for updates?
I have some classes being serialized via frugal (this is an open source extension of Thrift). The primary reason this is relevant is that the serialization process is out of my control and needs to ...
- 12k
1
vote
1
answer
3k
views
How can I handle multi-producer to particular single-consumer in Kafka?
I'm evaluating the Kafka. It provides some nice features which I want to use, especially durability be default and the access to past messages for new consumers, whenever the consumer wants to reach ...
- 157
3
votes
0
answers
147
views
How to broadcast message to all non connected clients
I plan to have server which consumes all data sent from clients. I want to use messaging system (RabbitMQ) to avoid all troubles with discovering services, recoveries and so on. Client just publish ...
- 157