Questions tagged [load-balancing]
The load-balancing tag has no usage guidance.
43
questions
2
votes
1
answer
83
views
Granularity of API Gateways to Service Balancers
OSS API Gateways typically come bundled with built-in load-balancing capabilities. We see this with Netflix Zuul and Kong.
In a service-oriented architecture, where many microservices are talking to ...
- 343
4
votes
1
answer
85
views
Service discovery and load balancers with high-frequency health checks
I am trying to understand the advantages of service discovery compared to load-balancing within the context of a microservice mesh where many instances/nodes/VMs/containers of many web services are ...
- 30.3k
0
votes
0
answers
79
views
Load balancing the load balancers
Currently I have a system where I have installed HAProxy on one machine and my other 3 machines serves the webapps and the fourth machine for the database. Now I need to add another load balancer in ...
- 109
0
votes
0
answers
46
views
What would be the best way to queue asynchronous calls received simultaneously by a web service cluster?
I have an API where every time is called there are multiple calls to multiple webservices in the background, sometimes it takes up to 20 seconds to process the request calling up to 10 different web ...
- 109
1
vote
1
answer
114
views
How can an anycast IP address handle millions of RPS (requests per second)
So, in terms of systems design:
given a highly scalable system being served through a single load-balanced anycast IP address,
when that system receives a load in the order of (hundreds of) millions ...
- 183
1
vote
1
answer
480
views
What performance benefits does a Redis cluster have over having all machines connect to a single Redis node? [closed]
Suppose I have data that easily fits in memory in a redis database. The redis server runs as a single service on a single process on a single machine. Let's say I have a 100 different machines connect ...
- 409
-1
votes
1
answer
882
views
How do I know if my nodejs application is stateless or not?
According to documentation from PM: https://pm2.io/docs/runtime/guide/load-balancing/
To make use of its load balancing feature which uses node's clustering to spawn multiple node processes, I need a ...
- 134k
1
vote
2
answers
126
views
Alternatives to pessimistic locking in the DBMS for load balancing
A simplified version of my problem looks like this:
the database contains two tables:
one contains account balances (Accounts)
the other contains account withdrawal and deposit requests (Requests)
...
- 196k
0
votes
1
answer
37
views
How to dispatch sets of items to the relevant (LB) exclusive consumers with RabbitMQ?
I am trying to process sets of items (also, different sets have different items) in specific RabbitMQ consumers (one for each set of items) that would be created on-demand and are dispatched to the ...
- 121
2
votes
4
answers
346
views
Reverse Load Balancer: Out Balancer?
Load balancing in is a common topic, but there isn't as much said about load balancing out. I may have an application that can prepare 1mm requests/s but is unable to send them all out at that speed ...
- 195
1
vote
0
answers
95
views
How to do loadbalancing for collaborative editing with multi-az and geoproximity based routing policy
I am planning a project which has users collaboratively editing a document. To provide good latency to users, I am planning to deploy in multiple AWS regions with active-active mongodb replicas with ...
- 649
0
votes
1
answer
202
views
What should we consider when designing a load balancer with minimum cost
Given a set of processes running on a cluster of hosts, I'm designing a system that load balances the hosts through live migrations (carried out by an external service) of the processes.
The goal of ...
- 3,062
1
vote
1
answer
45
views
Poll based database operations with a load balanced application
I have a .NET Core application that is hosted as multiple load balanced instances (separate servers, obviously pointing to the same database).
I have written a service within the application that ...
- 12.4k
0
votes
0
answers
75
views
Assigning weights dynamically to ensure equal distribution
Scenario:-
The load balancer distributes traffic to backends with a simple round-robin mechanism.
With default config, each backend is assigned weight "1" so all backends are given equal chance of ...
- 109
1
vote
1
answer
404
views
Are there still reasons to use DNS for load balancing?
I wanted to learn more about DNS, and I happened to have a copy of Computer Networking: A Top-Down Approach 4th Edition lying around.
Section 2.5.1 (page 132) suggests using DNS as a load balancer:
...
- 839
1
vote
1
answer
116
views
How can I prepare my platform to drastically expand for the future?
Preface
I'm currently building a very small scale platform I plan on bringing into a trial-production phase here within the next month.
As of now, it's just a simple web application. It contains ...
CommunityBot
- 1
0
votes
0
answers
49
views
How should the interaction between the MIS instances of a large system happen?
Overall situations:
The plan was to build a large system (Management Information System or MIS type) to be used throughout the country, by say 100,000 users daily. The team decided to split that into ...
- 119
5
votes
2
answers
3k
views
Load Balancer / API Gateway availability or is it a single point of failure?
I'm developing a microservice system. I have a discovery service (Eureka) for all my services and an API Gateway (Zuul) to call each service via an URL.
My problem: How can I assure that a service ...
- 26.3k
1
vote
0
answers
52
views
How to design a highly available and fault tolerant file storage drop location in linux box
Am trying to build a highly available and fault tolerant file drop location in linux server. Please find the current system design below:
We got 2 linux servers in secured zone into which several ...
- 127
3
votes
0
answers
370
views
Blue-Green Deployment: how to synchronize and maintain data consistency after migration?
To provide zero downtime upgrades of my highload service I use blue green deployment strategy.
Every moment data changing happens, so how to migrate all data consistently? In the moment I switch ...
- 433
0
votes
0
answers
64
views
How to restrict API endpoints which are deployed in AWS Application Load Balancer?
I created one webapi application which includes few modules like account, user etc and overall includes 10 or more endpoints.
I deployed this in EC2 instances and configured in application load ...
- 99
17
votes
4
answers
2k
views
Rate limiting *un*-authenticated requests
Say we have a load balancer that also does rate limiting. Rate limiting seems pretty straightforward for logged-in users - just look at the JWT and maybe use an in-memory data-store to see how many ...
- 1,367
0
votes
1
answer
369
views
How an async response is usually getting back to the clent in typical reactive highload architecture?
A typical highload reactive architecture is:
(Q means queue)
And usually arrows are from client to DB at such sketches. My question is how the response is going back? The same queues and other stuff?...
- 125k
1
vote
0
answers
70
views
NGINX in between load balance and Apache?
I have recently joined the company where I see below stack to handle the http request
CDN -> LVS(Load balancer) -> NGINX -> Apache
My question is about using advantage of NGINX b/w Load balancer ...
- 103k
1
vote
1
answer
65
views
Fail over for application that does outgoing requests
We built an application that has a list of fixed intranet URLs and crawls these periodically, transforms the data, stores it in a database.
We have the requirement that the application has some kind ...
- 275
-3
votes
1
answer
36
views
Disable recieving messages from queue remotly
I have a CRUD like service which have REST HTTP API. This service have two instances - only one recieving request at time. If first instance starts throwing exceptions or slowing down we change load ...
- 65k
6
votes
1
answer
978
views
Optimal load distribution with maximum workload
I need to find an optimal distribution of some matching tasks on multiple jobs; each job is limited by a maximum workload and the grouped tasks should maximize the workload within the same job.
...
CommunityBot
- 1
1
vote
1
answer
61
views
should I use server cluster when my application does not work with session
I read about payara(glassfish) server cluster and find out that clustering with payara only replicate session in multiple servers.
but I use jwt for my project so I don't use session at all.
I ...
- 123
1
vote
1
answer
180
views
How does global load balancing work?
How does a highly scaled company serve users on the opposite end of the world?
Take Facebook for example (headquartered in California). If someone hit their endpoints from a place like South Africa, ...
- 134k
15
votes
1
answer
3k
views
Should I split my API by user type?
Let's say I have an app to manage sporting teams. Potential users have a role of 'coach', 'player', and 'fan'. In many cases they will have to make similar api calls to retrieve info like this:
/api/...
- 9,027
18
votes
3
answers
6k
views
What does a load balancer return?
When a user hits the load balancer and the load balancer determines which web server to forward to, what happens next? Does the load balancer forward the request and all its data to the webserver, ...
- 9,915
1
vote
0
answers
496
views
Using a hardware load balancer for PostgreSQL / MySQL
I need to ensure high availability of my 3-tier architecture system. Currently I have the database mirrored by using MySQL Master-Master. All app boxes talk to the primary DB server
In case of ...
- 38.9k
0
votes
5
answers
2k
views
Best approach to write on a database with two webservers
I have an architecture/performance problem.
The problem:
One voting based application with: 1 loadbalancer, 2 webservers and a database
10 candidates and 200k voting users.
There may be more than ...
- 76.3k
-1
votes
1
answer
144
views
imitate load balancing programmatically
I have implemented some simple messaging system IMS for my own use inside the application, that allows sending and recieving message for objects.
I have a singleton object IMSContext that has a ...
- 65k
2
votes
1
answer
1k
views
Deliver message to websocket client connected through load balancer
The problem
I have a number of clients connected via websocket to nodes of my web application through a load balancer. What I need is to deliver notifications on a per-user basis.
My idea
My idea ...
CommunityBot
- 1
0
votes
1
answer
137
views
VMs are not created on the same physical server to balance load?
When load reaches a certain level in IaaS environemnt, new VM instances are created to reduce load (scalability).
My Questions that these VMs are not created on the same physical server, right?
I ...
- 17.9k
3
votes
2
answers
3k
views
Scaling a Restful Web Service Hosted in Server
We have deployed a restful web service on a application server (Apache). The volume is getting higher and we do want to scale it. We will deploy two more Apache instances on two more machines.
How do ...
CommunityBot
- 1
3
votes
1
answer
3k
views
What is the best way to horizontally scale .Net back-end applications?
Given a workload with many long running CPU/IO intensive operations (e.g. producing multi-GB text files from database reads and business rules), what is the best way to balance .net application load ...
CommunityBot
- 1
1
vote
1
answer
913
views
How does a network load balancer work with session affinity?
I would like to know the low level details of how a network load balancer works with sticky session enabled.
Reason behind the question:
We have a legacy ASP.NET application that is both a front-...
CommunityBot
- 1
3
votes
2
answers
75
views
Parallelising processing of users
Update I updated my question to reflect the fact I'm working with a database.
I need to process user actions:
The actions for each user change the user's balance which is then persisted to a database....
CommunityBot
- 1
2
votes
1
answer
1k
views
How to minimize database deadlocks in a load balanced web application?
I'm working on a web application hosted on multiple load-balanced web front ends (WFEs). This application has an API method that performs a database query and returns the results. This query only ...
CommunityBot
- 1
0
votes
0
answers
59
views
Algorithm to minimize total processing time with multiple workers?
Say you have an office with 3 printers, all execute print jobs at exactly the same speed. Say you have a fixed order size of:
20 single page reports which take 10 seconds each
15 paper packets which ...
8
votes
1
answer
3k
views
Bottlenecks, nginx as a load balancer
Why nginx can keep itself from being a bottleneck when serving as a load balancer. If it becomes the single point bottleneck in some conditions, then is there solution except hardware load balancer?
- 125k