Questions tagged [load-balancing]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2 votes
1 answer
83 views

Granularity of API Gateways to Service Balancers

OSS API Gateways typically come bundled with built-in load-balancing capabilities. We see this with Netflix Zuul and Kong. In a service-oriented architecture, where many microservices are talking to ...
4 votes
1 answer
85 views

Service discovery and load balancers with high-frequency health checks

I am trying to understand the advantages of service discovery compared to load-balancing within the context of a microservice mesh where many instances/nodes/VMs/containers of many web services are ...
0 votes
0 answers
79 views

Load balancing the load balancers

Currently I have a system where I have installed HAProxy on one machine and my other 3 machines serves the webapps and the fourth machine for the database. Now I need to add another load balancer in ...
0 votes
0 answers
46 views

What would be the best way to queue asynchronous calls received simultaneously by a web service cluster?

I have an API where every time is called there are multiple calls to multiple webservices in the background, sometimes it takes up to 20 seconds to process the request calling up to 10 different web ...
1 vote
1 answer
114 views

How can an anycast IP address handle millions of RPS (requests per second)

So, in terms of systems design: given a highly scalable system being served through a single load-balanced anycast IP address, when that system receives a load in the order of (hundreds of) millions ...
1 vote
1 answer
480 views

What performance benefits does a Redis cluster have over having all machines connect to a single Redis node? [closed]

Suppose I have data that easily fits in memory in a redis database. The redis server runs as a single service on a single process on a single machine. Let's say I have a 100 different machines connect ...
-1 votes
1 answer
882 views

How do I know if my nodejs application is stateless or not?

According to documentation from PM: https://pm2.io/docs/runtime/guide/load-balancing/ To make use of its load balancing feature which uses node's clustering to spawn multiple node processes, I need a ...
1 vote
2 answers
126 views

Alternatives to pessimistic locking in the DBMS for load balancing

A simplified version of my problem looks like this: the database contains two tables: one contains account balances (Accounts) the other contains account withdrawal and deposit requests (Requests) ...
0 votes
1 answer
37 views

How to dispatch sets of items to the relevant (LB) exclusive consumers with RabbitMQ?

I am trying to process sets of items (also, different sets have different items) in specific RabbitMQ consumers (one for each set of items) that would be created on-demand and are dispatched to the ...
2 votes
4 answers
346 views

Reverse Load Balancer: Out Balancer?

Load balancing in is a common topic, but there isn't as much said about load balancing out. I may have an application that can prepare 1mm requests/s but is unable to send them all out at that speed ...
1 vote
0 answers
95 views

How to do loadbalancing for collaborative editing with multi-az and geoproximity based routing policy

I am planning a project which has users collaboratively editing a document. To provide good latency to users, I am planning to deploy in multiple AWS regions with active-active mongodb replicas with ...
0 votes
1 answer
202 views

What should we consider when designing a load balancer with minimum cost

Given a set of processes running on a cluster of hosts, I'm designing a system that load balances the hosts through live migrations (carried out by an external service) of the processes. The goal of ...
1 vote
1 answer
45 views

Poll based database operations with a load balanced application

I have a .NET Core application that is hosted as multiple load balanced instances (separate servers, obviously pointing to the same database). I have written a service within the application that ...
0 votes
0 answers
75 views

Assigning weights dynamically to ensure equal distribution

Scenario:- The load balancer distributes traffic to backends with a simple round-robin mechanism. With default config, each backend is assigned weight "1" so all backends are given equal chance of ...
1 vote
1 answer
404 views

Are there still reasons to use DNS for load balancing?

I wanted to learn more about DNS, and I happened to have a copy of Computer Networking: A Top-Down Approach 4th Edition lying around. Section 2.5.1 (page 132) suggests using DNS as a load balancer: ...
1 vote
1 answer
116 views

How can I prepare my platform to drastically expand for the future?

Preface I'm currently building a very small scale platform I plan on bringing into a trial-production phase here within the next month. As of now, it's just a simple web application. It contains ...
0 votes
0 answers
49 views

How should the interaction between the MIS instances of a large system happen?

Overall situations: The plan was to build a large system (Management Information System or MIS type) to be used throughout the country, by say 100,000 users daily. The team decided to split that into ...
5 votes
2 answers
3k views

Load Balancer / API Gateway availability or is it a single point of failure?

I'm developing a microservice system. I have a discovery service (Eureka) for all my services and an API Gateway (Zuul) to call each service via an URL. My problem: How can I assure that a service ...
1 vote
0 answers
52 views

How to design a highly available and fault tolerant file storage drop location in linux box

Am trying to build a highly available and fault tolerant file drop location in linux server. Please find the current system design below: We got 2 linux servers in secured zone into which several ...
3 votes
0 answers
370 views

Blue-Green Deployment: how to synchronize and maintain data consistency after migration?

To provide zero downtime upgrades of my highload service I use blue green deployment strategy. Every moment data changing happens, so how to migrate all data consistently? In the moment I switch ...
0 votes
0 answers
64 views

How to restrict API endpoints which are deployed in AWS Application Load Balancer?

I created one webapi application which includes few modules like account, user etc and overall includes 10 or more endpoints. I deployed this in EC2 instances and configured in application load ...
17 votes
4 answers
2k views

Rate limiting *un*-authenticated requests

Say we have a load balancer that also does rate limiting. Rate limiting seems pretty straightforward for logged-in users - just look at the JWT and maybe use an in-memory data-store to see how many ...
0 votes
1 answer
369 views

How an async response is usually getting back to the clent in typical reactive highload architecture?

A typical highload reactive architecture is: (Q means queue) And usually arrows are from client to DB at such sketches. My question is how the response is going back? The same queues and other stuff?...
1 vote
0 answers
70 views

NGINX in between load balance and Apache?

I have recently joined the company where I see below stack to handle the http request CDN -> LVS(Load balancer) -> NGINX -> Apache My question is about using advantage of NGINX b/w Load balancer ...
1 vote
1 answer
65 views

Fail over for application that does outgoing requests

We built an application that has a list of fixed intranet URLs and crawls these periodically, transforms the data, stores it in a database. We have the requirement that the application has some kind ...
-3 votes
1 answer
36 views

Disable recieving messages from queue remotly

I have a CRUD like service which have REST HTTP API. This service have two instances - only one recieving request at time. If first instance starts throwing exceptions or slowing down we change load ...
6 votes
1 answer
978 views

Optimal load distribution with maximum workload

I need to find an optimal distribution of some matching tasks on multiple jobs; each job is limited by a maximum workload and the grouped tasks should maximize the workload within the same job. ...
1 vote
1 answer
61 views

should I use server cluster when my application does not work with session

I read about payara(glassfish) server cluster and find out that clustering with payara only replicate session in multiple servers. but I use jwt for my project so I don't use session at all. I ...
1 vote
1 answer
180 views

How does global load balancing work?

How does a highly scaled company serve users on the opposite end of the world? Take Facebook for example (headquartered in California). If someone hit their endpoints from a place like South Africa, ...
15 votes
1 answer
3k views

Should I split my API by user type?

Let's say I have an app to manage sporting teams. Potential users have a role of 'coach', 'player', and 'fan'. In many cases they will have to make similar api calls to retrieve info like this: /api/...
18 votes
3 answers
6k views

What does a load balancer return?

When a user hits the load balancer and the load balancer determines which web server to forward to, what happens next? Does the load balancer forward the request and all its data to the webserver, ...
1 vote
0 answers
496 views

Using a hardware load balancer for PostgreSQL / MySQL

I need to ensure high availability of my 3-tier architecture system. Currently I have the database mirrored by using MySQL Master-Master. All app boxes talk to the primary DB server In case of ...
0 votes
5 answers
2k views

Best approach to write on a database with two webservers

I have an architecture/performance problem. The problem: One voting based application with: 1 loadbalancer, 2 webservers and a database 10 candidates and 200k voting users. There may be more than ...
-1 votes
1 answer
144 views

imitate load balancing programmatically

I have implemented some simple messaging system IMS for my own use inside the application, that allows sending and recieving message for objects. I have a singleton object IMSContext that has a ...
2 votes
1 answer
1k views

Deliver message to websocket client connected through load balancer

The problem I have a number of clients connected via websocket to nodes of my web application through a load balancer. What I need is to deliver notifications on a per-user basis. My idea My idea ...
0 votes
1 answer
137 views

VMs are not created on the same physical server to balance load?

When load reaches a certain level in IaaS environemnt, new VM instances are created to reduce load (scalability). My Questions that these VMs are not created on the same physical server, right? I ...
3 votes
2 answers
3k views

Scaling a Restful Web Service Hosted in Server

We have deployed a restful web service on a application server (Apache). The volume is getting higher and we do want to scale it. We will deploy two more Apache instances on two more machines. How do ...
3 votes
1 answer
3k views

What is the best way to horizontally scale .Net back-end applications?

Given a workload with many long running CPU/IO intensive operations (e.g. producing multi-GB text files from database reads and business rules), what is the best way to balance .net application load ...
1 vote
1 answer
913 views

How does a network load balancer work with session affinity?

I would like to know the low level details of how a network load balancer works with sticky session enabled. Reason behind the question: We have a legacy ASP.NET application that is both a front-...
3 votes
2 answers
75 views

Parallelising processing of users

Update I updated my question to reflect the fact I'm working with a database. I need to process user actions: The actions for each user change the user's balance which is then persisted to a database....
2 votes
1 answer
1k views

How to minimize database deadlocks in a load balanced web application?

I'm working on a web application hosted on multiple load-balanced web front ends (WFEs). This application has an API method that performs a database query and returns the results. This query only ...
0 votes
0 answers
59 views

Algorithm to minimize total processing time with multiple workers?

Say you have an office with 3 printers, all execute print jobs at exactly the same speed. Say you have a fixed order size of: 20 single page reports which take 10 seconds each 15 paper packets which ...
8 votes
1 answer
3k views

Bottlenecks, nginx as a load balancer

Why nginx can keep itself from being a bottleneck when serving as a load balancer. If it becomes the single point bottleneck in some conditions, then is there solution except hardware load balancer?