Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [load-balancing]

The tag has no usage guidance.

-1
votes
0answers
13 views

Grouping clients with horizontal scaling

I am creating a system which will be deployed on Kubernetes using GCP. The team working on this is really small, only two people, so we are looking for solutions that don't take forever to implement ...
0
votes
1answer
56 views

How an async response is usually getting back to the clent in typical reactive highload architecture?

A typical highload reactive architecture is: (Q means queue) And usually arrows are from client to DB at such sketches. My question is how the response is going back? The same queues and other stuff?...
1
vote
0answers
47 views

NGINX in between load balance and Apache?

I have recently joined the company where I see below stack to handle the http request CDN -> LVS(Load balancer) -> NGINX -> Apache My question is about using advantage of NGINX b/w Load balancer ...
1
vote
1answer
52 views

Fail over for application that does outgoing requests

We built an application that has a list of fixed intranet URLs and crawls these periodically, transforms the data, stores it in a database. We have the requirement that the application has some kind ...
-3
votes
1answer
31 views

Disable recieving messages from queue remotly

I have a CRUD like service which have REST HTTP API. This service have two instances - only one recieving request at time. If first instance starts throwing exceptions or slowing down we change load ...
1
vote
1answer
46 views

should I use server cluster when my application does not work with session

I read about payara(glassfish) server cluster and find out that clustering with payara only replicate session in multiple servers. but I use jwt for my project so I don't use session at all. I ...
1
vote
0answers
159 views

How to set up servers in node.js for intensive calculations?

I'm developing architecture for devices where requests can be very high in in number, also the data that is received requires to do some intensive computation on it 1) Is there any method to do the ...
1
vote
1answer
140 views

How does global load balancing work?

How does a highly scaled company serve users on the opposite end of the world? Take Facebook for example (headquartered in California). If someone hit their endpoints from a place like South Africa, ...
7
votes
1answer
390 views

Should I split my API by user type?

Let's say I have an app to manage sporting teams. Potential users have a role of 'coach', 'player', and 'fan'. In many cases they will have to make similar api calls to retrieve info like this: /api/...
1
vote
0answers
263 views

Using a hardware load balancer for PostgreSQL / MySQL

I need to ensure high availability of my 3-tier architecture system. Currently I have the database mirrored by using MySQL Master-Master. All app boxes talk to the primary DB server In case of ...
-1
votes
1answer
111 views

imitate load balancing programmatically

I have implemented some simple messaging system IMS for my own use inside the application, that allows sending and recieving message for objects. I have a singleton object IMSContext that has a ...
1
vote
1answer
601 views

Deliver message to websocket client connected through load balancer

The problem I have a number of clients connected via websocket to nodes of my web application through a load balancer. What I need is to deliver notifications on a per-user basis. My idea My idea ...
6
votes
1answer
592 views

Optimal load distribution with maximum workload

I need to find an optimal distribution of some matching tasks on multiple jobs; each job is limited by a maximum workload and the grouped tasks should maximize the workload within the same job. ...
0
votes
5answers
664 views

Best approach to write on a database with two webservers

I have an architecture/performance problem. The problem: One voting based application with: 1 loadbalancer, 2 webservers and a database 10 candidates and 200k voting users. There may be more than ...
5
votes
3answers
1k views

What does a load balancer return?

When a user hits the load balancer and the load balancer determines which web server to forward to, what happens next? Does the load balancer forward the request and all its data to the webserver, ...
0
votes
1answer
123 views

VMs are not created on the same physical server to balance load?

When load reaches a certain level in IaaS environemnt, new VM instances are created to reduce load (scalability). My Questions that these VMs are not created on the same physical server, right? I ...
2
votes
2answers
2k views

Scaling a Restful Web Service Hosted in Server

We have deployed a restful web service on a application server (Apache). The volume is getting higher and we do want to scale it. We will deploy two more Apache instances on two more machines. How do ...
3
votes
1answer
1k views

What is the best way to horizontally scale .Net back-end applications?

Given a workload with many long running CPU/IO intensive operations (e.g. producing multi-GB text files from database reads and business rules), what is the best way to balance .net application load ...
0
votes
0answers
43 views

Algorithm to minimize total processing time with multiple workers?

Say you have an office with 3 printers, all execute print jobs at exactly the same speed. Say you have a fixed order size of: 20 single page reports which take 10 seconds each 15 paper packets which ...
1
vote
1answer
592 views

How does a network load balancer work with session affinity?

I would like to know the low level details of how a network load balancer works with sticky session enabled. Reason behind the question: We have a legacy ASP.NET application that is both a front-...
2
votes
2answers
71 views

Parallelising processing of users

Update I updated my question to reflect the fact I'm working with a database. I need to process user actions: The actions for each user change the user's balance which is then persisted to a database....
2
votes
1answer
643 views

How to minimize database deadlocks in a load balanced web application?

I'm working on a web application hosted on multiple load-balanced web front ends (WFEs). This application has an API method that performs a database query and returns the results. This query only ...
2
votes
1answer
1k views

Bottlenecks, nginx as a load balancer

Why nginx can keep itself from being a bottleneck when serving as a load balancer. If it becomes the single point bottleneck in some conditions, then is there solution except hardware load balancer?