Questions tagged [scalability]

Scalability is the ability of a system, network, or process, to handle growing amount of work in a capable manner or its ability to be enlarged to accommodate that growth.

Filter by
Sorted by
Tagged with
32 votes
10 answers
9k views

Am I right that switching programming languages will have little impact on the scalability of a CRUD API?

An external consultant to our team advised us to rewrite our SAAS offering (essentially a CRUD API) in .NET because this is more "scalable" than using Node.JS (or Rails or Flask etc.). By ...
user avatar
  • 515
0 votes
1 answer
117 views

Architecture solution for scalable crawling

I have the following requirements: a list of queries (rather long list ~ 100K - 1M items or even more) that I need to perform in a certain period of time and the execution time must be predictable. ...
user avatar
1 vote
0 answers
64 views

Handling notifications at scale

How do applications like twitter handle notifications at scale. For example @BarackObama has 131.3 million followers. When he tweets, how is that notification sent to all 131.3 million followers. I ...
user avatar
  • 119
3 votes
0 answers
83 views

Difficulty understanding how federation increases cache performance for databases?

I am studying system design for distributed systems and in this page (https://github.com/donnemartin/system-design-primer), one of the following advantages was mentioned for federation for databases ...
user avatar
  • 153
3 votes
2 answers
348 views

Real time chat at scale

I have been looking at different solutions for large scale chatting solutions. I feel as if I understand 90 % of it but am turning to this forum to tie the knot. I imagine running a bunch of message ...
user avatar
  • 119
0 votes
0 answers
24 views

Use orchestration or choreography when the 'oldest' system in a cluster needs to do something?

Imagine you have a cluster of server applications. All applications are identical. They get lots of data from a database or an external source, perform lengthy calculations, then offer the solution ...
user avatar
  • 561
-3 votes
1 answer
44 views

Server performance and CMS scalability [closed]

I have been given the job of a colleague who has resigned and I don't know where to start. I hope you can give me some hints: It is about a CMS made from scratch (Javascript/jQuery/PHP/MySQL) which ...
user avatar
  • 97
0 votes
1 answer
26 views

Scalable Web Data Service Approach

I'm looking to build a service that interacts with an existing web application's database. The service would retrieve data from an api for which the web application users own an account and warehouse/...
user avatar
  • 1
0 votes
1 answer
146 views

Low Latency for multi-million record database in a web app [closed]

As a forewarning, this is for a school project with other school teammates, so my question is just for the sake of learning best practices. We are creating a recommendation system web app which ...
user avatar
0 votes
0 answers
41 views

Express.js, redis, Traefik, service discovery for stateful app

I am currently working on a video streaming application using Node.js. The app consists of a simple Express.js api, which uses a 3rd party dependency which spawns a separate Node.js server. This Node ...
user avatar
0 votes
1 answer
197 views

How can users be notified of changes during collaborative editing in a system like Google Docs?

"Designing Google Docs" is a popular system design interview question, and there are plenty of articles on it on the web. However, those mostly touch on merging changes, but don't explain ...
user avatar
  • 133
0 votes
1 answer
103 views

designing high throughout system for storing hundred thousands incoming records per second in SQL server database

In our company we have a requirement where we would like to store hundred thousands incoming records per seconds. we currently a pub-sub model for processing many records(100/sec) from many system(~...
user avatar
0 votes
1 answer
105 views

How to deal with massively concurrent events?

I got the following interview question: Say the company has this event, where we will create a button on a website and only the first ten clicks will be accepted and win a prize. Assume that there a ...
user avatar
0 votes
2 answers
114 views

Start small - but design in such way that sharding is possible - how?

Following question is more about best-practices than a real problem - nevertheless, I'd like to know how to do it in best way. Given a service, that can operate in multiple countries/geo-areas, one ...
user avatar
3 votes
1 answer
749 views

Is consistent hashing required for sharding?

I am reading about scaling of database and came to know about sharding technique. But I also read about consistent hashing technique. So how practically sharding is implemented? Do we arrange nodes in ...
user avatar
2 votes
0 answers
40 views

Scaling Order Management System for ecommerce

Tech Stack: I am using MySQL 8 with InnoDB engine. Application is built using Java with Spring & Hibernate. Database is hosted in AWS RDS and web apps in EC2. I have two primary tables for ...
user avatar
  • 249
1 vote
1 answer
110 views

How can an anycast IP address handle millions of RPS (requests per second)

So, in terms of systems design: given a highly scalable system being served through a single load-balanced anycast IP address, when that system receives a load in the order of (hundreds of) millions ...
user avatar
  • 119
6 votes
3 answers
288 views

How can adding redunancy adversely affect performance

I have been reading about system design and was going through this popular article - A Word on Scalability The author here says: An always-on service is said to be scalable if adding resources to ...
user avatar
  • 171
2 votes
1 answer
116 views

Sharding rule updating on DB scaling

When you have sharding, horizontal partitioning, you have multiple DBMS instances, and your server app chooses which one to use by some rule that uses record IDs. Well, for example, we have ...
user avatar
  • 191
5 votes
3 answers
510 views

Performance implications of a game project monorepo on *modern* Git

First off please note, I’m fully aware that Git has historically been terrible at dealing with large binary files and very large repos; there are at least a dozen questions on SO that deal with large ...
user avatar
  • 241
0 votes
0 answers
39 views

Scalable database design review

I'm doing some research on how to scale our current SQL database and need some advice with a possible solution. The goal being able to handle more data and doing it in a way that performs well. We ...
user avatar
1 vote
2 answers
1k views

How do atomic updates work at scale?

I am working on a weird ID system where I generate all the IDs in advance and need to atomically pop() one from the database, so no ID is read twice at the same time (and so used more than once). This ...
user avatar
  • 2,412
-3 votes
2 answers
53 views

How should I handle a scalability problem during routing my requests from server?

I have faced a problem with the initial design of my system where sensitive information was being sent to the front-end and front-end was responsible for calling 3rd party APIs. As you have probably ...
user avatar
  • 103
-1 votes
3 answers
145 views

Can I manage thousands of concurrent connections with a non-Node stack?

I'm developing a social network with Django (Python) + Postgres SQL. My site will have a chat feature so that users can communicate to each other in real-time, and the communication will be only from ...
user avatar
  • 9
-4 votes
1 answer
63 views

application can not handle certain amount of RPS when 3k+ sessions connected

i have a problem in my scalable Pub/Sub application that it can not take more than 30 RPS when big amount of sessions are open against it. first i will explain the application structure. the ...
user avatar
  • 21
0 votes
1 answer
94 views

How to make sure all of the nodes process one API request behind a load balancer

I have an architectural question. I have an application which is subscribed to a log compacted Kafka topic. I have to process each event and store into a persistent datastore. I am planning to run the ...
user avatar
  • 101
-1 votes
2 answers
102 views

Developing your application as microservices or as a monolithic app - which is cheaper when deploying and scaling?

I am developing an application, and want to implement a certain functionality. I find that this can be done in the stack I am using, however it's hard to implement. I can create a microservice with ...
user avatar
2 votes
2 answers
615 views

Designing a scalable microservice: how to prevent one instance from performing an action if another instance allready did?

As I am moving a part of the monolith app logic to a microservice, I am standing before a problem with scalability. Currently, the main monolith runs on different instances, and has some scheduled ...
user avatar
  • 129
3 votes
2 answers
260 views

Architecture for real time updates from the data in file system

I am trying to revamp my legacy application to make it scalable and performant. Its current architecture is something like this Consider a short-lived script that gets invocated 500k+ times a day, ...
user avatar
3 votes
3 answers
316 views

How can I scale a database that requires that writes are consistent?

Suppose I have a table that saves plane ticket purchases. I need to keep track that I don't oversell so when a user purchases a ticket it needs to be stored in that table and other customers need to ...
user avatar
4 votes
1 answer
74 views

How does a push-based(write fanout) feed system handle unsubscribe logic, message erasure and new following user's message

I am curious about these three questions when building a push-based(write fanout) feed system: How does it handle the unsubscribe logic? To me, it seems to me that we have two choices: delete or ...
user avatar
-3 votes
2 answers
86 views

How to scale an application where every read results in a write?

So I am trying to design a simple URL shortener application where every time a URL is queried, it is going to update the number of times it has been queried. I'm thinking of using MongoDB and I am ...
user avatar
  • 291
1 vote
1 answer
82 views

Is my server design safe regarding multiple threads and concurrent database reads/writes?

I'm making a chat server using sockets and a MySQL database, and after it's working I want to expand it to become a more complex game server. I want to know whether my design is missing anything. ...
user avatar
4 votes
4 answers
2k views

Should we share a database between two 'Microservices'?

We're implementing a service that exposes data related to a particular part of a business. It will pull data in from different sources, do some ETL, and store it in Redis. It will expose this data ...
user avatar
0 votes
1 answer
225 views

Is event-sourcing and event-driven design works in scalable architecture for a wallet?

considering you need to design a simple wallet service that keep tracks of transactions, and give balance for each account. I started designing the solution using event-driven architecture, so every ...
user avatar
  • 11
7 votes
4 answers
6k views

Should data transformation be on the front or on the back end in this scenario?

Let us say I have some data in a Json format. Let us say the Json format is the following: {title, resources[] } The resources array contains information about a graph. But it should be iterated ...
user avatar
1 vote
0 answers
25 views

How would i design processing twitter data

I am working on a project where a user can input different criteria which will be used to fetch tweets, lets call this action as TweetAnalysis. These tweets will then be sent to another internal ...
user avatar
  • 215
0 votes
0 answers
123 views

What could be a good scalable alternative to polling data and then looping over a list of objects for triggering some action on those?

So I have some naive implementation for the following problem: We have a list of objects with action methods that have to be trigger at some value of interest. This value is polled (or is streamed) ...
user avatar
  • 101
1 vote
2 answers
1k views

What is the best way to run multiple instances of a web app that requires state to be transferred between instances?

I'm working on a web app where users enter a "room." The state of these rooms is loaded in the server's memory at all times, and is synchronized with the clients via websockets. What's the best way to ...
user avatar
0 votes
0 answers
96 views

How can I economically scale to 100+ instances of my .Net Core app without using 1 container per instance?

Currently I have a .NET core application, which fires up a new thread to hold each customer account. Each thread instance: Is long running for many months or more Holds open SignalR Websockets and ...
user avatar
-1 votes
1 answer
56 views

Calling microservices after scaling

I am developing a microservice platform with Spring. So far I have a few microservices and a service discovery server where all microservices register themselves. I also have an Angular client ...
user avatar
1 vote
2 answers
910 views

Advantages of using a message broker for scaling websocket client-to-client communications

I'm designing a system where pairs of clients need to exchange messages proxied by a backend service. My initial plan was to use websockets and have the clients connect to a single websocket server, ...
user avatar
0 votes
3 answers
130 views

Using Kubernetes with an app that wasn't designed to scale

We have a .Net 3 tiered app that wasn't designed to scale horizontally. I've heard we can use docker to containerize our app and then put it on kubernetes. Is that enough for kubernetes to make it ...
user avatar
2 votes
1 answer
2k views

One process using std::thread, 2 physical CPUs, 4 cores each, parallelism level?

Suppose I have a one C++ process, and I want this process to run eight threads in parallel. And suppose that: I have a computer with two (2) physical CPUs. Each CPU has four (4) cores, so that's 4x2 ...
user avatar
2 votes
1 answer
573 views

How to better scale reads in a website: to CQRS or not to CQRS?

The company i'm working for it's rewriting a legacy web application and we are evaluating the better architecture to get the job done. The business domain is quite simple: there are few entities, ...
user avatar
1 vote
1 answer
72 views

Publish / Subscribe Paradigm Implementation Problems

Reading the final chapter 6 of the paper "The Many Faces of Publish/Subscribe" I stumbled across: Decoupling is a desirable property because it enforces scalability at the abstraction level,...
user avatar
  • 119
6 votes
2 answers
598 views

Scalability: Millions of tables vs one big master table and millions of views

We have to migrate an old (million LOC) system from SAP ADS (formerly Sybase) ISAM based (so called free tables) based system to a PostgreSQL database. The system implements kind of multitenancy ...
user avatar
0 votes
1 answer
78 views

My local server is getting close to maximum resources, I want to add another server.

So, first let me explain my current setup. I have an unmanaged ethernet switch which is connected to my intel nuc (server A) and an external had drive. Server A is running: Ubuntu Docker Gitlab ...
user avatar
1 vote
1 answer
1k views

Design scalable solution with queue

Assuming the following scenario: A web application that receives inputs from the user and process the inputs through an algorithm which takes between 5 to 25 minutes (depending on the inputs) and ...
user avatar
  • 179
4 votes
1 answer
601 views

Sharding and application routing cross region on AWS

We current have a very simple Multi Tenant monolith, with a SQL SERVER backend (Self hosted on EC2 on AWS), and multiple application services talking to one DB behind an Classic AWS ELB. Our database ...
user avatar

1
2 3 4 5