Questions tagged [scalability]

Scalability is the ability of a system, network, or process, to handle growing amount of work in a capable manner or its ability to be enlarged to accommodate that growth.

Filter by
Sorted by
Tagged with
-1
votes
0answers
90 views

How to deal with an ever-expanding project? [duplicate]

Let's start by saying that since the start of our project, I've been the sole software engineer and it's has been built on a small, but a relatively stable foundation of code made as a prototype. We ...
0
votes
0answers
84 views

How can I economically scale to 100+ instances of my .Net Core app without using 1 container per instance?

Currently I have a .NET core application, which fires up a new thread to hold each customer account. Each thread instance: Is long running for many months or more Holds open SignalR Websockets and ...
-1
votes
1answer
43 views

Calling microservices after scaling

I am developing a microservice platform with Spring. So far I have a few microservices and a service discovery server where all microservices register themselves. I also have an Angular client ...
-2
votes
1answer
117 views

Advantages of using a message broker for scaling websocket client-to-client communications

I'm designing a system where pairs of clients need to exchange messages proxied by a backend service. My initial plan was to use websockets and have the clients connect to a single websocket server, ...
0
votes
2answers
88 views

Using Kubernetes with an app that wasn't designed to scale

We have a .Net 3 tiered app that wasn't designed to scale horizontally. I've heard we can use docker to containerize our app and then put it on kubernetes. Is that enough for kubernetes to make it ...
1
vote
1answer
289 views

One process using std::thread, 2 physical CPUs, 4 cores each, parallelism level?

Suppose I have a one C++ process, and I want this process to run eight threads in parallel. And suppose that: I have a computer with two (2) physical CPUs. Each CPU has four (4) cores, so that's 4x2 ...
2
votes
1answer
161 views

How to better scale reads in a website: to CQRS or not to CQRS?

The company i'm working for it's rewriting a legacy web application and we are evaluating the better architecture to get the job done. The business domain is quite simple: there are few entities, ...
1
vote
1answer
64 views

Publish / Subscribe Paradigm Implementation Problems

Reading the final chapter 6 of the paper "The Many Faces of Publish/Subscribe" I stumbled across: Decoupling is a desirable property because it enforces scalability at the abstraction level, by ...
6
votes
2answers
479 views

Scalability: Millions of tables vs one big master table and millions of views

We have to migrate an old (million LOC) system from SAP ADS (formerly Sybase) ISAM based (so called free tables) based system to a PostgreSQL database. The system implements kind of multitenancy ...
0
votes
1answer
76 views

My local server is getting close to maximum resources, I want to add another server.

So, first let me explain my current setup. I have an unmanaged ethernet switch which is connected to my intel nuc (server A) and an external had drive. Server A is running: Ubuntu Docker Gitlab ...
1
vote
1answer
333 views

Design scalable solution with queue

Assuming the following scenario: A web application that receives inputs from the user and process the inputs through an algorithm which takes between 5 to 25 minutes (depending on the inputs) and ...
3
votes
1answer
146 views

Sharding and application routing cross region on AWS

We current have a very simple Multi Tenant monolith, with a SQL SERVER backend (Self hosted on EC2 on AWS), and multiple application services talking to one DB behind an Classic AWS ELB. Our database ...
2
votes
4answers
184 views

User calling REST APIs on behalf of a different user

Here's an example: GET /posts POST /posts GET /posts/{post_id} PUT /posts/{post_id} This api is being used by SUPER_ADMIN as well as CONTENT_WRITERS. Its working great. If user is logged in as a ...
1
vote
0answers
65 views

User level customised activity feed design

I am working creating api for activity feed of user. Feed contains different type of entities. Before that let me give you bit overview about the app. Its a video app where Users can ask questions ...
13
votes
7answers
793 views

Saving high-frequency events to a connection-limit constrained database

We've got a situation where I have to deal with a massive influx of events coming in to our server, at about 1000 events per second, on average (peak could be ~2000). The problem Our system is ...
1
vote
1answer
116 views

How should we approach layered-architectures that need large amounts of continuous, real-time, communication?

Background In much of the literature I've read online with respect to multi-layered architectures, many people describe how to create the simple application where: UI presents static model objects ...
-2
votes
1answer
282 views

Shopping Cart Concurrency Question [closed]

I have a problem with my e-commerce site. There can be multiple simultaneous requests to add items in the shopping cart, I was moving towards the design where when an item is added to the shopping ...
0
votes
1answer
110 views

Guidance for Client side

We have created software for Rugged and mobile devices, and it gets deployed on the device. Admin has a provision to send an update to those devices. We use GCM or WNS for sending a notification to ...
0
votes
1answer
182 views

Co-relating messages in Kafka

Context We are building an application that acts like a hub for messages coming in from multiple Producers and it assigns to Consumers based on certain criteria. Need is to have the design highly ...
3
votes
1answer
91 views

Architecture for Large-Scale Matrix Multiplication: Distributed Architecture or One Strong Server

I've asked a question about Scaling Matrix Multiplication by CPU Cores on StackOverflow and it seems that merely adding more CPU cores to this problem won't reduce the time to do Matrix ...
2
votes
1answer
192 views

High scale architecture using Event Sourcing and Eventual Consistency

I want to share with you and know what your opinion/improvements are regarding a solution I was tasked with a technical interview I faced. The exercise: You need to create an API which will indicate ...
2
votes
1answer
54 views

Architecture and Database re-design for migration and support of multiple clients

I'm evaluating the migration of the following application's architecture: - Nginx + PHP + MySQL - Currently the infrastructure is scalable and redundant in the AWS cloud and It was designed to support ...
1
vote
1answer
175 views

Building a scalable Email Delivery system

I want to fix my current Email Delivery system which sends email using a third-party email provider and creates a record for each email sent in RDS. Functionally this is how the system behaves - A ...
0
votes
1answer
409 views

What would be the architecture for a polling-based monitoring service?

I have a list of 75000 websites that need to be monitored for uptime. Monitoring the websites involves making a HTTP request for the website every minute, and the website is said to be "up" or "down" ...
2
votes
1answer
1k views

Scalable design for a web application [closed]

My apologies if this is the wrong stack exchange site for this question. Please, let me know if I should ask this in a different place. I have recently went to a interview. The interview was for the ...
0
votes
1answer
104 views

scalable communication system

I am designing communication system that will be sending targeted based SMS (ads/offers) to its customer. The basic system with low load scenario works well, and the SMS sent are based on an event ...
0
votes
2answers
2k views

Best way to design file storage for image processing system

Would appreciate any recommendations regarding design a high-load image processing service. There are lots (tens of hundreds of relatively large images (~10...20 Mb each)) that to be processed using ...
4
votes
2answers
727 views

What time series database can support high cardinality?

I have a situation where I want to track page views, click events, etc. in a time series database but am having scalability issues in the case where I want to retrieve aggregated groups of data that ...
0
votes
1answer
133 views

How to adapt the architecture of a website and have suitable hosting along with it to meet increasing users? [closed]

Say you start a web site on shared hosting and it increases in popularity which might cause it to become unavailable as the number of accesses increases. So as a developer how do I figure out when ...
3
votes
1answer
665 views

Scaling tcp/ip socket server applications

I have been trying to understand how one would scale an application utilizing tcp/ip sockets for client server communication. For example in the simple diagram below: +------------+ | ...
4
votes
1answer
1k views

Understanding architecture of NGINX

According to this article, nginx has a master process and a number of worker processes. I'm trying to understand how a request is handled by the nginx worker processes. nginx uses an event driven ...
0
votes
1answer
69 views

Standard Patterns to measure capacity in a competing consumers system

We have a number of systems that are based on the competing consumers pattern. We currently monitor the delay between an item of work being queued and processing finishing, however, as throughput ...
1
vote
1answer
146 views

How does global load balancing work?

How does a highly scaled company serve users on the opposite end of the world? Take Facebook for example (headquartered in California). If someone hit their endpoints from a place like South Africa, ...
-1
votes
1answer
541 views

similarity measure between millions of documents [closed]

I have millions of documents(close to 100 million), each document has fields such as skills, hobbies, certification and education. I want to find similarity between each document along with a score. ...
0
votes
1answer
55 views

Binding an interface on top of third-party modules to develop future-proofed and scalable apps

Every day a couple of new javascript modules are created and published around the world and we need to think long term. Let's say today I need to use an ORM module to go smooth and fast. But tomorrow ...
-2
votes
1answer
80 views

Access Management of End User Data - End User Permission Tickets

I have been familiarizing myself with Googles Security Design Whitepaper. As far as I can understand, and with respect to a Micro-services architecture, from the Access Management of End User Data ...
5
votes
2answers
175 views

switching implementations dynamically according to execution time estimates

I have a function that I can implement in two different ways. Each way has its own advantages, and performance depends on the arguments it will be given. Since each implementation has several short ...
1
vote
3answers
249 views

Multiple feature teams multiple products

Evening all. We currently have two feature teams, one Web one mobile. They have their own backlogs. Each have their own product manager and scrum master. Team size is 11 including scrum and product ...
3
votes
2answers
276 views

Is briefly closing a listen socket then re-opening it a horrible idea?

I'm writing an application on x86_64 CentOS 7 that functions as a server, managing potentially thousands of devices. Because my application doesn't do so well when running through the connection ...
1
vote
2answers
91 views

Scaling Out re-design approach?

My current web app provides a service to clients on a single site. It is NOT eBay, but I will explain using eBay as an analagous service we can all understand. A client sets up a page, and other peer ...
0
votes
1answer
425 views

What's the best way to do horizontally scalable file uploads?

In general, how do websites handle file uploads when they scale horizontally? Obviously if you have a load balancer going to 10 application servers, and each application server just saves an upload ...
1
vote
0answers
96 views

Scaling Systems With Shared Data

I'm working on an in memory on disk cache and am starting to think about strategies for scaling the system. At the moment the system persists data by creating a file for each key value pair, where the ...
2
votes
1answer
155 views

Approach to perform a calculation over a large dataset and calculate mean of scores

I have a table/collection called scores and it has 3 relevant identifiers based on which calculation need to be done. sample { score : Number, company : String, zone : String, unit : String, ...
1
vote
1answer
376 views

“persistence as a service”: what does that mean?

I read this in a book: Most of the time, calls to third-party products are entangled throughout the code. But if you really abstracted the idea of a database out—to the point where it simply ...
-3
votes
2answers
88 views

Managing quiz collection

I am creating a simple application where users will be shown random quizzes one at a time and they have to answer them. Each quiz has a category and many tags, right now I have stored quizzes in a ...
6
votes
2answers
7k views

System Design: Scalable Chat Server

Suppose you were asked to design a scalable chat server with the following requirements: The main use case is: player A sees B online, A sends a message to B, B receives it. The secondary use case is:...
1
vote
1answer
35 views

Using a second GAE app as backup

I have a Google App Engine app which is used by a small amount of users of a certain niche website. The app's only function is to get data about the user from that website's API, use that data to ...
29
votes
4answers
2k views

How does a company like Amazon avoid bottlenecks accessing the database layer?

If you imagine a company like Amazon (or any other large e-commerce web application), that is operating an online store at massive scale and only has limited quantity of physical items in its ...
0
votes
2answers
555 views

Scaling without queues?

Whenever I am asked how I would scale out an application I inevitably tend toward a queueing model: split the application responsibilities into individual services and add queues between those ...
0
votes
2answers
797 views

Designing Table To Store Hierarchy

I have a table Company and User like below... Company Table: CompanyID CompanyName etc... User Table: UserID Email UserType CompanyID etc... First I must tell you that, ...