Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [scalability]

Scalability is the ability of a system, network, or process, to handle growing amount of work in a capable manner or its ability to be enlarged to accommodate that growth.

1
vote
1answer
90 views

How to better scale reads in a website: to CQRS or not to CQRS?

The company i'm working for it's rewriting a legacy web application and we are evaluating the better architecture to get the job done. The business domain is quite simple: there are few entities, ...
0
votes
1answer
35 views

Publish / Subscribe Paradigm Implementation Problems

Reading the final chapter 6 of the paper "The Many Faces of Publish/Subscribe" I stumbled across: Decoupling is a desirable property because it enforces scalability at the abstraction level, by ...
6
votes
2answers
421 views

Scalability: Millions of tables vs one big master table and millions of views

We have to migrate an old (million LOC) system from SAP ADS (formerly Sybase) ISAM based (so called free tables) based system to a PostgreSQL database. The system implements kind of multitenancy ...
0
votes
1answer
68 views

My local server is getting close to maximum resources, I want to add another server.

So, first let me explain my current setup. I have an unmanaged ethernet switch which is connected to my intel nuc (server A) and an external had drive. Server A is running: Ubuntu Docker Gitlab ...
1
vote
1answer
86 views

Design scalable solution with queue

Assuming the following scenario: A web application that receives inputs from the user and process the inputs through an algorithm which takes between 5 to 25 minutes (depending on the inputs) and ...
3
votes
1answer
93 views

Sharding and application routing cross region on AWS

We current have a very simple Multi Tenant monolith, with a SQL SERVER backend (Self hosted on EC2 on AWS), and multiple application services talking to one DB behind an Classic AWS ELB. Our database ...
2
votes
4answers
142 views

User calling REST APIs on behalf of a different user

Here's an example: GET /posts POST /posts GET /posts/{post_id} PUT /posts/{post_id} This api is being used by SUPER_ADMIN as well as CONTENT_WRITERS. Its working great. If user is logged in as a ...
1
vote
0answers
26 views

User level customised activity feed design

I am working creating api for activity feed of user. Feed contains different type of entities. Before that let me give you bit overview about the app. Its a video app where Users can ask questions ...
13
votes
7answers
679 views

Saving high-frequency events to a connection-limit constrained database

We've got a situation where I have to deal with a massive influx of events coming in to our server, at about 1000 events per second, on average (peak could be ~2000). The problem Our system is ...
1
vote
1answer
106 views

How should we approach layered-architectures that need large amounts of continuous, real-time, communication?

Background In much of the literature I've read online with respect to multi-layered architectures, many people describe how to create the simple application where: UI presents static model objects ...
-3
votes
1answer
107 views

Shopping Cart Concurrency Question [closed]

I have a problem with my e-commerce site. There can be multiple simultaneous requests to add items in the shopping cart, I was moving towards the design where when an item is added to the shopping ...
0
votes
1answer
98 views

Guidance for Client side

We have created software for Rugged and mobile devices, and it gets deployed on the device. Admin has a provision to send an update to those devices. We use GCM or WNS for sending a notification to ...
0
votes
1answer
66 views

Co-relating messages in Kafka

Context We are building an application that acts like a hub for messages coming in from multiple Producers and it assigns to Consumers based on certain criteria. Need is to have the design highly ...
3
votes
1answer
72 views

Architecture for Large-Scale Matrix Multiplication: Distributed Architecture or One Strong Server

I've asked a question about Scaling Matrix Multiplication by CPU Cores on StackOverflow and it seems that merely adding more CPU cores to this problem won't reduce the time to do Matrix ...
0
votes
0answers
103 views

How to scale Redis pub/sub within a Docker stack, or should I decouple it?

I'm creating a simple websocket server in nodejs that uses Redis pub/sub as a messaging backplane and Mongo for some data storage. I would like to deploy this as a Docker service so we can scale it ...
2
votes
1answer
124 views

High scale architecture using Event Sourcing and Eventual Consistency

I want to share with you and know what your opinion/improvements are regarding a solution I was tasked with a technical interview I faced. The exercise: You need to create an API which will indicate ...
2
votes
1answer
44 views

Architecture and Database re-design for migration and support of multiple clients

I'm evaluating the migration of the following application's architecture: - Nginx + PHP + MySQL - Currently the infrastructure is scalable and redundant in the AWS cloud and It was designed to support ...
0
votes
1answer
78 views

Building a scalable Email Delivery system

I want to fix my current Email Delivery system which sends email using a third-party email provider and creates a record for each email sent in RDS. Functionally this is how the system behaves - A ...
0
votes
1answer
198 views

What would be the architecture for a polling-based monitoring service?

I have a list of 75000 websites that need to be monitored for uptime. Monitoring the websites involves making a HTTP request for the website every minute, and the website is said to be "up" or "down" ...
1
vote
1answer
852 views

Scalable design for a web application [closed]

My apologies if this is the wrong stack exchange site for this question. Please, let me know if I should ask this in a different place. I have recently went to a interview. The interview was for the ...
0
votes
0answers
252 views

Best design for C++boost::asio, lots of long-lasting connections, constant small messages

I'm rewriting an app that is currently written in nodejs but having scaling issues, and I know boost::asio is the proper answer. I'm just unclear which is the best pattern to use. Full duplex server, ...
0
votes
0answers
39 views

Recommended use of Azure managed services in custom event Notification system design

Upon analysis of an event processing system my team is working on I noticed usage of managed Azure services that I haven't seen before. In a nutshell what the system is doing is processing incoming ...
0
votes
1answer
97 views

scalable communication system

I am designing communication system that will be sending targeted based SMS (ads/offers) to its customer. The basic system with low load scenario works well, and the SMS sent are based on an event ...
0
votes
2answers
808 views

Best way to design file storage for image processing system

Would appreciate any recommendations regarding design a high-load image processing service. There are lots (tens of hundreds of relatively large images (~10...20 Mb each)) that to be processed using ...
3
votes
2answers
529 views

What time series database can support high cardinality?

I have a situation where I want to track page views, click events, etc. in a time series database but am having scalability issues in the case where I want to retrieve aggregated groups of data that ...
0
votes
1answer
133 views

How to adapt the architecture of a website and have suitable hosting along with it to meet increasing users? [closed]

Say you start a web site on shared hosting and it increases in popularity which might cause it to become unavailable as the number of accesses increases. So as a developer how do I figure out when ...
2
votes
1answer
447 views

Scaling tcp/ip socket server applications

I have been trying to understand how one would scale an application utilizing tcp/ip sockets for client server communication. For example in the simple diagram below: +------------+ | ...
4
votes
1answer
573 views

Understanding architecture of NGINX

According to this article, nginx has a master process and a number of worker processes. I'm trying to understand how a request is handled by the nginx worker processes. nginx uses an event driven ...
0
votes
1answer
52 views

Standard Patterns to measure capacity in a competing consumers system

We have a number of systems that are based on the competing consumers pattern. We currently monitor the delay between an item of work being queued and processing finishing, however, as throughput ...
1
vote
1answer
140 views

How does global load balancing work?

How does a highly scaled company serve users on the opposite end of the world? Take Facebook for example (headquartered in California). If someone hit their endpoints from a place like South Africa, ...
0
votes
0answers
129 views

Designing high concurrency sale

I am facing issue trying to design it correctly. Problem is simple- there is 1-click button to buy one type of coupon. It is single row entry in DB with 1000 as stock count. Assume QPS as 1 million ...
-1
votes
1answer
394 views

similarity measure between millions of documents [closed]

I have millions of documents(close to 100 million), each document has fields such as skills, hobbies, certification and education. I want to find similarity between each document along with a score. ...
0
votes
1answer
53 views

Binding an interface on top of third-party modules to develop future-proofed and scalable apps

Every day a couple of new javascript modules are created and published around the world and we need to think long term. Let's say today I need to use an ORM module to go smooth and fast. But tomorrow ...
-2
votes
1answer
63 views

Access Management of End User Data - End User Permission Tickets

I have been familiarizing myself with Googles Security Design Whitepaper. As far as I can understand, and with respect to a Micro-services architecture, from the Access Management of End User Data ...
5
votes
2answers
175 views

switching implementations dynamically according to execution time estimates

I have a function that I can implement in two different ways. Each way has its own advantages, and performance depends on the arguments it will be given. Since each implementation has several short ...
0
votes
0answers
48 views

Scalable and performant way to organize access to a shared resource?

Here's the thing: Imagine there is a database containing just ids from 1 to 1000 and a flag is_used for each of those. There is a service which has only two methods: getId() which finds available ...
0
votes
0answers
47 views

Deriving data from MongoDB collections that are distinct for each website

Problem I need to display different data based on some set of long lists of rules. Rules are different for each website that would use my system. Each second, I fetch an everchanging data set from a ...
1
vote
3answers
206 views

Multiple feature teams multiple products

Evening all. We currently have two feature teams, one Web one mobile. They have their own backlogs. Each have their own product manager and scrum master. Team size is 11 including scrum and product ...
3
votes
2answers
252 views

Is briefly closing a listen socket then re-opening it a horrible idea?

I'm writing an application on x86_64 CentOS 7 that functions as a server, managing potentially thousands of devices. Because my application doesn't do so well when running through the connection ...
1
vote
2answers
83 views

Scaling Out re-design approach?

My current web app provides a service to clients on a single site. It is NOT eBay, but I will explain using eBay as an analagous service we can all understand. A client sets up a page, and other peer ...
0
votes
1answer
258 views

What's the best way to do horizontally scalable file uploads?

In general, how do websites handle file uploads when they scale horizontally? Obviously if you have a load balancer going to 10 application servers, and each application server just saves an upload ...
1
vote
0answers
87 views

Scaling Systems With Shared Data

I'm working on an in memory on disk cache and am starting to think about strategies for scaling the system. At the moment the system persists data by creating a file for each key value pair, where the ...
3
votes
1answer
140 views

Approach to perform a calculation over a large dataset and calculate mean of scores

I have a table/collection called scores and it has 3 relevant identifiers based on which calculation need to be done. sample { score : Number, company : String, zone : String, unit : String, ...
1
vote
1answer
289 views

“persistence as a service”: what does that mean?

I read this in a book: Most of the time, calls to third-party products are entangled throughout the code. But if you really abstracted the idea of a database out—to the point where it simply ...
-3
votes
2answers
85 views

Managing quiz collection

I am creating a simple application where users will be shown random quizzes one at a time and they have to answer them. Each quiz has a category and many tags, right now I have stored quizzes in a ...
4
votes
0answers
5k views

System Design: Scalable Chat Server

Suppose you were asked to design a scalable chat server with the following requirements: The main use case is: player A sees B online, A sends a message to B, B receives it. The secondary use case is:...
1
vote
1answer
35 views

Using a second GAE app as backup

I have a Google App Engine app which is used by a small amount of users of a certain niche website. The app's only function is to get data about the user from that website's API, use that data to ...
28
votes
4answers
2k views

How does a company like Amazon avoid bottlenecks accessing the database layer?

If you imagine a company like Amazon (or any other large e-commerce web application), that is operating an online store at massive scale and only has limited quantity of physical items in its ...
0
votes
2answers
467 views

Scaling without queues?

Whenever I am asked how I would scale out an application I inevitably tend toward a queueing model: split the application responsibilities into individual services and add queues between those ...
0
votes
2answers
622 views

Designing Table To Store Hierarchy

I have a table Company and User like below... Company Table: CompanyID CompanyName etc... User Table: UserID Email UserType CompanyID etc... First I must tell you that, ...