Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [scalability]

Scalability is the ability of a system, network, or process, to handle growing amount of work in a capable manner or its ability to be enlarged to accommodate that growth.

-1
votes
0answers
11 views

Circuit breakers preventing autoscaling (specifically in Kubernetes)

We are using Circuit breakers (specifically Hystrix) to protect our application when it makes calls out to external resources e.g. other services, the DB, cache etc. One side effect we have observed ...
0
votes
1answer
52 views

Design scalable solution with queue

Assuming the following scenario: A web application that receives inputs from the user and process the inputs through an algorithm which takes between 5 to 25 minutes (depending on the inputs) and ...
0
votes
0answers
31 views
+50

Sharding and application routing cross region on AWS

We current have a very simple Multi Tenant monolith, with a SQL SERVER backend (Self hosted on EC2 on AWS), and multiple application services talking to one DB behind an Classic AWS ELB. Our database ...
2
votes
4answers
127 views

User calling REST APIs on behalf of a different user

Here's an example: GET /posts POST /posts GET /posts/{post_id} PUT /posts/{post_id} This api is being used by SUPER_ADMIN as well as CONTENT_WRITERS. Its working great. If user is logged in as a ...
1
vote
0answers
21 views

User level customised activity feed design

I am working creating api for activity feed of user. Feed contains different type of entities. Before that let me give you bit overview about the app. Its a video app where Users can ask questions ...
0
votes
0answers
13 views

Grouping clients with horizontal scaling

I am creating a system which will be deployed on Kubernetes using GCP. The team working on this is really small, only two people, so we are looking for solutions that don't take forever to implement ...
13
votes
7answers
658 views

Saving high-frequency events to a connection-limit constrained database

We've got a situation where I have to deal with a massive influx of events coming in to our server, at about 1000 events per second, on average (peak could be ~2000). The problem Our system is ...
1
vote
1answer
104 views

How should we approach layered-architectures that need large amounts of continuous, real-time, communication?

Background In much of the literature I've read online with respect to multi-layered architectures, many people describe how to create the simple application where: UI presents static model objects ...
-3
votes
1answer
92 views

Shopping Cart Concurrency Question [closed]

I have a problem with my e-commerce site. There can be multiple simultaneous requests to add items in the shopping cart, I was moving towards the design where when an item is added to the shopping ...
0
votes
1answer
70 views

Guidance for Client side

We have created software for Rugged and mobile devices, and it gets deployed on the device. Admin has a provision to send an update to those devices. We use GCM or WNS for sending a notification to ...
0
votes
0answers
49 views

How to scale a group messaging system?

I am working on a group messaging system. There can be any number of users in a single group. A user can have any number of groups. It's like twitter, a user can follow any number of users and a user ...
0
votes
1answer
63 views

Co-relating messages in Kafka

Context We are building an application that acts like a hub for messages coming in from multiple Producers and it assigns to Consumers based on certain criteria. Need is to have the design highly ...
3
votes
1answer
69 views

Architecture for Large-Scale Matrix Multiplication: Distributed Architecture or One Strong Server

I've asked a question about Scaling Matrix Multiplication by CPU Cores on StackOverflow and it seems that merely adding more CPU cores to this problem won't reduce the time to do Matrix ...
0
votes
0answers
79 views

How to scale Redis pub/sub within a Docker stack, or should I decouple it?

I'm creating a simple websocket server in nodejs that uses Redis pub/sub as a messaging backplane and Mongo for some data storage. I would like to deploy this as a Docker service so we can scale it ...
2
votes
1answer
119 views

High scale architecture using Event Sourcing and Eventual Consistency

I want to share with you and know what your opinion/improvements are regarding a solution I was tasked with a technical interview I faced. The exercise: You need to create an API which will indicate ...
2
votes
1answer
44 views

Architecture and Database re-design for migration and support of multiple clients

I'm evaluating the migration of the following application's architecture: - Nginx + PHP + MySQL - Currently the infrastructure is scalable and redundant in the AWS cloud and It was designed to support ...
0
votes
1answer
71 views

Building a scalable Email Delivery system

I want to fix my current Email Delivery system which sends email using a third-party email provider and creates a record for each email sent in RDS. Functionally this is how the system behaves - A ...
0
votes
1answer
176 views

What would be the architecture for a polling-based monitoring service?

I have a list of 75000 websites that need to be monitored for uptime. Monitoring the websites involves making a HTTP request for the website every minute, and the website is said to be "up" or "down" ...
1
vote
1answer
748 views

Scalable design for a web application [closed]

My apologies if this is the wrong stack exchange site for this question. Please, let me know if I should ask this in a different place. I have recently went to a interview. The interview was for the ...
0
votes
0answers
224 views

Best design for C++boost::asio, lots of long-lasting connections, constant small messages

I'm rewriting an app that is currently written in nodejs but having scaling issues, and I know boost::asio is the proper answer. I'm just unclear which is the best pattern to use. Full duplex server, ...
0
votes
0answers
39 views

Recommended use of Azure managed services in custom event Notification system design

Upon analysis of an event processing system my team is working on I noticed usage of managed Azure services that I haven't seen before. In a nutshell what the system is doing is processing incoming ...
0
votes
1answer
94 views

scalable communication system

I am designing communication system that will be sending targeted based SMS (ads/offers) to its customer. The basic system with low load scenario works well, and the SMS sent are based on an event ...
0
votes
2answers
675 views

Best way to design file storage for image processing system

Would appreciate any recommendations regarding design a high-load image processing service. There are lots (tens of hundreds of relatively large images (~10...20 Mb each)) that to be processed using ...
3
votes
2answers
471 views

What time series database can support high cardinality?

I have a situation where I want to track page views, click events, etc. in a time series database but am having scalability issues in the case where I want to retrieve aggregated groups of data that ...
0
votes
1answer
133 views

How to adapt the architecture of a website and have suitable hosting along with it to meet increasing users? [closed]

Say you start a web site on shared hosting and it increases in popularity which might cause it to become unavailable as the number of accesses increases. So as a developer how do I figure out when ...
2
votes
1answer
396 views

Scaling tcp/ip socket server applications

I have been trying to understand how one would scale an application utilizing tcp/ip sockets for client server communication. For example in the simple diagram below: +------------+ | ...
4
votes
1answer
481 views

Understanding architecture of NGINX

According to this article, nginx has a master process and a number of worker processes. I'm trying to understand how a request is handled by the nginx worker processes. nginx uses an event driven ...
0
votes
1answer
50 views

Standard Patterns to measure capacity in a competing consumers system

We have a number of systems that are based on the competing consumers pattern. We currently monitor the delay between an item of work being queued and processing finishing, however, as throughput ...
1
vote
1answer
137 views

How does global load balancing work?

How does a highly scaled company serve users on the opposite end of the world? Take Facebook for example (headquartered in California). If someone hit their endpoints from a place like South Africa, ...
0
votes
0answers
117 views

Designing high concurrency sale

I am facing issue trying to design it correctly. Problem is simple- there is 1-click button to buy one type of coupon. It is single row entry in DB with 1000 as stock count. Assume QPS as 1 million ...
-1
votes
1answer
367 views

similarity measure between millions of documents [closed]

I have millions of documents(close to 100 million), each document has fields such as skills, hobbies, certification and education. I want to find similarity between each document along with a score. ...
0
votes
1answer
52 views

Binding an interface on top of third-party modules to develop future-proofed and scalable apps

Every day a couple of new javascript modules are created and published around the world and we need to think long term. Let's say today I need to use an ORM module to go smooth and fast. But tomorrow ...
-2
votes
1answer
56 views

Access Management of End User Data - End User Permission Tickets

I have been familiarizing myself with Googles Security Design Whitepaper. As far as I can understand, and with respect to a Micro-services architecture, from the Access Management of End User Data ...
5
votes
2answers
175 views

switching implementations dynamically according to execution time estimates

I have a function that I can implement in two different ways. Each way has its own advantages, and performance depends on the arguments it will be given. Since each implementation has several short ...
0
votes
0answers
48 views

Scalable and performant way to organize access to a shared resource?

Here's the thing: Imagine there is a database containing just ids from 1 to 1000 and a flag is_used for each of those. There is a service which has only two methods: getId() which finds available ...
0
votes
0answers
46 views

Deriving data from MongoDB collections that are distinct for each website

Problem I need to display different data based on some set of long lists of rules. Rules are different for each website that would use my system. Each second, I fetch an everchanging data set from a ...
1
vote
3answers
185 views

Multiple feature teams multiple products

Evening all. We currently have two feature teams, one Web one mobile. They have their own backlogs. Each have their own product manager and scrum master. Team size is 11 including scrum and product ...
3
votes
2answers
242 views

Is briefly closing a listen socket then re-opening it a horrible idea?

I'm writing an application on x86_64 CentOS 7 that functions as a server, managing potentially thousands of devices. Because my application doesn't do so well when running through the connection ...
1
vote
2answers
81 views

Scaling Out re-design approach?

My current web app provides a service to clients on a single site. It is NOT eBay, but I will explain using eBay as an analagous service we can all understand. A client sets up a page, and other peer ...
0
votes
1answer
234 views

What's the best way to do horizontally scalable file uploads?

In general, how do websites handle file uploads when they scale horizontally? Obviously if you have a load balancer going to 10 application servers, and each application server just saves an upload ...
1
vote
0answers
86 views

Scaling Systems With Shared Data

I'm working on an in memory on disk cache and am starting to think about strategies for scaling the system. At the moment the system persists data by creating a file for each key value pair, where the ...
3
votes
1answer
139 views

Approach to perform a calculation over a large dataset and calculate mean of scores

I have a table/collection called scores and it has 3 relevant identifiers based on which calculation need to be done. sample { score : Number, company : String, zone : String, unit : String, ...
1
vote
1answer
277 views

“persistence as a service”: what does that mean?

I read this in a book: Most of the time, calls to third-party products are entangled throughout the code. But if you really abstracted the idea of a database out—to the point where it simply ...
-3
votes
2answers
85 views

Managing quiz collection

I am creating a simple application where users will be shown random quizzes one at a time and they have to answer them. Each quiz has a category and many tags, right now I have stored quizzes in a ...
4
votes
0answers
5k views

System Design: Scalable Chat Server

Suppose you were asked to design a scalable chat server with the following requirements: The main use case is: player A sees B online, A sends a message to B, B receives it. The secondary use case is:...
1
vote
1answer
34 views

Using a second GAE app as backup

I have a Google App Engine app which is used by a small amount of users of a certain niche website. The app's only function is to get data about the user from that website's API, use that data to ...
28
votes
4answers
2k views

How does a company like Amazon avoid bottlenecks accessing the database layer?

If you imagine a company like Amazon (or any other large e-commerce web application), that is operating an online store at massive scale and only has limited quantity of physical items in its ...
0
votes
2answers
447 views

Scaling without queues?

Whenever I am asked how I would scale out an application I inevitably tend toward a queueing model: split the application responsibilities into individual services and add queues between those ...
0
votes
2answers
571 views

Designing Table To Store Hierarchy

I have a table Company and User like below... Company Table: CompanyID CompanyName etc... User Table: UserID Email UserType CompanyID etc... First I must tell you that, ...
6
votes
2answers
849 views

How to scale microservices in DDD world?

I am interested what would be the ideal way to scale Microservices in DDD world? In case of the following scenario, where Sales context is hosted as a microservice on a different host then Support ...