Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange
Join us in building a kind, collaborative learning community via our updated Code of Conduct.

Scalability is the ability of a system, network, or process, to handle growing amount of work in a capable manner or its ability to be enlarged to accommodate that growth.

0
votes
0answers
42 views

How to scale a group messaging system?

I am working on a group messaging system. There can be any number of users in a single group. A user can have any number of groups. It's like twitter, a user can follow any number of users and a user ...
0
votes
1answer
56 views

Co-relating messages in Kafka

Context We are building an application that acts like a hub for messages coming in from multiple Producers and it assigns to Consumers based on certain criteria. Need is to have the design highly ...
1
vote
0answers
33 views

Architecture for Large-Scale Matrix Multiplication: Distributed Architecture or One Strong Server

I've asked a question about Scaling Matrix Multiplication by CPU Cores on StackOverflow and it seems that merely adding more CPU cores to this problem won't reduce the time to do Matrix ...
0
votes
0answers
38 views

How to scale Redis pub/sub within a Docker stack, or should I decouple it?

I'm creating a simple websocket server in nodejs that uses Redis pub/sub as a messaging backplane and Mongo for some data storage. I would like to deploy this as a Docker service so we can scale it ...
2
votes
1answer
105 views

High scale architecture using Event Sourcing and Eventual Consistency

I want to share with you and know what your opinion/improvements are regarding a solution I was tasked with a technical interview I faced. The exercise: You need to create an API which will indicate ...
2
votes
1answer
39 views

Architecture and Database re-design for migration and support of multiple clients

I'm evaluating the migration of the following application's architecture: - Nginx + PHP + MySQL - Currently the infrastructure is scalable and redundant in the AWS cloud and It was designed to support ...
0
votes
1answer
67 views

Building a scalable Email Delivery system

I want to fix my current Email Delivery system which sends email using a third-party email provider and creates a record for each email sent in RDS. Functionally this is how the system behaves - A ...
0
votes
1answer
144 views

What would be the architecture for a polling-based monitoring service?

I have a list of 75000 websites that need to be monitored for uptime. Monitoring the websites involves making a HTTP request for the website every minute, and the website is said to be "up" or "down" ...
1
vote
1answer
551 views

Scalable design for a web application [closed]

My apologies if this is the wrong stack exchange site for this question. Please, let me know if I should ask this in a different place. I have recently went to a interview. The interview was for the ...
0
votes
0answers
201 views

Best design for C++boost::asio, lots of long-lasting connections, constant small messages

I'm rewriting an app that is currently written in nodejs but having scaling issues, and I know boost::asio is the proper answer. I'm just unclear which is the best pattern to use. Full duplex server, ...
0
votes
0answers
39 views

Recommended use of Azure managed services in custom event Notification system design

Upon analysis of an event processing system my team is working on I noticed usage of managed Azure services that I haven't seen before. In a nutshell what the system is doing is processing incoming ...
0
votes
1answer
93 views

scalable communication system

I am designing communication system that will be sending targeted based SMS (ads/offers) to its customer. The basic system with low load scenario works well, and the SMS sent are based on an event ...
0
votes
2answers
524 views

Best way to design file storage for image processing system

Would appreciate any recommendations regarding design a high-load image processing service. There are lots (tens of hundreds of relatively large images (~10...20 Mb each)) that to be processed using ...
3
votes
2answers
397 views

What time series database can support high cardinality?

I have a situation where I want to track page views, click events, etc. in a time series database but am having scalability issues in the case where I want to retrieve aggregated groups of data that ...
0
votes
1answer
133 views

How to adapt the architecture of a website and have suitable hosting along with it to meet increasing users? [closed]

Say you start a web site on shared hosting and it increases in popularity which might cause it to become unavailable as the number of accesses increases. So as a developer how do I figure out when ...
2
votes
1answer
303 views

Scaling tcp/ip socket server applications

I have been trying to understand how one would scale an application utilizing tcp/ip sockets for client server communication. For example in the simple diagram below: +------------+ | ...
3
votes
1answer
391 views

Understanding architecture of NGINX

According to this article, nginx has a master process and a number of worker processes. I'm trying to understand how a request is handled by the nginx worker processes. nginx uses an event driven ...
0
votes
1answer
49 views

Standard Patterns to measure capacity in a competing consumers system

We have a number of systems that are based on the competing consumers pattern. We currently monitor the delay between an item of work being queued and processing finishing, however, as throughput ...
1
vote
1answer
132 views

How does global load balancing work?

How does a highly scaled company serve users on the opposite end of the world? Take Facebook for example (headquartered in California). If someone hit their endpoints from a place like South Africa, ...
0
votes
0answers
105 views

Designing high concurrency sale

I am facing issue trying to design it correctly. Problem is simple- there is 1-click button to buy one type of coupon. It is single row entry in DB with 1000 as stock count. Assume QPS as 1 million ...
-2
votes
1answer
306 views

similarity measure between millions of documents [closed]

I have millions of documents(close to 100 million), each document has fields such as skills, hobbies, certification and education. I want to find similarity between each document along with a score. ...
0
votes
1answer
52 views

Binding an interface on top of third-party modules to develop future-proofed and scalable apps

Every day a couple of new javascript modules are created and published around the world and we need to think long term. Let's say today I need to use an ORM module to go smooth and fast. But tomorrow ...
-2
votes
1answer
51 views

Access Management of End User Data - End User Permission Tickets

I have been familiarizing myself with Googles Security Design Whitepaper. As far as I can understand, and with respect to a Micro-services architecture, from the Access Management of End User Data ...
5
votes
2answers
175 views

switching implementations dynamically according to execution time estimates

I have a function that I can implement in two different ways. Each way has its own advantages, and performance depends on the arguments it will be given. Since each implementation has several short ...
0
votes
0answers
48 views

Scalable and performant way to organize access to a shared resource?

Here's the thing: Imagine there is a database containing just ids from 1 to 1000 and a flag is_used for each of those. There is a service which has only two methods: getId() which finds available ...
0
votes
0answers
39 views

Deriving data from MongoDB collections that are distinct for each website

Problem I need to display different data based on some set of long lists of rules. Rules are different for each website that would use my system. Each second, I fetch an everchanging data set from a ...
1
vote
3answers
161 views

Multiple feature teams multiple products

Evening all. We currently have two feature teams, one Web one mobile. They have their own backlogs. Each have their own product manager and scrum master. Team size is 11 including scrum and product ...
3
votes
2answers
234 views

Is briefly closing a listen socket then re-opening it a horrible idea?

I'm writing an application on x86_64 CentOS 7 that functions as a server, managing potentially thousands of devices. Because my application doesn't do so well when running through the connection ...
1
vote
2answers
78 views

Scaling Out re-design approach?

My current web app provides a service to clients on a single site. It is NOT eBay, but I will explain using eBay as an analagous service we can all understand. A client sets up a page, and other peer ...
0
votes
1answer
196 views

What's the best way to do horizontally scalable file uploads?

In general, how do websites handle file uploads when they scale horizontally? Obviously if you have a load balancer going to 10 application servers, and each application server just saves an upload ...
1
vote
0answers
82 views

Scaling Systems With Shared Data

I'm working on an in memory on disk cache and am starting to think about strategies for scaling the system. At the moment the system persists data by creating a file for each key value pair, where the ...
3
votes
1answer
137 views

Approach to perform a calculation over a large dataset and calculate mean of scores

I have a table/collection called scores and it has 3 relevant identifiers based on which calculation need to be done. sample { score : Number, company : String, zone : String, unit : String, ...
1
vote
1answer
262 views

“persistence as a service”: what does that mean?

I read this in a book: Most of the time, calls to third-party products are entangled throughout the code. But if you really abstracted the idea of a database out—to the point where it simply ...
-3
votes
2answers
85 views

Managing quiz collection

I am creating a simple application where users will be shown random quizzes one at a time and they have to answer them. Each quiz has a category and many tags, right now I have stored quizzes in a ...
4
votes
0answers
4k views

System Design: Scalable Chat Server

Suppose you were asked to design a scalable chat server with the following requirements: The main use case is: player A sees B online, A sends a message to B, B receives it. The secondary use case is:...
1
vote
1answer
34 views

Using a second GAE app as backup

I have a Google App Engine app which is used by a small amount of users of a certain niche website. The app's only function is to get data about the user from that website's API, use that data to ...
28
votes
4answers
2k views

How does a company like Amazon avoid bottlenecks accessing the database layer?

If you imagine a company like Amazon (or any other large e-commerce web application), that is operating an online store at massive scale and only has limited quantity of physical items in its ...
0
votes
2answers
421 views

Scaling without queues?

Whenever I am asked how I would scale out an application I inevitably tend toward a queueing model: split the application responsibilities into individual services and add queues between those ...
0
votes
2answers
503 views

Designing Table To Store Hierarchy

I have a table Company and User like below... Company Table: CompanyID CompanyName etc... User Table: UserID Email UserType CompanyID etc... First I must tell you that, ...
6
votes
2answers
809 views

How to scale microservices in DDD world?

I am interested what would be the ideal way to scale Microservices in DDD world? In case of the following scenario, where Sales context is hosted as a microservice on a different host then Support ...
1
vote
2answers
126 views

How can I maintain a database record of an entity that belongs to several categories of another entity, per year, per season, etc

I am building a kind of School Management System. I want to be managing the database records of things like assessment, term/season, academic years. every info must belong to a particular academic ...
2
votes
0answers
121 views

How to scale a slackbot app

I'm building an app for slack. While I've completed the POC, and everything works well for a single instance of the app, I'm having an issue of wrapping my mind around the scaling of it. The specific ...
-1
votes
1answer
144 views

Sql vs nosql important data [closed]

In one of youtubes videos about scalling web sites I found the statement that, however, in term of scallability, noSql is easier and more flexible, though it is better to use SQL for data important ...
0
votes
1answer
88 views

Resources for availability can be used for scalability?

In his great thesis, Benjamin Erb says about scalability, reliability and availability: The essential technique for ensuring availability and reliability is redundancy and the overprovisioning of ...
0
votes
1answer
123 views

VMs are not created on the same physical server to balance load?

When load reaches a certain level in IaaS environemnt, new VM instances are created to reduce load (scalability). My Questions that these VMs are not created on the same physical server, right? I ...
2
votes
2answers
2k views

Scaling a Restful Web Service Hosted in Server

We have deployed a restful web service on a application server (Apache). The volume is getting higher and we do want to scale it. We will deploy two more Apache instances on two more machines. How do ...
2
votes
1answer
2k views

Scaling websocket client connections (not server) to multiple servers

I wrote a Slack bot which must connect to Slack teams through websocket connections. Since the bot might be used by thousands of team, I will eventually need to distribute the teams across multiple ...
3
votes
1answer
910 views

What is the best way to horizontally scale .Net back-end applications?

Given a workload with many long running CPU/IO intensive operations (e.g. producing multi-GB text files from database reads and business rules), what is the best way to balance .net application load ...
2
votes
1answer
776 views

How do you calculate affinity in Edge Rank/Activity Streams

I have been researching how to build a newsfeed that sorts the order by relevancy. I have been following along Facebook's Edge Rank and Etsy's Activity Feed Architecture and I can't figure out how ...
4
votes
0answers
476 views

RDBMS v/s NoSQL for analytics [closed]

While reading about this topic online I have found out that, in general, RDBMS are good for read heavy loads and NoSQL databases are good for write heavy workloads. This statement also seemed true ...