Questions tagged [distributed-system]

This tag can be used by questions on distributed system concept, design, and implementations.

Filter by
Sorted by
Tagged with
4 votes
1 answer
149 views

How are application in separate data centers routed

A bit of down time at work let my mind wonder a bit. I was designing a single location application on Digital Ocean (load balancer to app servers to DB with DNS). All fine. Then I thought what if the ...
user avatar
  • 945
3 votes
2 answers
160 views

load balancing in shared nothing cluster

I have a system where the load is distributed across the nodes in the cluster and once an entity is assigned to particular node, it is taken to completion through that node only(distribution is saved ...
user avatar
1 vote
1 answer
191 views

#Apache-flink: Stream processing or Batch processing using Flink

I am tasked with redesigning an existing catalog processor and the requirement goes as below Requirement I have 5 to 10 vendors(each vendor can have multiple stores) who would provide me with 'XML' ...
user avatar
  • 19
3 votes
0 answers
84 views

Architecture and implementation of a de-centralised web service

I'm a web programmer with several years of experience in RoR and node.js. I have a project idea that is quite big and I need some input in how it can be achieved. I heard of the Diaspora project, and ...
user avatar
  • 291
-2 votes
1 answer
209 views

CAP Theorem x Load Balance / Failover x Availability

My understanding is that the system below can accomplish consistency, availability and partition tolerance. So I must be misinterpreting some aspect of the CAP theorem. How come? Let's say I have a ...
user avatar
  • 101
-1 votes
2 answers
1k views

Did I beat the CAP Theorem with this master-slaves distributed system (with picture)?

I was watching this video about the CAP theorem, where the author explains well the trade-offs of distributed systems. However I disagree with the CAP theorem in the following aspect. Given the ...
user avatar
3 votes
0 answers
714 views

Vector clock conflict resolution in event sourced system via local timestamp - is this safe?

We have an occasionally connected, event sourced system: a budgeting application where each client can pull other client's event store from a separate storage (network share, dropbox,...). It is our ...
user avatar
4 votes
2 answers
690 views

How to implement to flood fill algorithm on multiple machines?

I have a large image distributed over multiple machines for which I need to implement the flood fill algorithm used in MS Paint. I am able to do it with a single machine but what approach must be ...
user avatar
  • 139
0 votes
1 answer
116 views

Resources for availability can be used for scalability?

In his great thesis, Benjamin Erb says about scalability, reliability and availability: The essential technique for ensuring availability and reliability is redundancy and the overprovisioning of ...
user avatar
2 votes
1 answer
91 views

Mechanisms to ensure distributed systems do not sychchronize (anti-synchronize)

We have a service that based on a local timer does a GET request to our server on Azure to transmit some information to be saved on the server. At this stage we are only testing and we are finding ...
user avatar
  • 123
3 votes
1 answer
284 views

Is TCP still considered siginificant overhead compared to UDP? [closed]

I'm working on a distributed application for a graduate class I'm taking. There has been much discussion around implementing a way to maintain peer connection health statuses. Think Gossip. One of the ...
user avatar
  • 173
1 vote
1 answer
196 views

Matrix distribution to process grid

I need to write a program, which will perform LU-decomposition, etc. The problem is that I don't know about the preferred way to distribute the loaded matrix from the root process to other processes. ...
user avatar
  • 327
13 votes
2 answers
397 views

Does Optimistic Concurrency per object imply Serializability if a transaction will never span multiple objects?

Given a system which provides: Optimistic concurrency control / versioning per object (using CAS - Check-and-Set) Transactions that never need to span more then a single object. Snapshot Isolation ...
user avatar
  • 663
1 vote
1 answer
98 views

Reduce Operations on Distributed Databases

I would like to ask you about optimizing reduce operations (e.g. count) on multiple databases. Let's say there is a user table that is stored in various countries and sharding is made based on the ...
user avatar
6 votes
2 answers
3k views

How do you solve issue of consistency in concurrent and distributed application (built around Bankers Dilemma)?

This is a classic problem which I'm sure has been solved many times by many different people. I don't have any formal training (I've not studied computer science or any other such academic subject) ...
user avatar
1 vote
1 answer
282 views

Are there any serialization schemes for OOP that include methods or operations in the contract in addition to data structure?

So typically we create schemas, mime-types, etc for our objects when we're communicating to another system about objects. The document usually defines data structure of the objects for serialization ...
user avatar
  • 2,577
2 votes
2 answers
1k views

Version hash to solve Event Sourcing problems

The basic examples I have seen about Event Sourcing do not deal with out of order events, clock offsets in different systems and late events from system partitions. I am wondering if more polished ...
user avatar
3 votes
2 answers
963 views

Thinking pragmatically about scalability

I was recently asked as an exercise to design a scalable graph. My first intuition was how to seperate the graph and distribute it (sharding,consistent hashing..etc) Turns out my thinking was on ...
user avatar
  • 133

1 2 3
4