Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange
Join us in building a kind, collaborative learning community via our updated Code of Conduct.

The tag has no usage guidance.

2
votes
1answer
56 views

Race conditions in client synchronization

I have a web app whose server creates a Client for each websocket connection. A Client acts as an intermediary between the websocket connection and a single instance of a Hub. The Hub maintains a set ...
0
votes
2answers
97 views

Keep channels online, even though underlying systems are offline?

We have six very old systems where the newest one is built 1995. All these systems have batch jobs running from midnight to 6 AM every night, and these systems are offline. On top of these six systems ...
0
votes
0answers
25 views

How to architect priority ordered processing between two apps with multiple threads producing/consuming requests?

Apologies if the title of the question is bit misleading. I have two apps X and Y both implemented in java. App X runs in apache servicemix container and Y is web-app running in jee app server (often ...
1
vote
2answers
80 views

How to implement online/offline data synchronisation?

I want to create a desktop application. The application must be able to accept database transactions even if internet connection is lost, but as soon as internet connection is available the ...
0
votes
1answer
104 views

How to resolve data-binding efficiently

Following this question, the solution to resolve data binding is to use DFS and Topological Sorting. I am not really sure exactly what that means. Here is an animation that roughly demonstrates what I ...
0
votes
2answers
77 views

Struggling with implementing synchronization or concurrency

In my app two components A and B, have their data and state based on the data and state of a 3rd component, component C: Both A and B can change the data of component C. Both A and B listen to ...
1
vote
1answer
71 views

How to sync data between two detached systems using rest API?

I own system A, and other entity owns system B. I need to sync system B, based on changes that took place in system A. Data being synced would be spitted into different sets, so I dont have to sync ...
6
votes
4answers
339 views

What are some approaches used in financial applications to prevent deposit/withdrawal sync problems?

I am currently facing a problem with an application that has deposit/withdraw functionality. The underlying database (Cassandra) offers no read/write locks. Now suppose user A has deposited 100$...
2
votes
0answers
168 views

File upload sync for offline desktop application. (Electron)

We are making an offline desktop application in Electron that needs to sync when the user goes online. Sqlite is used as the database when offline and it gets synced to postgres on the server when ...
1
vote
1answer
309 views

Using inner classes to achieve thread-safe behavior without synchronization

I have some classes that contains both immutable (primitive & references) and mutable data, but mutability come from external writes (another process). To avoid using synchronized on every ...
6
votes
2answers
97 views

Are there any techniques for detecting redundancies a stream of changes to a filesystem?

I'm working on a file-synchronization client that currently produces a stream of changes to the underlying filesystem. That is a stream of create/update/move/delete events is produced for each ...
4
votes
2answers
399 views

Design for client-server synchronisation

Background I am working on improving the backend design for a video game. The game is live and working fine, but we want to improve various things. As a video game studio, we often do events which ...
0
votes
0answers
32 views

Adaptive Playout Buffer handling network fluctuations?

I am creating a multiplayer game with Unity/C#, and have made a system which revolves around a PlayoutBuffer class. Player inputs and object corrections are sent via reliable UDP through a Client-...
0
votes
0answers
42 views

Decoupled database synchronization

I have a database server in a network that is not connected to the internet. I need to feed it data from a database that is, and also export some data back out to the online database server. The data ...
4
votes
7answers
425 views

Sync one thousand vector3 across network with minimal bytes?

I am making a game with Unity, and am having problems attempting network synchronisation. Deterministic simulation is impossible because Unity's internal logic is float based. I am trying to make a ...
0
votes
2answers
170 views

State ownership cover everything for a class to be thread safe

As mentioned by Java_author, When defining which variables form an object's state, we want to consider only the data that object owns.... In many case, ownership and encapsulation go together—...
3
votes
1answer
399 views

Design for syncing data from remote API

I am trying to find a robust and correct solution for syncing data from different sources to my local relational database. I have different sources of data for eg: CSV, REST API and probably network ...
2
votes
2answers
259 views

Best practice to keep different data sources in sync?

I'm having doubts about how to implement and keep synchronization between two datasources in a distributed system. In my case, I have a service that checks for expired jobs in a repository. If the job ...
0
votes
2answers
548 views

Threads - When to use barrier?

Using python syntax, threading.Barrier(NUM_THREADS) establishes a control point and all participating threads block until all of the participating “parties” have reached that point. It lets threads ...
3
votes
1answer
844 views

Architecture for real-time application, avoiding duplicate messages for queues with no active consumers

I am designing the architecture of an application which has your typical backend and frontend components. The frontend application must be semi real-time. For this requirement, the backend is pushing ...
0
votes
0answers
287 views

Web interface on top of an ERP system

We are currently running an ERP system which has its own client, which is a desktop application. The server is hosted on premise and all the data is in an SQL database. This is all windows based. We ...
1
vote
1answer
60 views

Designing a mechanism to synchronize states with commands despite timing / network inconsistencies

I have two browser clients: A and B. They communicate through a signalling server Server. A has a clientside heartbeat that signals its ClientState to other clients. ClientState can be one of the ...
3
votes
0answers
114 views

Some “intent”-related questions vis-à-vis Operational Transformation and CRDTs

I’m a little unclear on some questions relating to the "intent" part of concurrent collaboration algorithms (operational transformation and conflict-free replicated data types). Please help! Strings ...
1
vote
3answers
127 views

How can I wait on multiple processes across users?

I have some code in process A that needs to wait until work completes in other processes that can be running simultaneously under multiple users. I'm uncertain what is the appropriate ...
1
vote
1answer
680 views

Keeping data between two databases in sync

Let's say I have a forum application running, and I start building a separate web application with a Python web framework. Both applications use their own MySQL databases, which contain their own ...
4
votes
1answer
3k views

How to perform a 2 way sync from many client applications to central server?

I have many client applications that sync up to a central server. I am using C#, MS SQL server, Win Forms, ASP.NET MVC + API. I need to learn/figure out how to perform a 2 way sync for data changes ...
6
votes
2answers
4k views

What's the best implementation for offline mobile app synchronization?

We have an Android app written as a Cordova AngularJS SPA which has now grown so that we need to add some work to it meaning we have to improve the synchronization part of the app. The app is mainly ...
0
votes
0answers
68 views

Bidirectional Synchronization

I'm developing a Gradle plugin for Oracle Forms that can convert the source files back and forth between the traditional binary format for use in the Forms Developer IDE and a XML format to allow us ...
1
vote
1answer
50 views

Synchronize a Device without Directly Setting Date/Time?

Setup: I have a number of biometric devices, each of which records 24hr-48hr chunks of data that need to be correctly time-stamped with start date of each recording. Each device needs to be connected ...
1
vote
1answer
829 views

How to implement ETL with MySQL?

I have a legacy MySQL Database (A), and a new reviewed structure for MySQL data base (B). Problem number one is that Database has to be alive and keeps receiving data from legacy apps. What I need is ...
4
votes
1answer
97 views

Why does a process set its turn to the other process in Peterson's solution for synchronization?

From Operating System Concepts by Abraham Silberschatz, Peter B. Galvin, Greg Gagne, Peterson's solution to the critical-section problem has two processes Pi and Pj, do { flag[i] = true; turn ...
3
votes
1answer
2k views

Implement a monitor in terms of semaphores

From Operating System Concepts by Abraham Silberschatz, Peter B. Galvin, Greg Gagne 5.8.3 Implementing a Monitor Using Semaphores We now consider a possible implementation of the monitor ...
3
votes
1answer
1k views

Producer/consumer problem with 2 mutexes?

The setup Let us consider a variant of the classical multithreaded programming problem: the producer/consumer problem. We have some finite number of resources (for simplicity, let there be just a ...
1
vote
1answer
1k views

Two way data synchronization between web application and REST API server

I have a web application and a REST API server (Microsoft Dynamics CRM 2016) that I don't have access to it's code, but I have access to the available resources. I need to create a data sync between ...
0
votes
1answer
138 views

How to play audio samples while generating them

I am trying to write a simple live sine wave generator from scratch in Qt. I try not to use any external APIs like ASIO or VST. And I want to generate new audio while playing. (As opposed to the Qt ...
4
votes
2answers
673 views

Bi-directional sync of 2 different APIs

I'm currently assigned a task, where I have to program a bidirectional synchronisation between 2 ERP-related software, one providing webservices (Visual Studio Web Reference) and the other one ...
0
votes
1answer
451 views

Android Activitiy and Service Sync

I've looked for the solution of my problem but I've failed in finding a suitable answer. I've been trying to develop an Android application with heavy asyncronous networking capabilities. The problem ...
0
votes
1answer
47 views

How Do DB Version Control Systems Lack in Script Semantics When Modeled on Source/Target Difference Comparisons

There are several database version control solutions out there to assist with controlling not only the versioning of a database, but also deploying and synchronizing databases. These systems are ...
1
vote
0answers
365 views

Vector clock conflict resolution in event sourced system via local timestamp - is this safe?

We have an occasionally connected, event sourced system: a budgeting application where each client can pull other client's event store from a separate storage (network share, dropbox,...). It is our ...
1
vote
1answer
486 views

Web service + sync database + main application architecture

I got to develop a web service that will help synchronize some of our data with APIs from Google, as well other services in the future. I thought, and my boss too, we should go for a stand alone web ...
2
votes
1answer
2k views

How to synchronize data between two web services

I'm currently working on a project consisting of two different web applications. One of the applications is a PHP web server with a website front-end and a MySQL database. It consists of Laravel ...
2
votes
3answers
265 views

Data from devices with unreliable clocks

Are there any viable approaches to dealing with data coming from devices with unreliable clocks? We have a database system running on a central server. The latest addition to the system is a bunch of ...
1
vote
1answer
167 views

Terminology for partial offline database synchronization

I am looking for solutions for a field where I think I don't know the adequate terminology. The problem is that I have a central SQL database in the cloud. Then I have child databases only containing ...
3
votes
2answers
1k views

Technique to sync medium/large amounts of data

I implemented sync for my app (with a REST backend), it works well but there are some problems: Blocks - Since I don't want to overwrite possible inputs of the user during sync, I block the UI (...
5
votes
1answer
526 views

Android: Design for fetching update/syncing from server

I'm building a meeting app where users can create, join (by invite), and edit events like meetings, outings etc. Think What's app chat groups. So I'm looking into designing how the android app would ...
3
votes
2answers
92 views

How do you address the problem of dealing with an external service that stores your data and you want to keep in sync?

I'm integrating an enterprise application with an existing pattern. The main problem is how to synchronize data between my system and an external system through RPC (HTTP API calls to be precise). ...
9
votes
2answers
1k views

Synchronisation with offline system

I'm designing a system from which I will synchronise business data from the mobile device (that have an embedded application) that generates data and sends it back to the server. Each line ...
1
vote
1answer
69 views

Process synchronization over Internet

I'm trying to create an IOT hub that can be controlled locally (Intranet) or from Internet. The problem I'm facing is of state synchronization. The following points depict what's happening at my local ...
0
votes
0answers
46 views

What does synchronous communication with an application mean?

An example of documentation: To set up synchronous communication with Google Play What does synchronous communication means here? Synchronous to what? And what would asynchronous communication ...
2
votes
1answer
137 views

Remote job execution and synchronization

I have master and nodes infrastructure. Master executes remote jobs on nodes. Each job returns success/failure message back to master. So the flow of execution is the following: master receives ...