Questions tagged [synchronization]
The synchronization tag has no usage guidance.
4
votes
2answers
296 views
Synchronization of data across microservices
We have 2 to 3 dozen microservices that serve our customers.
These services are deployed in a Kubernetes cluster, and they're only accessible to the outside world through 3 or 4 API gateways.
We ...
2
votes
1answer
87 views
Generic way to describe data synchronization between systems?
Is there a generic way (useful formalisms) to think about data synchronization between two systems, especially in the case of slightly asymmetric roles (eg, one system contain master data, another one ...
0
votes
3answers
79 views
What are criteria for enterprise to have multiple databases (for new project)?
We are working on new enterprise project (multiple activities - online ordering, offline ordering, b2b ordering, accounting processing, secure payment processing, analysis and dynamic pricing and so ...
0
votes
1answer
95 views
Synchronize multiples REST api, centralized into 1 web application
I am developing a web application for a client, connected to 4 differents sources :
E-commerce website
CRM
Emailing platform
Surveys platform
All the sources have REST Api's.
The web application ...
0
votes
1answer
34 views
How state updates to existing instances/sessions are generally done?
This is a very broad question, but maybe someone has a worthwhile response.
There is a general synchronization issue that often has to be solved, but always seems to be difficult. Here's an example:
...
-1
votes
1answer
92 views
Synchronization method vs private final object for locking in java
Can anyone tell me which one is better approach between synchronization method and private final object in java and why ??
public class kclass {
private final Object myObject = new Object();
...
1
vote
0answers
22 views
Client synchronization of authentication tokens in parallel connections
In my app server's authentication implementation, an authentication token is generated for every user that has logged in. According to some highly recommended security tips (Implementing Secure User ...
2
votes
1answer
115 views
Best practices for app-cloud synchronization of database representation
I'm planning a cookbook-like Android app that would let users store/add/edit their e-juice recipes, keep track of the ingredients, etc. Internally, I'll be storing the data in a database on the user's ...
1
vote
0answers
52 views
2 way synchronization with multiple client version
I have a project consisting of both a local and a remote system.
The database between the local and remote system needs to perform 2 way syncing. I know this can be achieved by using a 2-way syncing ...
2
votes
1answer
93 views
Race conditions in client synchronization
I have a web app whose server creates a Client for each websocket connection. A Client acts as an intermediary between the websocket connection and a single instance of a Hub. The Hub maintains a set ...
0
votes
2answers
108 views
Keep channels online, even though underlying systems are offline?
We have six very old systems where the newest one is built 1995. All these systems have batch jobs running from midnight to 6 AM every night, and these systems are offline. On top of these six systems ...
1
vote
2answers
128 views
How to implement online/offline data synchronisation?
I want to create a desktop application.
The application must be able to accept database transactions even if internet connection is lost, but as soon as internet connection is available the ...
0
votes
1answer
122 views
How to resolve data-binding efficiently
Following this question, the solution to resolve data binding is to use DFS and Topological Sorting. I am not really sure exactly what that means. Here is an animation that roughly demonstrates what I ...
0
votes
2answers
102 views
Struggling with implementing synchronization or concurrency
In my app two components A and B, have their data and state based on the data and state of a 3rd component, component C:
Both A and B can change the data of component C.
Both A and B listen to ...
1
vote
1answer
256 views
How to sync data between two detached systems using rest API?
I own system A, and other entity owns system B. I need to sync system B, based on changes that took place in system A. Data being synced would be spitted into different sets, so I dont have to sync ...
6
votes
4answers
363 views
What are some approaches used in financial applications to prevent deposit/withdrawal sync problems?
I am currently facing a problem with an application that has deposit/withdraw functionality.
The underlying database (Cassandra) offers no read/write locks.
Now suppose user A has deposited 100$...
2
votes
0answers
322 views
File upload sync for offline desktop application. (Electron)
We are making an offline desktop application in Electron that needs to sync when the user goes online.
Sqlite is used as the database when offline and it gets synced to postgres on the server when ...
1
vote
1answer
633 views
Using inner classes to achieve thread-safe behavior without synchronization
I have some classes that contains both immutable (primitive & references) and mutable data, but mutability come from external writes (another process).
To avoid using synchronized on every ...
6
votes
2answers
101 views
Are there any techniques for detecting redundancies a stream of changes to a filesystem?
I'm working on a file-synchronization client that currently produces a stream of changes to the underlying filesystem. That is a stream of create/update/move/delete events is produced for each ...
4
votes
2answers
744 views
Design for client-server synchronisation
Background
I am working on improving the backend design for a video game. The game is live and working fine, but we want to improve various things. As a video game studio, we often do events which ...
4
votes
7answers
569 views
Sync one thousand vector3 across network with minimal bytes?
I am making a game with Unity, and am having problems attempting network synchronisation. Deterministic simulation is impossible because Unity's internal logic is float based. I am trying to make a ...
0
votes
2answers
212 views
State ownership cover everything for a class to be thread safe
As mentioned by Java_author,
When defining which variables form an object's state, we want to consider only the data that object owns....
In many case, ownership and encapsulation go together—...
3
votes
1answer
650 views
Design for syncing data from remote API
I am trying to find a robust and correct solution for syncing data from different sources to my local relational database.
I have different sources of data for eg: CSV, REST API and probably network ...
2
votes
2answers
717 views
Best practice to keep different data sources in sync?
I'm having doubts about how to implement and keep synchronization between two datasources in a distributed system. In my case, I have a service that checks for expired jobs in a repository. If the job ...
0
votes
2answers
865 views
Threads - When to use barrier?
Using python syntax,
threading.Barrier(NUM_THREADS) establishes a control point and all participating threads block until all of the participating “parties” have reached that point. It lets threads ...
3
votes
1answer
1k views
Architecture for real-time application, avoiding duplicate messages for queues with no active consumers
I am designing the architecture of an application which has your typical backend and frontend components. The frontend application must be semi real-time. For this requirement, the backend is pushing ...
1
vote
1answer
61 views
Designing a mechanism to synchronize states with commands despite timing / network inconsistencies
I have two browser clients: A and B. They communicate through a signalling server Server.
A has a clientside heartbeat that signals its ClientState to other clients. ClientState can be one of the ...
3
votes
0answers
126 views
Some “intent”-related questions vis-à-vis Operational Transformation and CRDTs
I’m a little unclear on some questions relating to the "intent" part of concurrent collaboration algorithms (operational transformation and conflict-free replicated data types). Please help!
Strings ...
1
vote
3answers
241 views
How can I wait on multiple processes across users?
I have some code in process A that needs to wait until work completes in other processes that can be running simultaneously under multiple users.
I'm uncertain what is the appropriate ...
3
votes
1answer
988 views
Keeping data between two databases in sync
Let's say I have a forum application running, and I start building a separate web application with a Python web framework. Both applications use their own MySQL databases, which contain their own ...
3
votes
1answer
5k views
How to perform a 2 way sync from many client applications to central server?
I have many client applications that sync up to a central server.
I am using C#, MS SQL server, Win Forms, ASP.NET MVC + API.
I need to learn/figure out how to perform a 2 way sync for data changes ...
6
votes
2answers
5k views
What's the best implementation for offline mobile app synchronization?
We have an Android app written as a Cordova AngularJS SPA which has now grown so that we need to add some work to it meaning we have to improve the synchronization part of the app. The app is mainly ...
1
vote
1answer
51 views
Synchronize a Device without Directly Setting Date/Time?
Setup: I have a number of biometric devices, each of which records 24hr-48hr chunks of data that need to be correctly time-stamped with start date of each recording. Each device needs to be connected ...
1
vote
1answer
1k views
How to implement ETL with MySQL?
I have a legacy MySQL Database (A), and a new reviewed structure for MySQL data base (B).
Problem number one is that Database has to be alive and keeps receiving data from legacy apps.
What I need is ...
4
votes
1answer
203 views
Why does a process set its turn to the other process in Peterson's solution for synchronization?
From Operating System Concepts by Abraham Silberschatz, Peter B. Galvin, Greg Gagne, Peterson's solution to the critical-section problem has two processes Pi and Pj,
do {
flag[i] = true;
turn ...
4
votes
1answer
4k views
Implement a monitor in terms of semaphores
From Operating System Concepts by Abraham Silberschatz, Peter B. Galvin, Greg Gagne
5.8.3 Implementing a Monitor Using Semaphores
We now consider a possible implementation of the monitor ...
2
votes
1answer
2k views
Producer/consumer problem with 2 mutexes?
The setup
Let us consider a variant of the classical multithreaded programming problem: the producer/consumer problem. We have some finite number of resources (for simplicity, let there be just a ...
1
vote
1answer
2k views
Two way data synchronization between web application and REST API server
I have a web application and a REST API server (Microsoft Dynamics CRM 2016) that I don't have access to it's code, but I have access to the available resources. I need to create a data sync between ...
0
votes
1answer
142 views
How to play audio samples while generating them
I am trying to write a simple live sine wave generator from scratch in Qt.
I try not to use any external APIs like ASIO or VST. And I want to generate new audio while playing. (As opposed to the Qt ...
4
votes
2answers
994 views
Bi-directional sync of 2 different APIs
I'm currently assigned a task, where I have to program a bidirectional synchronisation between 2 ERP-related software, one providing webservices (Visual Studio Web Reference) and the other one ...
0
votes
1answer
622 views
Android Activitiy and Service Sync
I've looked for the solution of my problem but I've failed in finding a suitable answer.
I've been trying to develop an Android application with heavy asyncronous networking capabilities. The problem ...
0
votes
1answer
47 views
How Do DB Version Control Systems Lack in Script Semantics When Modeled on Source/Target Difference Comparisons
There are several database version control solutions out there to assist with controlling not only the versioning of a database, but also deploying and synchronizing databases. These systems are ...
1
vote
0answers
474 views
Vector clock conflict resolution in event sourced system via local timestamp - is this safe?
We have an occasionally connected, event sourced system: a budgeting application where each client can pull other client's event store from a separate storage (network share, dropbox,...).
It is our ...
1
vote
1answer
649 views
Web service + sync database + main application architecture
I got to develop a web service that will help synchronize some of our data with APIs from Google, as well other services in the future. I thought, and my boss too, we should go for a stand alone web ...
3
votes
1answer
2k views
How to synchronize data between two web services
I'm currently working on a project consisting of two different web applications. One of the applications is a PHP web server with a website front-end and a MySQL database. It consists of Laravel ...
2
votes
3answers
312 views
Data from devices with unreliable clocks
Are there any viable approaches to dealing with data coming from devices with unreliable clocks?
We have a database system running on a central server. The latest addition to the system is a bunch of ...
1
vote
1answer
184 views
Terminology for partial offline database synchronization
I am looking for solutions for a field where I think I don't know the adequate terminology. The problem is that I have a central SQL database in the cloud. Then I have child databases only containing ...
3
votes
2answers
2k views
Technique to sync medium/large amounts of data
I implemented sync for my app (with a REST backend), it works well but there are some problems:
Blocks - Since I don't want to overwrite possible inputs of the user during sync, I block the UI (...
5
votes
1answer
541 views
Android: Design for fetching update/syncing from server
I'm building a meeting app where users can create, join (by invite), and edit events like meetings, outings etc. Think What's app chat groups. So I'm looking into designing how the android app would ...
3
votes
2answers
99 views
How do you address the problem of dealing with an external service that stores your data and you want to keep in sync?
I'm integrating an enterprise application with an existing pattern.
The main problem is how to synchronize data between my system and an external system through RPC (HTTP API calls to be precise).
...
