Skip to main content

Questions tagged [real-time]

Real-time processing means processing data as it is created or modified. This is in contrast to batch processing, wherein data is processed in large chunks at a specific interval (e.g. every night).

Filter by
Sorted by
Tagged with
0 votes
0 answers
49 views

Web application having database with OPC client

I'm designing a browser-based application that will display real-time data collected from OPC server. I have decided to use Angular framework for the browser application development. The browser ...
Kamrul A's user avatar
3 votes
4 answers
1k views

Is real-time processing a synonym for streaming?

I watched two YouTube videos where in: 1st one - there are concepts of batch processing and stream ingestion and in the 2nd one - there is a comparison between batch and real time processing. Is it ...
bridgemnc's user avatar
  • 251
0 votes
1 answer
153 views

Architecture to show real time Google Calendar data (without polling) on a client

I have a Flutter app with a Firebase Firestore database. I want to integrate my app with Google Calendar, and I need the app to have real-time access to the calendar data. Moreover, my app needs to ...
Anakhand's user avatar
  • 149
0 votes
1 answer
109 views

Implementing Real-Time Signal Failure Handling (Django)

I'm developing a trading platform using Django, where users can publish trading signals with specific stop losses. I'm facing a challenge in implementing a real-time feature to automatically mark ...
scaryhamid's user avatar
2 votes
2 answers
195 views

When should I be worried of Time of check time of use vulnerabilities during database queries?

I am having difficulties on understanding when I should be worried about TOCTOU vulnerabilities and how to avoid them because yes, we can use database transactions but there are different level of ...
Alessandro's user avatar
1 vote
1 answer
103 views

Deterministic behavior using RTOS with preemption

Consider an application with a fixed amount of tasks computation per cycle (let's say 100ms) that's usually done with manual scheduling. With 100 sub-cycles of 1ms, knowing and cutting each ...
iFlo's user avatar
  • 119
2 votes
3 answers
521 views

Critical Infrastructure Language Selection

I took over a development team working on life-safety critical software earlier in the year. The product has been in development for about 8 years, but the current team has only been working on the ...
agentroadkill's user avatar
-2 votes
1 answer
105 views

System design to present live query results over realtime data

Question What is a good storage layer, coding paradigm, and query language for computing over realtime data? Use-case For example, stock and options prices are (essentially) realtime data streams. I ...
geofflittle's user avatar
0 votes
1 answer
258 views

Best practices to deal with realtime data in REST API, Postgres and Redis

Overview Today we have a monolithic service that deals with realtime time data. The monolithic are composed by follow stack: Django + AuroraDB Cluster (Postgres AWS) + Varnish cache and cloudfront at ...
Patrick Acioli's user avatar
1 vote
1 answer
665 views

Performing many SQL inserts quickly without using BulkCopy

I have a C# system that reads thousands of messages per minute from a Kafka topic. The messages are filtered and I need to insert the filtered messages into a MSSQL table. A normal insert statement is ...
Mulciber Coder's user avatar
0 votes
1 answer
342 views

Solution architecture for a Kafka streaming to website system

Not sure if this is the correct forum for this question - but I could really use some advice. I need to design a system (within certain constraints). The system must implement the following logic: A ...
Mulciber Coder's user avatar
0 votes
0 answers
104 views

Handling realtime notification receivers in a paginated application

I am working on an application right now, which is fully paginated. The application basically providers the client (a browser SPA) with a list of all data items other users added, and it does that in ...
nugetminer23's user avatar
0 votes
1 answer
518 views

Architecture for alerts system based on API - would this be too slow a design?

(Hi I’m new here - I believe this question suits here from the guide saying “ architecture, and design” - however if there is a better place, just pop me a comment. As there’s no actual code it doesn’...
Wayneio's user avatar
  • 101
1 vote
1 answer
81 views

Architecture for an app that shows posts in real time in a map based on location

I would love to hear some more expert opinions on a problem related to bulk real time information, here some details: Use Case The users view in real time a map with determined places. The users can ...
user3353167's user avatar
1 vote
0 answers
168 views

Near Real-Time Data Aggregation using Complex Queries

We are working on a multi-tenant SaaS product that has a ledger of all tenant customer transactions, which we use to track invoice states on a line-item level. This particular application will result ...
André Haupt's user avatar
-1 votes
2 answers
191 views

Need help with thinking about design to build bidding service [closed]

I have a legacy service written in a procedural style which I am rewriting. I want to improve the maintainability first and foremost; the code gets tweaked often as the business rules change over time....
CXJ's user avatar
  • 187
-1 votes
4 answers
280 views

How to avoid the accident that an item price is updated right after a user clicks purchase?

This is not a real scenario. This is just my assumption that such an accident may happen if the the following events really occur in this chronological order First, a user clicked "puchase" ...
Raymond Pang's user avatar
0 votes
2 answers
66 views

Do 1:1 mobile video call face filters belong on Client or Server?

I am drafting architecture for 1:1 video calling mobile app with face filters (face recognition). I could use p2p e.g. WebRTC because more savings less complexity. However, continuous face rec during ...
softcode's user avatar
  • 103
2 votes
1 answer
61 views

Need advice on approach for IOT project

I need some advice on an IOT project I am working on. Here are some details about what I am trying to do: Use Case: Periodically receive data from the 3rd party vendor API in real time and allow users ...
Riley MacDonald's user avatar
1 vote
0 answers
135 views

FreeRTOS based application architecture

I am going to use the FreeRTOS on my hardware platform. My plan is to model individual tasks as C structs containing task execution period, task priority, task stack size, task name and maybe another ...
Steve's user avatar
  • 141
0 votes
1 answer
167 views

Integrating with real-time data from multiple devices with accelerometer

I am designing a MVP for a simple gamification system for a trampoline park(s). External company is providing bracelets for customers, then collecting this data in their own web app, where they ...
Celebes's user avatar
  • 67
1 vote
1 answer
291 views

Instant Messaging with WebSocket

I am trying to develop an Instant messenger using WebSocket. I have multiple instances of my servers running (say server1 , server2). Two users(say userA , userB) who wants to chat with each other. ...
Jeevi's user avatar
  • 159
2 votes
2 answers
195 views

Architecture to populate graphs from real-time data

I'm developing an application where graphs need to be populated from realtime data. The Real-Time data comes from a Kafka Queue. How should I send this real-time data to the front-end which is in ...
saintlyzero's user avatar
1 vote
1 answer
124 views

Develop Windows based application with 1/10th milisecond precision

I want to develop a Windows based application that would interface with external hardware using serial communication. The hardware would in turn relay back the feedback to the application. This entire ...
Abhishek Agarwal's user avatar
0 votes
0 answers
111 views

How to design realtime deeplearning based application for robotics using python?

I have created a machine learning software that detects objects(duh!), processes the objects based on some computer vision parameters and then triggers some hardware that puts the object in the ...
PanNik's user avatar
  • 67
0 votes
0 answers
28 views

The optimal way to simulate vision detection from limited visual field

I need to build an experiment based on a scientific paper in which a high number of agents have a divided visual field (with limited detection distance) and have to detect other agents in a 2D ...
Hugo Simon's user avatar
0 votes
2 answers
497 views

Should I separate send and receive methods into tasks for a CAN-BUS reader on ESP32?

I am developing a CAN-BUS reader (logger) with an ESP32 microcontroller. This sample uses RTOS and several task to send and receive CAN-BUS messages. https://github.com/espressif/esp-idf/tree/master/...
Edgar's user avatar
  • 293
0 votes
0 answers
179 views

Real-time application and RDBMS bottleneck

I'm currently developing a real-time application using .NET Core 2.2. Many IOT devices (could be up to 100) are concurrently sending messages via MQTT. These messages are parsed, elaborated to extract ...
Alessandro's user avatar
3 votes
1 answer
595 views

What is a good technique to process an event stream to ensure sequential or transactional consistency

I am trying to improve an event-driven processing system, which is having a few problems because the events are not guaranteed to arrive in the correct chronological sequence. This is due to batching ...
scipilot's user avatar
  • 141
-5 votes
1 answer
64 views

Easiest way to add tracking of interactivity (mouse clicks, scrolls, multi-touch gestures) to a React Web App already developed?

Context: we have a responsive web application developed in React.js, which we have successfully used a few times to run user studies on Amazon Mechanical Turk. Now, we would like to add interactivity ...
Pablo Messina's user avatar
1 vote
1 answer
73 views

Displaying periodic simulations via web interface

The gist of my problem is that I'm trying to make a basic simulation for periodically collected data. More specifically, given the position of a radio antenna, the RF patterns would be simulated ...
Forest LeBlanc's user avatar
1 vote
1 answer
139 views

Backend architecture for a datastore with real-time events?

I need to build a data store for transactions that meets the following requirements: A 'transaction' is effectively a state machine which moves through a number of statuses during its lifecycle and ...
jimmy_terra's user avatar
0 votes
2 answers
821 views

copying of memory vs pointer to memory in real time systems

While working in a multi-threaded environment, then data sharing seems to be a good option to pass data between threads. While working with real time systems it is apparently advisable to go with ...
Nishant Bijani A's user avatar
2 votes
2 answers
7k views

Why is Modbus/TCP not considered a real-time protocol?

It is often stated that Modbus/TCP isn't a real-time protocol. It is also "known" that Modbus isn't a real-time protocol. This despite the fact that the original Modbus protocol is highly ...
user247243's user avatar
2 votes
1 answer
435 views

Realtime Live Auto updates for web applications

It's about trying to understand the architecture behind how updates to web application is done. I've been working on a non-public website that has bunch of records displayed in a UI, now the ...
App2015's user avatar
  • 129
1 vote
1 answer
565 views

How to write integration tests for a distributed system highly dependant on current date and flow of time?

My team and I are trying to set up some integration tests of a distributed system that is highly dependant on the flow of time and events coming from external sources. Just to give you an idea about ...
danidemi's user avatar
  • 251
2 votes
2 answers
8k views

Build a realtime chat app which stores messages in a MySQL database

I'm thinking of making a realtime chat app that would allow me to store user messages into a MySQL database. So far these are the two ideas I have. 1) Create and API which the message is sent to and ...
ThatOneQuestionn's user avatar
0 votes
2 answers
254 views

Trigger no more than M events per second, simulate N increments per second

What algorithm should I use, to simulate a continual stream of N increments each second — not writing a loop, but instead by timed-interval events, no more than M events per second? I am implementing ...
bignose's user avatar
  • 191
-1 votes
1 answer
558 views

Real time Querying on Real-time Data

I have data flowing from Kafka into MongoDB real-time. This is just raw data and various APIs are served using this data in real time. The APIs respond using aggregation queries. However when data to ...
nishant's user avatar
  • 101
4 votes
0 answers
2k views

Why does clock() function in C from <time.h> header only returns clock ticks in increments of 10's of thousands?

I am curious to know why does the function clock() only returns values in increments of 10,000 and is not able to return values in between. I have the following code: #include<iostream> #...
yoyo_fun's user avatar
  • 2,297
4 votes
1 answer
1k views

What is so different about RTOS compared to normal programming?

Classical programs run a loop with prioritized ISRs. How do RTOS do this differently of better?
michael mathiasmeier's user avatar
1 vote
3 answers
208 views

Strategy to maintain data efficiency in real time application

Lets say there is a real time application where a list is shared among multiple people and updates done to the list must propagate to all the subscribers of the list. Like in trello. The list is ...
GriffinTaimer's user avatar
1 vote
2 answers
2k views

Realtime statistics of last 60 seconds with O(1) time and memory [closed]

What would be a clean design for an app that is to store transactions and return a overview of the ones received in the last 60 seconds, operating in constant time and memory (O(1))? The app should ...
saralor's user avatar
  • 21
5 votes
1 answer
4k views

Architecture for real-time application, avoiding duplicate messages for queues with no active consumers

I am designing the architecture of an application which has your typical backend and frontend components. The frontend application must be semi real-time. For this requirement, the backend is pushing ...
TheMQJuggler's user avatar
-1 votes
1 answer
83 views

Is this a named pattern: Injecting specialized objects to detect fault conditions

I've got an idea, but I wonder whether somebody else already has named it. I'm writing code to control a machine with actuators, motors, etc., and software will be responsible for preventing ...
Solomon Slow's user avatar
  • 1,223
3 votes
0 answers
1k views

pinging vs socket vs push notifications

I develop mobile apps, now im working on a very big project building a tool for the employees to be heavily used. Now the app is on development mode, and testing with few users, but will need to be ...
manuelBetancurt's user avatar
0 votes
1 answer
132 views

Real-time application : Is this a good way of communicating with my server?[very frequent transmission]

I'm making an application that collects timestamp and GPS data from a user's phone in intervals along with some other information. Currently, every tuple generated is sent via TCP to my application ...
carva's user avatar
  • 3
1 vote
1 answer
75 views

Looking for best way to implement BFD module

I'm going to implement a BFD module (for MPLS LSPs) in VxWorks and was wondering the following: Is it better to create and use a separate timer instance (<2048) per BFD session at the specified Tx ...
stdcerr's user avatar
  • 139
1 vote
4 answers
4k views

Web application Architecture for real time app

Usecase: End user places an order on the company website, the order needs to be pushed to company admin's screen with small latency.The company has multiple branches(identified by compId and branchId ...
Rohit's user avatar
  • 119
1 vote
1 answer
161 views

Save realtime data on client vs on server

I need to implement a site with a real-time graph. I'm currently using WebSockets and chartjs.org for displaying the values. Now I'm not sure whether I should send all data points in every message ...
Marco's user avatar
  • 377