Skip to main content
OverflowAI is here! AI power for your Stack Overflow for Teams knowledge community. Learn more

Questions tagged [latency]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
2 answers
193 views

Can caching increase p90 response time

I'm learning about caching and I realized a positional problem I need clarification on. Suppose the database p90 response time is too high and we need to decrease it. We are considering adding a cache....
Ali Pardhan's user avatar
20 votes
6 answers
7k views

How would you identify slow queries before reaching production?

Let's say you are running a query on your database. In development and staging, where the amount of data is small, everything looks good. Unit and integration tests are also fine and the logic is ...
riorio's user avatar
  • 489
0 votes
1 answer
90 views

Would an edge-optimized API Gateway deployment or multiple deployments with latency routing be most performant?

I'm deploying a serverless/lambda-based HTTP API via AWS API Gateway. My goal is to minimize latency in handling requests. I am considering two architectures, and I'm wondering which best meets this ...
Chad Johnson's user avatar
-4 votes
1 answer
147 views

A request's round trip time monitoring at microservice production best tools and practices?

I've a microservice's system at production which provide an API to the outer world. Along with each service monitoring via monitoring tool ( Prometheus, zabbix, etc.) of course it's highly desirable ...
cpu's user avatar
  • 1
-1 votes
1 answer
786 views

Suitable networking protocols for low latency, one-packet messaging

What would be some suitable transport and application layer protocols for a secure payments network where low latency is a key goal? Here "low latency" means completing an encrypted ...
LearningFast's user avatar
-1 votes
1 answer
394 views

Reducing duplicate API call between micro services in a latency sensitive flow

Let's suppose that I have 5 microservices, let's also name them ServiceA, ServiceB, ServiceC, ServiceD, ServiceE. To perform an operation X communication needs to happen between these services. And ...
Amit Upadhyay's user avatar
64 votes
10 answers
13k views

How do I mitigate a scenario where a user goes to pay, but the price is changed mid-request?

This is kind of similar to the Two Generals' Problem, but not quite. I think there is a name for it, but I just can't remember it right now. I am working on my website's payment flow. Scenario ...
turnip's user avatar
  • 1,667
1 vote
0 answers
44 views

Speeding up read write intensive operation on large files in cloud (Azure)

I am using Azure Storage Blobs to persist certain models per tenant. While processing items for each tenant these models have to be pulled to memory, used for certain operation, updated and pushed ...
mebjas's user avatar
  • 119
3 votes
2 answers
556 views

Writing requirement for Response Time from Hosted Server

We are contracting with a group to create some cloud services for us, and would like to write a requirement for them stating that a particular API call will provide results within X seconds. They are ...
Betty Crokker's user avatar
5 votes
1 answer
1k views

Low latency TCP sockets in .NET

Is it possible to optimize a .NET application running on a server version of Windows for near-zero latency TCP communication? Or will there always be unpredictable/unavoidable delays? For example, ...
user7834712's user avatar
-1 votes
1 answer
86 views

How can I configure storm to receive data from a client, process the data in bolts and then return the processed data to the same client as a stream?

Here my scenario: I have a client application that needs a dedicated powerful computation system that every seconds process some data in input (few kilobyte) and return a few megabytes of processed ...
Paolo Vigori's user avatar
0 votes
1 answer
112 views

Design question: Server returns partial results for optimization

I have a service which sends a set of queries to the server in a single call and acts on the decisions from the server. I will first introduce what I already have and the questions will follow. ...
learnerer's user avatar
  • 101
1 vote
1 answer
4k views

REST services with a local or remote application

I have several uncommon questions related to the design of REST services hosted on a server communicating with local or remote applications. As an example, let's say that I have 2 machines ("A" and "...
AilurusFulgens's user avatar
5 votes
1 answer
918 views

Do you have a metaphor for cache/data latencies? [closed]

From this answer about latencies, we have some numbers (yes, caveat caveat) for latencies when coding (slightly edited): L1 cache reference 0.5 ns Branch mispredict 5 ns L2 cache reference 7 ns Main ...
Phil H's user avatar
  • 209
2 votes
1 answer
827 views

How do you reduce geographic latency in web application (MVC ASP.net) backed by a single database

I'm working on a modest sized web application that receives circa 30k unique users per day, this is an MVC C# application hosted on 3 web servers and backed by a single SQL server, everything is ...
Dan's user avatar
  • 161
5 votes
2 answers
6k views

DbFirst vs Code First? what should I use if I rely on Stored procedures

This question is asked many times, and I always prefer code-first as I like to keep the logic in code. But now I have a challenge to load screen under 5 seconds and very little time to do things. I ...
A.T.'s user avatar
  • 171
0 votes
1 answer
1k views

alternative to environment variables

The amount of servers and the complexity of our application is growing and we now have servers in different regions (hosted on AWS). Certain database operations require low latency so we have stuck a ...
tonyl7126's user avatar
  • 297
1 vote
5 answers
2k views

Read K&R before learning low latency C++? [closed]

I have never really done a large amount of C programming but am in the middle of teaching myself low latency C++. Would it do more harm than good to read the K&R C programming book? I am a bit ...
user997112's user avatar
  • 1,469
16 votes
3 answers
28k views

Low Latency Unix/Linux

Most low latency/high frequency programming jobs (based on job specs) appear to be implemented on unix platforms. In a lot of the specs they make particular request for people with "low latency linux" ...
user997112's user avatar
  • 1,469
22 votes
11 answers
3k views

Does low latency code sometimes have to be "ugly"?

(This is mainly aimed at those who have specific knowledge of low latency systems, to avoid people just answering with unsubstantiated opinions). Do you feel there is a trade-off between writing "...
user997112's user avatar
  • 1,469
11 votes
8 answers
3k views

Is Java much harder to "tweak" for performance compared with C/C++? [closed]

Does the "magic" of the JVM hinder the influence a programmer has over micro-optimisations in Java? I recently read in C++ sometimes the ordering of the data members can provide optimizations (granted,...
user997112's user avatar
  • 1,469
33 votes
2 answers
35k views

Writing low latency Java [closed]

Are there any Java-specific techniques (things which wouldnt apply to C++) for writing low latency code, in Java? I often see Java low latency roles and they ask for experience writing low latency ...
user997112's user avatar
  • 1,469
5 votes
2 answers
178 views

Designing a web app that will be used from distant geographic locations

I have designed/built a number of small web apps. Most have been used by clients who operate in a specific geographic area, mostly within the same state/province. For these I would follow best ...
Farray's user avatar
  • 191
7 votes
6 answers
10k views

Is it worth learning C++ in depth JUST for a career in low latency trading? [closed]

I am interested in ultra high frequency trading and Java is the language I know best. I was always under the impression I would have to perfect my C++ skills in order to work within the ultra high ...
user997112's user avatar
  • 1,469
3 votes
3 answers
484 views

To what extent could Java be used over C++ for ultra high frequency systems?

Could Java ever match C++ with regards to programming ultra high frequency systems? Has the JVM improved enough to allow this? From a theoretical or practical point is it possible? Is C++ used in ...
user997112's user avatar
  • 1,469
6 votes
2 answers
2k views

How do I optimize a web application for high-latency users?

Basically, I have an application that does searches and requests results from a backend via long polling. It connects to the backend which collects results for 500 ms then sends them back to the ...
Jason Baker's user avatar
  • 9,625