Questions tagged [caching]
Questions regarding cache algorithms by applications and implementations of information caching by database engines and other information repository and presentation applications.
30
questions with no upvoted or accepted answers
13
votes
0
answers
2k
views
Caching Strategy: WCF Buffer pooling and size
I am currently trying to understand the best configuration for caching. I am using Azure In-Role caching (currently Colocated, but Dedicated at a later point) in a Web Api 2 application in .NET 4.5.1....
- 887
4
votes
1
answer
321
views
Caching data in a Rails variable instead of querying the database?
I have a list of about 15000 items in my database, every one of them has a unique ID and name. New items are added regularly but usually not more than ten a day.
My frontend uses a form with ...
- 49
3
votes
0
answers
726
views
Creating a generic Cache solution for function calls using SOLID principles in C#
I would like to have a caching solution for a variety of function calls.
All of the function calls fit the following signature
public ResponseType ProcessRequest(RequestType request);
About half ...
- 209
3
votes
0
answers
62
views
Cache updates after not related REST request completes
I am wondering about the following scenario - it's in the land of Spring/AOP and Ehcache.
Happens in REST Web Application - REST/Service/DAO layers - I have objects in cache (@Repository + @Cacheable)....
- 133
1
vote
0
answers
55
views
Cache publishing updates, or clients polling the cache?
Context:
I am working on an application which loads a cache on startup - periodically refreshed. However it turns out that this cache is something which is very general and can be used by other ...
- 119
1
vote
0
answers
134
views
Near Real-Time Data Aggregation using Complex Queries
We are working on a multi-tenant SaaS product that has a ledger of all tenant customer transactions, which we use to track invoice states on a line-item level. This particular application will result ...
- 227
1
vote
0
answers
165
views
Architect Java Hashmap Hierarchy to its equivalent in Redis Cache?
I have the following Job class representing runs of a job. I have a list of start and end times in Job class because the same Job can be rerun.
public class Job {
private final List<...
- 119
1
vote
0
answers
61
views
How to specify constant data wrt cache coherence?
I am suspecting cache latency issues due to constant data (or same data across multiprocessor caches) being churned up in the cache coherence protocols. Is there a way to specify specific data as ...
- 267
1
vote
0
answers
186
views
Location specific caching for read-heavy data (server architecture)
This project will serve many duplicate requests with location-specific answers. I.e. 10,000 people in New York will all get the same server response (a list of businesses in New York), but one person ...
- 11
1
vote
0
answers
145
views
Difference between application cache and object cache
I'm reading Martin L. Abbott, Michael T. Fisher's Scalability rules: 50 principles for scaling Web sites, and in rules 24 and 25 they talk about Application Caches and Object Caches respectively.
My ...
- 1,567
1
vote
0
answers
214
views
Saving and retrieving multiple cached json/txt data files
I am working on some numerical programming and need to generate the results for a model given a variety of input parameters. Since the model takes a while to run, I was planning to save the data to ...
- 179
1
vote
0
answers
463
views
Why does the EF query plan cache eviction algorithm reduce the cache to its cleanup trigger size, causing a perpetual cleanup?
The cache eviction algorithm for query plan caching in Entity Framework is described in section 3.2.2 as this:
Once the cache contains a set number of entries (800), we start a timer that ...
- 5,716
1
vote
0
answers
65
views
efficient caching with complex user rights
I am currently learning about memcached/redis, and I am trying to figure out how could I use this kind of technology at work.
Now I understand that you should mostly cache data which is common to ...
- 7,890
1
vote
0
answers
2k
views
Understand how the TLB (Translation Lookaside buffer) works and interacts with pagetable and addresses
So I am trying to understand this TLB (Translation Lookaside Buffer). But I am having a hard time grasping it.
in context of having two streams of addresses, tlb and pagetable.
I don't understand ...
- 151
1
vote
0
answers
74
views
Built-in Context-and-Input-to-Output-Hashing in Compilers
Why doesn't (open source) compilers contain builtin funtionality for (shared) caching and reuse-fetching (using SHA1-hash of compiler-version, build-flags, target-platform and inputs) of executable ...
- 151
0
votes
0
answers
77
views
How to generate idempotency token for remote cache
We are using a client library over Memcache.
This library has a lot of logic for Memcache client and is indispensable in current form.
One of the API of the library is put which internally just uses ...
- 107
0
votes
0
answers
58
views
Effective cache solution to have the newest data in React Native
Goal
We have an app with different articles. I want to cache an article when the user has read it, but make sure that I display the latest data. I came up with this hook:
React.useEffect(() => {
...
- 101
0
votes
0
answers
97
views
Should I use ETag Cache on all HTTP Responses?
I was wondering if there is any downside to using E-Tag cache for every request and response.
To be more specific, I'm building a data heavy SPA connected to a Laravel API and the client insists that ...
- 103
0
votes
0
answers
84
views
Handle big data sets in a web application in combination with real-time communication between web-clients
We have the following use case to be developing:
A web application that shows a data table / data grid with up to 100000 rows and 30-50 columns. Each column is filterable and sortable. The web ...
- 125
0
votes
0
answers
38
views
Cache graph with hierarchy
I'm looking to build a graph that's tied to any caching system that I can interact with. Its only goal is when an item is deleted, based on its "linked items", to also delete these. A partial rebuild ...
- 85
0
votes
0
answers
51
views
How to elegantly allow for lookups/dropdowns to be loaded with items marked 'Inactive' without totally messing up caching?
Where the application has the ability to mark dropdown items 'inactive' - this means to the user that particular item is no longer in use and should not be shown in dropdowns. However, it is used on ...
- 165
0
votes
0
answers
383
views
How to cache timestamp based key values with a distributed cache?
I have a dataset in a key value store (similar to Cassandra). The data model is -
Key - ServiceName / timestamp_in_milliseconds
value - operation
In the write side I get some operations for a ...
- 101
0
votes
0
answers
696
views
Using signalR for streaming alongside a microservice architecture
I have a cluster of micro services with an exposed search API serving a client app. I want to "stream" in real time the aggregated results of a complex search. The search will be kicked of by the ...
- 1
-1
votes
1
answer
50
views
Is it practical to cache multiple instances of variable API data (updates hourly for each instance) for N users?
I'm using flask with SQLAlchemy on a postgresql database for a mobile app I'm building. My application allows a single user to save lets say up to 5 different locations which are saved in the database....
- 1
-1
votes
1
answer
94
views
Strategy to make sure relevant cache records are expired on data update
In our database, we have around 150 different tables. However, there are a handful of them that are key, as in they get referenced pretty much everywhere. We also have quite a few reports that we pull ...
- 196
-1
votes
1
answer
113
views
Design review for a Cache aside system
I am maintaining a system where a list of string ids are stored against a container (using the term here as a generic entity) object. The database used is MySQL and the table structure looks like this....
-1
votes
2
answers
1k
views
Website redirect in cache to old website
So I've developed a website for a client, however he used to use this url with a re-direct to 'another' site of his. I had the re-direct cancelled, but whoever visited their old website before, still ...
- 15
-2
votes
1
answer
225
views
Recommended way of caching weather information
I'm developing an application that will show some weather information based on the user's location. Since the weather forecast is just a very small feature of the app that complements the main ones, I ...
- 117
-2
votes
1
answer
236
views
Reducing duplicate API call between micro services in a latency sensitive flow
Let's suppose that I have 5 microservices, let's also name them ServiceA, ServiceB, ServiceC, ServiceD, ServiceE.
To perform an operation X communication needs to happen between these services.
And ...
- 161
-3
votes
1
answer
78
views
How to exchange 1T data between multiple processes?
How to exchange 1T data between multiple processes?
Requirements:
Data < 1TB. Memory > 1T.
Multiple processes (different languages) on the same machine or different machines over network
Data ...
- 103