Databases
StackOverflow2013
Postsdbo
POCache or MultiMap for day-based cache expiration?
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POCache or MultiMap for day-based cache expiration?
    primarykey
    data
    text
    <p>Context: I'm working on an analytics system for an ordering system. There are about 100,000 orders per day and the analytics need to run for the last N (say, 100) days months. The relevant data fits in memory. After N days, all orders are evicted from the memory cache, with an entire day in the past being evicted. Orders can be created or updated.</p> <ol> <li><p>A traditional approach would use a <code>ConcurrentHashMap&lt;Date, Queue&lt;Order&gt;&gt;</code>. Every day, values for keys representing dates more than N days in the past will be deleted. But, of course, the whole point of using Guava is to avoid this. EDIT: changed <code>Map</code> to <code>ConcurrentHashMap</code>, see the end of the question for rationale.</p></li> <li><p>With Guava collections, a <code>MultiMap &lt;Date, Order&gt;</code> would be simpler. Eviction is similar, implemented explicitly.</p></li> <li><p>While the <code>Cache</code> implementation looks appealing (after all, I am implementing a Cache), I'm not sure about the eviction options. Eviction only happens once a day and its best initiated from outside the cache, I don't want the cache to have to check the age of an order. I'm not even sure if the cache would use a MultiMap, which I think it's a suitable data structure in this case.</p></li> </ol> <p>Thus, my question is: is it possible to use a Cache that uses and exposes the semantics of a MultiMap and allows evictions controlled from outside itself, in particular with the rule I need ("delete all orders older than N days") ?</p> <p>As an important clarification, I'm not interested in a <code>LoadingCache</code> but I do need bulk loads (if the application needs to be restarted, the cache has to be populated, from the database, with the last N days of orders).</p> <p>EDIT: Forgot to mention that the map <em>needs to be concurrent</em>, as orders come in they are evaluated live against the previous orders for the same customer or location etc. </p> <p>EDIT2: Just stumbled over <a href="http://code.google.com/p/guava-libraries/issues/detail?id=135" rel="nofollow">Guava issue 135</a>. It looks like the MultiMap is not concurrent.</p>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. USwishihadabettername
    1. USwishihadabettername
    plurals
    1. PL
      singulars
      1. LTLinked
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    2. PO
      singulars
      1. PTAnswer
    3. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. COSee [Guava issue #142](https://code.google.com/p/guava-libraries/issues/detail?id=142) (`Cache` is successor of `ConcurrentMap` produced by `MapMaker`) and also [this question](http://stackoverflow.com/questions/737060/create-weak-multimap-with-google-collections).
      singulars
      1. POCache or MultiMap for day-based cache expiration?
      1. USXaerxess
    2. COAnd about edit#2: you can use [`Multimaps#synchronizedMultimap`](http://docs.guava-libraries.googlecode.com/git/javadoc/com/google/common/collect/Multimaps.html#synchronizedMultimap(com.google.common.collect.Multimap)) to have _a synchronized (thread-safe) multimap backed by the specified multimap_.
      singulars
      1. POCache or MultiMap for day-based cache expiration?
      1. USXaerxess
    3. CO@Xaerxess Thanks, I'll have to test how it performs; I have some concerns it's not going to be as good as ConcurrentHashMap, in which case I'll have to go back to using the JDK classes (i.e. approach #1 in the question).
      singulars
      1. POCache or MultiMap for day-based cache expiration?
      1. USwishihadabettername
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload