Databases
StackOverflow2013
Postsdbo
POAmazon SimpleDB Woes: Implementing counter attributes
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POAmazon SimpleDB Woes: Implementing counter attributes
    primarykey
    data
    text
    <p>Long story short, I'm rewriting a piece of a system and am looking for a way to store some hit counters in AWS SimpleDB.</p> <p>For those of you not familiar with SimpleDB, the (main) problem with storing counters is that the cloud propagation delay is often over a second. Our application currently gets ~1,500 hits per second. Not all those hits will map to the same key, but a ballpark figure might be around 5-10 updates to a key every second. This means that if we were to use a traditional update mechanism (read, increment, store), we would end up inadvertently dropping a significant number of hits.</p> <p>One potential solution is to keep the counters in memcache, and using a cron task to push the data. The big problem with this is that it isn't the "right" way to do it. Memcache shouldn't really be used for persistent storage... after all, it's a caching layer. In addition, then we'll end up with issues when we do the push, making sure we delete the correct elements, and hoping that there is no contention for them as we're deleting them (which is very likely).</p> <p>Another potential solution is to keep a local SQL database and write the counters there, updating our SimpleDB out-of-band every so many requests or running a cron task to push the data. This solves the syncing problem, as we can include timestamps to easily set boundaries for the SimpleDB pushes. Of course, there are still other issues, and though this might work with a decent amount of hacking, it doesn't seem like the most elegant solution.</p> <p>Has anyone encountered a similar issue in their experience, or have any novel approaches? Any advice or ideas would be appreciated, even if they're not completely flushed out. I've been thinking about this one for a while, and could use some new perspectives.</p>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. USSteffen Opel
    1. USJustin
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    2. PO
      singulars
      1. PTAnswer
    3. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POAmazon SimpleDB Woes: Implementing counter attributes
      1. USJustin
      1. VTFavorite
    2. VO
      singulars
      1. POAmazon SimpleDB Woes: Implementing counter attributes
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. POAmazon SimpleDB Woes: Implementing counter attributes
      1. This table or related slice is empty.
      1. VTUpMod
    1. COThis question and answers are out of date now that SimpleDB supports consistent reads and conditional puts. See http://developer.amazonwebservices.com/connect/ann.jspa?annID=611
      singulars
      1. POAmazon SimpleDB Woes: Implementing counter attributes
      1. USAshley Tate
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload