Databases
StackOverflow2013
Postsdbo
POAre there any libraries or components that handle storage and fast retrieval of user-generated content?
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POAre there any libraries or components that handle storage and fast retrieval of user-generated content?
    primarykey
    data
    text
    <p>Considering the case of having a large and active user base where each user wants to store a profile picture and some additional images or other artifacts, are there any libraries or frameworks that allow for easy storage and query of such data?</p> <p>A reference implementation would be Facebook's <a href="http://www.facebook.com/note.php?note_id=76191543919" rel="nofollow noreferrer">Haystack Photo Infrastructure</a>.</p> <p>The following characteristics are important</p> <ul> <li>Data store should scale well: adding resources should be transparent to the application using the store (<a href="https://stackoverflow.com/questions/1572574/java-fast-data-storage-retrieval">similar question</a> had an answer referring to <a href="http://project-voldemort.com/" rel="nofollow noreferrer">LinkedIn's Voldemort</a>).</li> <li>Ability to add some meta-data alongside the data being stored.</li> <li>Meta-data can be queried with good performance (e.g. stored in configurable index like Lucene/Solr).</li> <li>Quick key-based access and some intermediate caching layer</li> </ul> <p>Any recommendations for libraries or frameworks that can be easily integrated into a Java web application are welcome.</p> <p><em>Update</em>: thank you for the first few answers. I have to go into more detail on what type of answers are expected. <a href="https://stackoverflow.com/questions/2148711/are-there-any-libraries-or-components-that-handle-storage-and-fast-retrieval-of-u/2148836#2148836">Tobu's answer</a>, although not java related is very good (just voted up). It is possible to implement a solution with a combination of file system access and a DB and add some layer of caching in between, but I consider it a waste of time, if someone more qualified than me has already designed, implemented and run a better solution. Something based on a solution with underlying DB or JCR implementations is a good fit, but implementing the other infrastructure is not what I want to do.</p>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. USCommunity
    1. USKariem
    plurals
    1. PL
      singulars
      1. LTLinked
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    2. PO
      singulars
      1. PTAnswer
    3. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POAre there any libraries or components that handle storage and fast retrieval of user-generated content?
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. POAre there any libraries or components that handle storage and fast retrieval of user-generated content?
      1. This table or related slice is empty.
      1. VTUpMod
    1. This table or related slice is empty.
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload