Databases
StackOverflow2013
Postsdbo
POWhat's the best serialization method for objects in memcached?
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POWhat's the best serialization method for objects in memcached?
    primarykey
    data
    text
    <p>My Python application currently uses the <a href="http://www.tummy.com/Community/software/python-memcached/" rel="nofollow noreferrer">python-memcached API</a> to set and get objects in memcached. This API uses Python's native <a href="http://docs.python.org/library/pickle.html" rel="nofollow noreferrer">pickle module</a> to serialize and de-serialize Python objects. <p>This API makes it simple and fast to store nested Python lists, dictionaries and tuples in memcached, and reading these objects back into the application is completely transparent -- it just works.<p>But I don't want to be limited to using Python exclusively, and if all the memcached objects are serialized with pickle, then clients written in other languages won't work.<p>Here are the cross-platform serialization options I've considered:<p></p> <ol> <li>XML - the main benefit is that it's human-readable, but that's not important in this application. XML also takes a lot space, and it's expensive to parse.<p></li> <li>JSON - seems like a good cross-platform standard, but I'm not sure it retains the character of object types when read back from memcached. For example, according to <a href="https://stackoverflow.com/questions/408866/python-human-readable-object-serialization">this post</a> tuples are transformed into lists when using <a href="http://pypi.python.org/pypi/simplejson/" rel="nofollow noreferrer">simplejson</a>; also, it seems like adding elements to the JSON structure could break code written to the old structure<p></li> <li><a href="http://code.google.com/apis/protocolbuffers/docs/overview.html" rel="nofollow noreferrer">Google Protocol Buffers</a> - I'm really interested in this because it seems very fast and compact -- at least 10 times smaller and faster than XML; it's not human-readable, but that's not important for this app; and it seems designed to support growing the structure without breaking old code<p></li> </ol> <p>Considering the priorities for this app, what's the ideal object serialization method for memcached?<p></p> <ol> <li>Cross-platform support (Python, Java, C#, C++, Ruby, Perl)<p></li> <li>Handling nested data structures<p></li> <li>Fast serialization/de-serialization<p></li> <li>Minimum memory footprint<p></li> <li>Flexibility to change structure without breaking old code</li> </ol>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. USCommunity
    1. USmb.
    plurals
    1. PL
      singulars
      1. LTLinked
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    2. PO
      singulars
      1. PTAnswer
    3. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POWhat's the best serialization method for objects in memcached?
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. POWhat's the best serialization method for objects in memcached?
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. POWhat's the best serialization method for objects in memcached?
      1. USmb.
      1. VTFavorite
    1. COI think you first have to define the object types you want to store. You already pointed the tuples/lists issue and for arbitrary data types you run into arbitrary problems ;-)
      singulars
      1. POWhat's the best serialization method for objects in memcached?
      1. USmax
    2. COI think the point is that the object types are arbitrary.
      singulars
      1. POWhat's the best serialization method for objects in memcached?
      1. UScletus
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload