Note that there are some explanatory texts on larger screens.

plurals
  1. USKaushik Ghose
    primarykey
    data
    text
    plurals
    1. CO@Jeff Hmm, I had a funky problem with concurrent reads on an hdf5 file that I created with h5py (No writes). I was using Multiprocessing and ran into an intermittent problem where I would occasionally read garbage data. I had this regardless of whether I used a global file pointer or opened the file afresh in each thread. I had a devil of a time replicating the problem because it was so intermittent. Have you ever run into this?
      singulars
    2. CO@Jeff Thanks! In my use case I have a bunch of raw data files (sessions) that I ETL into a larger store. Pandas + Pytables does great, except when I have to go back to a previous session and reprocess it for some reason. In such a case I can not append but must first destroy the old entries. I found that tricky with Pandas. Also, I ran into some grief when I tried concurrent reads with an HDF5 store which I think is not an issue with sqlite
      singulars
    3. CO@TomAugspurger Thanks for the pointer! After reading your link I'm thinking that it may be better to store the actual data in a database and load relevant portions into Pandas. The more I look into it the more it seems Pandas is not that great with data that keeps changing but is awesome with static data. Is that correct?
      singulars
 

Querying!

 
Guidance

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload