Databases
StackOverflow2013
Postsdbo
POReading data blocks from a file in Python
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POReading data blocks from a file in Python
    primarykey
    data
    text
    <p>I'm new to python and am trying to read "blocks" of data from a file. The file is written something like:</p> <pre><code># Some comment # 4 cols of data --x,vx,vy,vz # nsp, nskip = 2 10 # 0 0.0000000 # 1 4 0.5056E+03 0.8687E-03 -0.1202E-02 0.4652E-02 0.3776E+03 0.8687E-03 0.1975E-04 0.9741E-03 0.2496E+03 0.8687E-03 0.7894E-04 0.8334E-03 0.1216E+03 0.8687E-03 0.1439E-03 0.6816E-03 # 2 4 0.5056E+03 0.8687E-03 -0.1202E-02 0.4652E-02 0.3776E+03 0.8687E-03 0.1975E-04 0.9741E-03 0.2496E+03 0.8687E-03 0.7894E-04 0.8334E-03 0.1216E+03 0.8687E-03 0.1439E-03 0.6816E-03 # 500 0.99999422 # 1 4 0.5057E+03 0.7392E-03 -0.6891E-03 0.4700E-02 0.3777E+03 0.9129E-03 0.2653E-04 0.9641E-03 0.2497E+03 0.9131E-03 0.7970E-04 0.8173E-03 0.1217E+03 0.9131E-03 0.1378E-03 0.6586E-03 and so on </code></pre> <p>Now I want to be able specify and read only one block of data out of these many blocks. I'm using <code>numpy.loadtxt('filename',comments='#')</code> to read the data but it loads the whole file in one go. I searched online and someone has created a patch for the numpy io routine to specify reading blocks but it's not in mainstream numpy. </p> <p>It's much easier to choose blocks of data in gnuplot but I'd have to write the routine to plot the distribution functions. If I can figure out reading specific blocks, it would be much easier in python. Also, I'm moving all my visualization codes to python from IDL and gnuplot, so it'll be nice to have everything in python instead of having things scattered around in multiple packages.</p> <p>I thought about calling gnuplot from within python, plotting a block to a table and assigning the output to some array in python. But I'm still starting and I could not figure out the syntax to do it.</p> <p>Any ideas, pointers to solve this problem would be of great help.</p>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. This table or related slice is empty.
    1. UStoylas
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    2. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POReading data blocks from a file in Python
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. POReading data blocks from a file in Python
      1. USole
      1. VTFavorite
    3. VO
      singulars
      1. POReading data blocks from a file in Python
      1. This table or related slice is empty.
      1. VTUpMod
    1. COSo you want the user to specify, say a pair of values (i,j) and read all the lines between the line "# i j" and the next blank line?
      singulars
      1. POReading data blocks from a file in Python
      1. USPascal Bugnion
    2. COAlsmot! The exact thing I want to be able to do is to be able to specify i,j where i is the starting block and j is the final block and a block is defined by rows seperated by two or more blank rows.
      singulars
      1. POReading data blocks from a file in Python
      1. UStoylas
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload