Databases
StackOverflow2013
Postsdbo
POTool for manipulating results of large set of computational experiments
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POTool for manipulating results of large set of computational experiments
    primarykey
    data
    text
    <p>I am a researcher and my primary interest is improving sparse kernels for high performance computing. I investigate large number of parameters on many sparse matrices. I wonder whether there is a tool to manage these results. The problems that I encounter are:</p> <ol> <li>Combine results of several experiments for each matrix</li> <li>Version the results</li> <li>Taking average, finding minimum/maximum/standard deviation of results</li> <li>There are hundreds of metrics that describe the performance improvement. I want to select a couple of the metrics easily and try to find which metric correlates with the performance improvement.</li> </ol> <p>Here I gave a sample small instance of my huge problem. There are three types of parameters and two values for each parameter: Row/Column, Cyclic/Block, HeuristicA/HeuristicB. So there must 8 files for the combination of these parameters. Contents of two of them:</p> <p>Contents of the file <code>RowCyclicHeuristicA.txt</code></p> <pre><code>a.mtx#3#5.1#10#2%#row#cyclic#heuristicA#1 a.mtx#7#4.1#10#4%#row#cyclic#heuristicA#2 b.mtx#4#6.1#10#3%#row#cyclic#heuristicA#1 b.mtx#12#5.7#10#7%#row#cyclic#heuristicA#2 b.mtx#9#3.1#10#10%#row#cyclic#heuristicA#3 </code></pre> <p>Contents of the file <code>ColumnCyclicHeuristicA.txt</code></p> <pre><code>a.mtx#3#5.1#10#5%#column#cyclic#heuristicA#1 a.mtx#1#5.3#10#6%#column#cyclic#heuristicA#2 b.mtx#4#7.1#10#5%#column#cyclic#heuristicA#1 b.mtx#3#5.7#10#9%#column#cyclic#heuristicA#2 b.mtx#5#4.1#10#3%#column#cyclic#heuristicA#3 </code></pre> <p>I have a scheme file to describe the contents of these files. This file has a line describing type and meaning of each column in the result files:</p> <pre><code>str MatrixName int Speedup double Time int RepetationCount double Imbalance str Parameter1 str Parameter2 str Parameter3 int ExperimentId </code></pre> <p>I need to display <strong>average</strong> <code>Time</code> and two types of parameters as follows: (numbers in the following table are random)</p> <pre><code> Parameter1 Parameter2 Matrix row col cyclic block a.mtx 4.3 5.2 4.2 5.4 b.mtx 2.1 6.3 8.4 3.3 </code></pre> <p>Is there an advanced and sophisticated tool that gets the scheme of the table above and generates this table automatically? Currently I have a tool written in Java to process raw files and Latex code to manipulate and display the table using <code>pgfplotstable</code>. However, I need one tool that is more professional. I do not want pivot tables of MS Excel.</p> <p>A similar question is <a href="https://stackoverflow.com/questions/5198152/way-to-store-large-amount-of-experiments-and-corresponding-results">here</a>.</p>
    singulars
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PTQuestion
    1. USCommunity
    1. USKadir
    plurals
    1. PL
      singulars
      1. LTLinked
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POTool for manipulating results of large set of computational experiments
      1. USKadir
      1. VTFavorite
    2. VO
      singulars
      1. POTool for manipulating results of large set of computational experiments
      1. USBertrand Caron
      1. VTFavorite
    1. This table or related slice is empty.
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload