Databases
StackOverflow2013
Postsdbo
PO
 

Note that there are some explanatory texts on larger screens.

plurals
  1. PO
    primarykey
    data
    text
    <p>Yes, using DataSets uses a lot more memory than the actual data. How much is hard to quantify, but <a href="https://stackoverflow.com/questions/424598/what-is-the-memory-overhead-of-storing-data-in-a-net-datatable/424662">this</a> question on StackOverflow suggests more than 4 times the original data size. Let's assume that is correct. 150MB of data times 4 = 600MB of memory. When ASP.NET application use around 800MB of RAM they will start to throw OutOfMemoryExceptions. I'm not sure how that that limit is the same as the Application Pool memory limit. Have you tried the /3GB switch in boot.ini? (See <a href="http://support.microsoft.com/kb/833722" rel="nofollow noreferrer">this article</a> for instructions)</p> <p>Also note that if you are serializing your DataSet, the serializer may allocate huge buffers for the serialization (up to 10 times the original size, see <a href="http://blogs.msdn.com/tess/archive/2006/02/02/523553.aspx" rel="nofollow noreferrer">this article</a>. You indicate that the problem occurs when you read the data so this is probably not the cause of your error (but it might be if you solve the out of memory error and try to send the data over the wire).</p> <p>My experience with DataSets is that they might seem like a good idea at first but you will very soon run into problems.</p> <p>Another (probably better) solution would be to use a DataReader and read one row at a time. Return batches of rows (i.e. use some kind of paging for the data) and experiment with the size of each batch to find the sweet spot between performance and memory usage. WCF streaming might do the trick but you will need to configure WCF correctly to allow it to return such massive amounts of data in one call.</p>
    singulars
    1. This table or related slice is empty.
    1. POWeb Service Out of Memory Exception while filling ADO.Net DataSet
      singulars
      1. PTQuestion
    1. PTAnswer
    1. USCommunity
    1. USKarl
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. POWeb Service Out of Memory Exception while filling ADO.Net DataSet
      singulars
      1. PTQuestion
    1. This table or related slice is empty.
    1. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTAcceptedByOriginator
    2. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTUpMod
    1. This table or related slice is empty.
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload