Databases
StackOverflow2013
Postsdbo
POOut of memory errors with permsize 1024M and heap size 2048M, for XMLs processed inside for-each loop in XPL, each being about 4.5 MB in size on disk
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POOut of memory errors with permsize 1024M and heap size 2048M, for XMLs processed inside for-each loop in XPL, each being about 4.5 MB in size on disk
    primarykey
    data
    text
    <p>I have a few for-each loops, that I use to iterate over the elements of a configuration XML which is very small size (2 KB on disk) to arrive at a source URL and a target URL dynamically. Then, I retrieve data from source URL using <code>URLGenerator</code> (because it performs streaming) and load it to XML database using XForms Submissions processor. Source URL and Target URLs are computed dynamically and the innermost loops where the retrieval and loads take place happen about 32 times in total, each time with an XML file of about 4.5 MB on average (max. about 6 MB, min. a few KB). Every time I try this, I get out of memory error for Tomcat running with permgen and heap sizes generously allocated, JVM is 32-bit, OS is 32-bit; I want a way out of this out-of-memory errors:</p> <ol> <li>I had thought the separate XForms Submissions will be separate transactions, so will not accumulate causing out-of-memory problem</li> <li>Is there a way to perform a streaming load using XForms Submissions processor instead of creating full document in memory?</li> <li>I do not know if that would help, but is there a way to perform aggressive garbage collection in Orbeon so I do not get out-of-memory problems?</li> </ol> <p>If needed, I can post the code here (for the XPL).</p> <p><a href="https://docs.google.com/document/pub?id=1qAsLU04VQYXpMc0w8Lbs1Fe5718Ouxa26Bgd77_DcQU" rel="nofollow">Source code</a> (in reply to the comment asking for it)</p>
    singulars
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PTQuestion
    1. USuser557060
    1. USuser557060
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. COWe need to see source code. Is this a java problem?
      singulars
      1. POOut of memory errors with permsize 1024M and heap size 2048M, for XMLs processed inside for-each loop in XPL, each being about 4.5 MB in size on disk
      1. USMike Pennington
    2. COLink to source code is above (in the question description). The source code is actually XPL (not java), if that was your question. The problem might be due to memory-handling in java, Tomcat, or Orbeon or the source code might be the culprit, don't know yet.
      singulars
      1. POOut of memory errors with permsize 1024M and heap size 2048M, for XMLs processed inside for-each loop in XPL, each being about 4.5 MB in size on disk
      1. USuser557060
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload