StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

POOut of memory errors with permsize 1024M and heap size 2048M, for XMLs processed inside for-each loop in XPL, each being about 4.5 MB in size on disk
text
Body
copied!<p>I have a few for-each loops, that I use to iterate over the elements of a configuration XML which is very small size (2 KB on disk) to arrive at a source URL and a target URL dynamically. Then, I retrieve data from source URL using <code>URLGenerator</code> (because it performs streaming) and load it to XML database using XForms Submissions processor. Source URL and Target URLs are computed dynamically and the innermost loops where the retrieval and loads take place happen about 32 times in total, each time with an XML file of about 4.5 MB on average (max. about 6 MB, min. a few KB). Every time I try this, I get out of memory error for Tomcat running with permgen and heap sizes generously allocated, JVM is 32-bit, OS is 32-bit; I want a way out of this out-of-memory errors:</p> <ol> <li>I had thought the separate XForms Submissions will be separate transactions, so will not accumulate causing out-of-memory problem</li> <li>Is there a way to perform a streaming load using XForms Submissions processor instead of creating full document in memory?</li> <li>I do not know if that would help, but is there a way to perform aggressive garbage collection in Orbeon so I do not get out-of-memory problems?</li> </ol> <p>If needed, I can post the code here (for the XPL).</p> <p><a href="https://docs.google.com/document/pub?id=1qAsLU04VQYXpMc0w8Lbs1Fe5718Ouxa26Bgd77_DcQU" rel="nofollow">Source code</a> (in reply to the comment asking for it)</p>

Querying!

Guidance

An individual column

Larger individual text columns get their own page to allow for proper reading.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload