Databases
StackOverflow2013
Postsdbo
POMule SFTP to File flow occasionally produces a corrupted pgp file
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POMule SFTP to File flow occasionally produces a corrupted pgp file
    primarykey
    data
    text
    <p>Using Mule 3.2.1, we have encountered a strange problem where we use the SFTP component to grab pgp encrypted report files from a server. We archive the file using the SFTP component and then use a file:endpoint to produce a working copy for further processing.</p> <p>Our problem is that every once in a while, the working copy of the file ends up corrupted, but the SFTP archived file is good. When looking at the corrupted file in a hex editor, we see good bytes and then all of a sudden, we see null bytes for the remainder of the file. It looks like the underlying file got deleted while Mule was copying.</p> <p>An additional confusing piece of information is that we have tried downloading a failed file again, and had everything work. This leads me to believe that it is not something in the file that is the problem, but apparently we do have one file that consistently seems to fail. All this stuff is occurring on production servers with files that I have no access to.</p> <p>Without knowing the inner workings of Mule, I have no idea what conditions could create this problem.</p> <p>Are there any smart folks out there familiar enough with the inner workings of Mule to venture a guess?</p> <p>Also, we are not Mule experts and would welcome any critique of our Mule configuration. (BTW, the config below is a modified version of what is in production and polls more frequently, etc) </p> <pre><code>&lt;sftp:connector name="SftpConnector" validateConnections="true" autoDelete="true"&gt; &lt;file:expression-filename-parser /&gt; &lt;/sftp:connector&gt; &lt;file:connector name="FileConnector" pollingFrequency="1000" fileAge="1000" streaming="false" autoDelete="false"&gt; &lt;service-overrides messageFactory="org.mule.transport.file.FileMuleMessageFactory" /&gt; &lt;file:expression-filename-parser /&gt; &lt;/file:connector&gt; &lt;sftp:endpoint name="SftpEndpoint" connector-ref="SftpConnector" host="localhost" port="22" user="tdr" password="password" path="/opt/tdr/outbound" archiveDir="/home/cps/mule/sftp-archive" responseTimeout="30000" sizeCheckWaitTime="2500" disableTransportTransformer="true"&gt; &lt;file:filename-wildcard-filter pattern="*.pgp,*.gpg" /&gt; &lt;/sftp:endpoint&gt; &lt;file:endpoint name="FileEndpoint" connector-ref="FileConnector" path="/home/cps/mule/input" /&gt; &lt;flow name="DfrFileGrabber"&gt; &lt;quartz:inbound-endpoint jobName="ptDfrGrabber" cronExpression="0/2 * * * * ?"&gt; &lt;quartz:endpoint-polling-job&gt; &lt;quartz:job-endpoint ref="SftpEndpoint" /&gt; &lt;/quartz:endpoint-polling-job&gt; &lt;/quartz:inbound-endpoint&gt; &lt;file:outbound-endpoint ref="FileEndpoint" outputPattern="#[header:originalFilename]" /&gt; &lt;/flow&gt; </code></pre>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. USDavid
    1. USDavid
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. This table or related slice is empty.
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload