Note that there are some explanatory texts on larger screens.

plurals
  1. POWhat does Disco's "Could not parse worker event:" error mean?
    primarykey
    data
    text
    <p>I'm trying to run a Disco job using map and reduce functions that are deserialized after being passed over a TCP socket using the <code>marshal</code> library. Specifically, I'm unpacking them with</p> <pre><code>code = marshal.loads(data_from_tcp) func = types.FunctionType(code, globals(), "func") </code></pre> <p>I've already tested plain Disco jobs (with locally defined functions) on the same system, and they work fine. However, when I run a Disco job with the new functions, the jobs keep failing and I keep getting the error message <code>localhost WARNING: [map:0] Could not parse worker event: invalid_length</code></p> <p>I've searched the documentation, and there is no mention that I could find of a "worker event", or of an <code>invalid_length</code>. After doing a grep on the source code, I find a single instance of the phrase "Could not parse worker event:", specifically in the file <code>master/src/disco_worker.erl</code>. I'm not familiar with Erlang, and have no idea how this works.</p> <p>What is causing this problem? Should I do something else to circumvent it?</p> <p>EDIT: After more debugging, I've realized that this error is tied to my use of the string.split() method inside my test-case function. Whenever it is used (even on strings that are not part of the input), this error is raised. I've verified that the method does exist on the object, but calling it seems to cause problems. Any thoughts?</p> <p>EDIT 2: In addition, any use of the re.split function achieves the same effect.</p> <p>EDIT 3: It appears that calling any string function on the input string in the map function creates this same error.</p>
    singulars
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
 

Querying!

 
Guidance

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload