Databases
StackOverflow2013
Postsdbo
POHanging on rake db:migrate ts:conf
Body
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POHanging on rake db:migrate ts:conf
    text
    copied!<p>I have Jenkins running a deploy script on all of our app machines. Lately, half my builds don't finish and keep hanging while trying to run the same thing. The last of the output looks like this:</p> <pre><code> ** [app@app1 :: stdout] Generating Configuration to /var/www/app/releases/20130509192657/config/production.sphinx.conf ** [app@app2 :: stdout] Generating Configuration to /var/www/app/releases/20130509192657/config/production.sphinx.conf ** [app@app3 :: stdout] Generating Configuration to /var/www/app/releases/20130509192657/config/production.sphinx.conf ** [app@app4 :: stdout] Generating Configuration to /var/www/app/releases/20130509192657/config/production.sphinx.conf ** [app@app6 :: stdout] Generating Configuration to /var/www/app/releases/20130509192657/config/production.sphinx.conf ** [app@app7 :: stdout] Generating Configuration to /var/www/app/releases/20130509192657/config/production.sphinx.conf </code></pre> <p>app5 is always the machine that seems to have this problem, and it occurs when it tries to run:</p> <pre><code>/usr/local/bin/ruby /usr/local/bin/bundle exec rake db:migrate ts:conf </code></pre> <p>Production is running ruby 1.9.3p194, and due to legacy reasons we're still running ThinkingSphinx v. 0.9.8. We're also running Rails 3.2.13 and ThinkingSphinx 2.0.7.</p> <p>Running strace on the hanging process shows me this:</p> <pre><code>... 29802 select(4, [3], NULL, NULL, NULL &lt;unfinished ...&gt; 29790 restart_syscall(&lt;... resuming interrupted call ...&gt;) = -1 ETIMEDOUT (Connection timed out) 29790 futex(0x64a88e8, FUTEX_WAKE_PRIVATE, 1) = 0 29790 write(4, "!", 1 &lt;unfinished ...&gt; 29802 &lt;... select resumed&gt; ) = 1 (in [3]) 29790 &lt;... write resumed&gt; ) = 1 29802 read(3, &lt;unfinished ...&gt; 29790 futex(0x1d47f64, FUTEX_WAIT_PRIVATE, 3, NULL &lt;unfinished ...&gt; 29802 &lt;... read resumed&gt; "!", 1024) = 1 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) 29802 select(4, [3], NULL, NULL, {0, 100000}) = 0 (Timeout) ... </code></pre> <p>Has anyone ever seen this before? Not having too much of a background in sysops, is there a specific approach I should be taking in trying to tackle this problem?</p>
 

Querying!

 
Guidance
An individual column

Larger individual text columns get their own page to allow for proper reading.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload