Databases
StackOverflow2013
Postsdbo
POSSL Connections Issues when running Unit Tests from the command line
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POSSL Connections Issues when running Unit Tests from the command line
    primarykey
    data
    text
    <h2>Goal</h2> <p>Our goal is to execute our Unit Tests within a Continuous Integration environment (<a href="http://jenkins-ci.org" rel="nofollow noreferrer" title="Jenkins CI">Jenkins</a>)</p> <p>(I believe it is essential for every question to state what exactly one is trying to achieve. Maybe the problem can actually be solved a very different way)</p> <h3>Update: More on "Why do you want to do this?"</h3> <p>Firstly, we are talking to specific, self-developed hardware. And I would like the Continuous <em>Integration</em> Test to tell me if anyone changed the behavior of the box without telling all the developers (Yes, yes, I know, such things <em>never</em> happen …)</p> <p>Secondly, some (not all) of our connections use certificates which are not valid by default, so we have code to check the validity of the certificate (<code>SecTrustEvaluate</code> etc.). Ideally of course, our tests would test that code, too. But that seems too much to ask.</p> <p>Thirdly: Well, why should I mock anything if I can have the real deal? The IDE has no issue with that, why should the command line.</p> <p>And if I wanted predictability, I'd return <code>YES</code> in all my tests ;) (and I <em>have</em> seen people do that). No, I want to know if the code actually and really works with our device. Is that some sort of perverted desire?</p> <h2>Problem resolved so far</h2> <p>Running tests from the command line sounds pretty straighforward, but</p> <pre><code>xcodebuild -sdk iphonesimulator ONLY_ACTIVE_ARCH=NO clean test </code></pre> <p>results in an ugly error:</p> <pre><code>unsupported build action 'test' </code></pre> <p>So I searched the web and found this article on <a href="http://www.raingrove.com/2012/03/28/running-ocunit-and-specta-tests-from-command-line.html" rel="nofollow noreferrer" title="Running OCUnit Tests from Command Line">Running OCUnit Tests from Command Line</a>.</p> <p>I followed all the steps, and I can run my tests from the command line like this:</p> <pre><code>xcodebuild -scheme CITests -sdk iphonesimulator TEST_AFTER_BUILD=YES ONLY_ACTIVE_ARCH=NO clean build </code></pre> <h2>Remaining Problem</h2> <p>However, now any NSURLConnection to an SSL Server will fail, because "The certificate for this server is invalid.". I have heared about keychain issues when running tests from the command line, but can this be true? Any SSL connection is refused?</p> <h2>To Reproduce</h2> <p>Get the sample at <a href="https://github.com/below/SSLTestDemo" rel="nofollow noreferrer">https://github.com/below/SSLTestDemo</a>. Open it up, and run the sample test using Xcode's own <strong>Test ⌘U</strong> command. The test should succeed.</p> <p>Now run the test on the command line:</p> <pre><code>xcodebuild -scheme CITests -sdk iphonesimulator TEST_AFTER_BUILD=YES ONLY_ACTIVE_ARCH=NO clean build </code></pre> <p>The test fails due to the "The certificate for this server is invalid." error.</p> <h2>Any Pointers?</h2> <ul> <li>Am I doing it wrong? </li> <li>Is this a genuine bug? </li> <li>If so, are there workaroungs?</li> </ul> <p>Any input is appreciated!</p>
    singulars
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PTQuestion
    1. USbelow
    1. USbelow
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    2. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POSSL Connections Issues when running Unit Tests from the command line
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. POSSL Connections Issues when running Unit Tests from the command line
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. POSSL Connections Issues when running Unit Tests from the command line
      1. This table or related slice is empty.
      1. VTUpMod
    1. COMh why do you unit test with network connection? Normally you mock such things for more predictable outcome and eliminate the external dependencies.
      singulars
      1. POSSL Connections Issues when running Unit Tests from the command line
      1. USPfitz
    2. COSee my addendum above
      singulars
      1. POSSL Connections Issues when running Unit Tests from the command line
      1. USbelow
    3. COto answer your question, "why mock when you can have the real thing": You want to eliminate variables. If you actually connect to the device in the unit test a test failure could result from any number of things other than a code commit. Such as the device is powered of, not connected to the network. Not to say these tests have no value, but they're not unit tests.
      singulars
      1. POSSL Connections Issues when running Unit Tests from the command line
      1. USthekbb
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload