StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

PO
text
Body
copied!<p>I have similar problem that you face, common issues are: - Different response time of Resources URLs ( as you may call them clients ) - The Demand of adding new URL you add one or ten at once. </p> <p>In addition to commons, my other observations:- - URL from different services providers, - with different data format - and they require different type of requests for what you want.</p> <p>I have reviewed couple of PHP-cURL libraries: </p> <ul> <li>Rolling-Curl and Perallel-Curl , <a href="https://stackoverflow.com/questions/10485199/php-parallel-curl-performance-rollingcurl-vs-parallelcurl?rq=1">covered in this article</a> . </li> <li><a href="https://github.com/jmathai/php-multi-curl" rel="nofollow noreferrer">PHP-Multi-curl (epiCurl)</a> , this one I prefer.</li> <li>multi-curl-php, <a href="http://code.google.com/p/multi-curl-php/source/browse/trunk/multi-curl-test.php" rel="nofollow noreferrer">code example</a> . </li> <li>phpmulticurl, <a href="http://code.google.com/p/phpmulticurl/source/browse/trunk/examples/example.php" rel="nofollow noreferrer">Code Exmaple</a> . </li> <li>and there are other libraries and classes...</li> </ul> <p>Now managing the the database and clients' send requests, you will at least well know RDBMS such MySQL or SQLite, <em>other options RDBMS are considered</em>.</p> <ul> <li>In the RDBMS create a table that contains requests as in { "clientNo" => "URL" }</li> <li>You can add your list of clients using PHPmyAdmin or any database management interface.</li> <li>The Script: create a script that fetch the whole entry of database, one by one within foreach loop; preform creation on CURL node and adding handler to queue of multiple CURl calls.</li> <li>test your script, and for production add it to cronjob. </li> <li>every time you have to add a client , just add him to RDBMS (MySQL, SQLite ) using database management interface.</li> </ul> <p>NOTE: if you are doing outbound management, you have to consider security issues, proxy; and possible create PHP and HTML form for submitting new clients.</p>

Querying!

Guidance

An individual column

Larger individual text columns get their own page to allow for proper reading.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload