Note that there are some explanatory texts on larger screens.

plurals
  1. PO
    primarykey
    data
    text
    <p>Both of your options use the same method: Apache Sqoop's Export utility. Using the licensed Microsoft connector/driver jar should expectedly yield more performance for the task than using a generic connector offered by Apache Sqoop.</p> <p>In terms of maintenance, there should be none once you have it working fine. So long as the version of SQL Server in use is supported by the driver jar, it should continue to work as normally expected of it.</p> <p>In terms of configuration, you may initially have to manually tune to find the best <code>-m</code> value for parallelism of your Export MapReduce job launched by the export tool. Using a too high value would cause problems on the DB side, while using a too low value would not give you ideal performance. Some trial and error is required here to arrive at the right <code>-m</code> value, along with knowledge of the load periods of your DB, in order to set the parallelism right.</p> <p>The Apache Sqoop (v1) <a href="http://sqoop.apache.org/docs/1.4.3/SqoopUserGuide.html#_literal_sqoop_export_literal" rel="nofollow">doc page</a> for users of the export tool also lists down a set of common reasons for the failure of the export job. You may want to <a href="http://sqoop.apache.org/docs/1.4.3/SqoopUserGuide.html#_failed_exports" rel="nofollow">view those here</a>.</p> <p>On the MapReduce side, you may also want to dedicate a defined scheduler pool or queue for such external-writing jobs as they may be business critical, and schedulers like <code>FairScheduler</code> and <code>CapacityScheduler</code> help define SLA guarantees on each pool or queue such that the jobs get adequate resources to run when they're launched.</p>
    singulars
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. VO
      singulars
      1. This table or related slice is empty.
    2. VO
      singulars
      1. This table or related slice is empty.
    3. VO
      singulars
      1. This table or related slice is empty.
    1. This table or related slice is empty.
 

Querying!

 
Guidance

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload