Databases
StackOverflow2013
Postsdbo
POWill running everything from RAM disk speed up scala compile time?
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POWill running everything from RAM disk speed up scala compile time?
    primarykey
    data
    text
    <p>Scenario:</p> <p>The machine I use for development have 32Gb of DDR3 RAM, i7 3770, SSD. The project is large, Scala compiles fast most of the time during incremental compilation but sometimes a single change leads to recompilation of hundreds of files, it then take some time to compile all and some good time for jrebel to reload all changed files.</p> <p>Question:</p> <p>Will putting everything on a RAMFS (Mac) make compile and jrebel reload significantly faster?</p> <p>My plan was to put everything directly related to the project in a RAMFS partition ( .ivy, project source, .sbt, maybe even copy JDK. etc). I would create a script to do all that in the boot or manually, that won't be a problem. Also, I would setup file sync tasks, so, losing a change won't be a concern in case of a OS failure.</p> <p>Updates:</p> <ol> <li>log says around 400 among java and scala sources are compiled after a clean.</li> <li>after changing a file in a core module, it recompiles 130 files in 50s.</li> <li>jrebel takes 72s to reload after #1 and 50s after #2</li> <li>adding -Drebel.check_class_hash=true made jrebel reload instantaneous after #2.</li> </ol> <p>I am quite happy with these results, but still interested on how to make scala compilation even faster, since cpu usage gets at most 70% for just about 5 seconds in compilation process that takes 170s, overall cpu usage during the compilation is 20%.</p> <p>UPDATE:</p> <p>After putting JVM, source, .ivy2 and .sbt folders on RAMDISK, I noticed a small improvement on compile time only: from 132s to 122s ( after a clean). So, not worth the trouble.</p> <p>NOTE:</p> <p>That is excluding the dependency resolution, since I using <a href="https://stackoverflow.com/questions/17190755/why-sbt-runs-dependency-resolution-every-time-after-clean">this approach</a> to avoid losing dependency resolution after a clean.</p>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. USCommunity
    1. USJohnny Everson
    plurals
    1. PL
      singulars
      1. LTLinked
    2. PL
      singulars
      1. LTLinked
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    2. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POWill running everything from RAM disk speed up scala compile time?
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. POWill running everything from RAM disk speed up scala compile time?
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. POWill running everything from RAM disk speed up scala compile time?
      1. This table or related slice is empty.
      1. VTUpMod
    1. COWhat happens if the computer crashes? Can you split your project up into components and develop them individually, so that you don't have hundreds of lines? I.e. each component is developed and unit tested and then built and referenced as a JAR rather than a project with sources.
      singulars
      1. POWill running everything from RAM disk speed up scala compile time?
      1. USAnt Kutschera
    2. CO1. will setup a task to backup source files every minute or so. 2. Changing the project structure is not an option.
      singulars
      1. POWill running everything from RAM disk speed up scala compile time?
      1. USJohnny Everson
    3. COWhat's your IDE? Do you have FSC enabled? IntelliJ instructions http://blog.jetbrains.com/scala/2011/10/05/real-fsc-support/ This gave me the most significant compiler performance increase. I'm not really sure marginal gains from ramdisk will offset any headaches in setting up/maintaining it. Might still be fun to try (and roll out a tidy tool for). I did something similar with a large Java project on windows 7 in the past, with little noticeable improvement (SSD already bridged most the gap).
      singulars
      1. POWill running everything from RAM disk speed up scala compile time?
      1. USJason Dunkelberger
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload