StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

PO
text
Body
copied!<p>I wouldn't recommend Amazon S3 for this. Amazon S3 is used for efficiently distributing files across the web. But if your whole purpose is to just read these files inside a VM - then saving these in S3 is not the correct choice. Refer to <a href="https://stackoverflow.com/questions/10801158/how-stable-is-s3fs-to-mount-an-amazon-s3-bucket-as-a-local-directory">this answer</a> for more details.</p> <p>To answer your question, <a href="http://www.turnkeylinux.org/blog/exploring-s3-based-filesystems-s3fs-and-s3backer" rel="nofollow noreferrer">yes it is possible to mount an S3 bucket</a> as a folder inside your server using <a href="https://code.google.com/p/s3fs/" rel="nofollow noreferrer">S3FS</a>. Here are instructions for <a href="http://zentraal.com/docs/installing-s3fs-on-ubuntu" rel="nofollow noreferrer">Ubuntu</a> and <a href="http://www.idevelopment.info/data/AWS/AWS_Tips/AWS_Management/AWS_20.shtml" rel="nofollow noreferrer">Red Hat</a>.</p> <p>But other ideal approaches are:</p> <ul> <li><p>If you don't have enough space in the hard disk, then install Moses server on a different partition, format it using BTRFS and enable <a href="https://help.ubuntu.com/community/btrfs#Adding_Filesystem_Compression" rel="nofollow noreferrer">Transparent Compression</a>. This will automatically compress/decompress files when you save/retrieve from the hard disk, so you will end up using much much less space. Also in a lot of benchmarks, Transparent Compression is shown to be faster, since lesser amount of data is transferred between hard disk and RAM. Specially when involving large files.</p></li> <li><p>You can always <a href="http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ebs-attaching-volume.html" rel="nofollow noreferrer">attach a secondary EBS disk</a> to your running VM (like a secondary hard disk). Use that for storing the translations/models (and you can also combine enable transparent compression as above too)</p></li> <li><p>Run a separate VM without EBS, and just using the normal instance storage, and use that to store the translations alone. Now in your Moses server, you can mount the translations alone from this separate non-EBS VM using <a href="https://help.ubuntu.com/community/SSHFS" rel="nofollow noreferrer">SSHFS</a></p></li> </ul> <p>Overall, don't use S3, there are other much better ways.</p> <p>Edit: Added link</p>

Querying!

Guidance

An individual column

Larger individual text columns get their own page to allow for proper reading.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload