StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

PO
text
Body
copied!<p>I setup directory structure with the following locally:</p> <pre><code>for i in $(seq 1 4500); do if [[ $i -lt 100 ]]; then dir="$(for j in $(seq 1 $i); do echo -n $i/;done)" mkdir -p "$dir" touch ${dir}$i else touch $i fi done </code></pre> <p>This creates 99 files with paths that are 1-99 levels deep and 4401 files in the root of the directory structure.</p> <p>I used the following ruby script:</p> <pre><code>#!/usr/bin/env ruby require 'benchmark' def recursive(path, bench) bench.report(path) do Dir["#{path}/**/**"] end end path = 'files' Benchmark.bm {|bench| recursive(path, bench)} </code></pre> <p>I got the following result:</p> <pre><code> user system total real files/ 0.030000 0.090000 0.120000 ( 0.108562) </code></pre> <p>I use the following python script using os.walk:</p> <pre><code>#!/usr/bin/env python import os import timeit def path_recurse(path): for (path, dirs, files) in os.walk(path): for folder in dirs: yield '{}/{}'.format(path, folder) for filename in files: yield '{}/{}'.format(path, filename) if __name__ == '__main__': path = 'files' print(timeit.timeit('[i for i in path_recurse("'+path+'")]', setup="from __main__ import path_recurse", number=1)) </code></pre> <p>I got the following result:</p> <pre><code> 0.250478029251 </code></pre> <p>So, it looks like ruby is still performing better. It'd be interesting to see how this one performs on your fileset on the network share.</p> <p>It would probably also be interesting to see this script run on python3 and with jython and maybe even with pypy.</p>

Querying!

Guidance

An individual column

Larger individual text columns get their own page to allow for proper reading.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload