Databases
StackOverflow2013
Postsdbo
POimproving speed of Python module import
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POimproving speed of Python module import
    primarykey
    data
    text
    <p>The question of how to speed up importing of Python modules has been asked previously (<a href="https://stackoverflow.com/questions/2010255/speeding-up-the-python-import-loader">Speeding up the python &quot;import&quot; loader</a> and <a href="https://stackoverflow.com/questions/6025635/python-speed-up-imports">Python -- Speed Up Imports?</a>) but without specific examples and has not yielded accepted solutions. I will therefore take up the issue again here, but this time with a specific example. </p> <p>I have a Python script that loads a 3-D image stack from disk, smooths it, and displays it as a movie. I call this script from the system command prompt when I want to quickly view my data. I'm OK with the 700 ms it takes to smooth the data as this is comparable to MATLAB. However, it takes an additional 650 ms to import the modules. So from the user's perspective the Python code runs at half the speed.</p> <p>This is the series of modules I'm importing:</p> <pre><code>import numpy as np import matplotlib.pyplot as plt import matplotlib.animation as animation import scipy.ndimage import scipy.signal import sys import os </code></pre> <p>Of course, not all modules are equally slow to import. The chief culprits are:</p> <pre><code>matplotlib.pyplot [300ms] numpy [110ms] scipy.signal [200ms] </code></pre> <p>I have experimented with using <code>from</code>, but this isn't any faster. Since Matplotlib is the main culprit and it's got a reputation for slow screen updates, I looked for alternatives. One is PyQtGraph, but that takes 550 ms to import. </p> <p>I am aware of one obvious solution, which is to call my function from an interactive Python session rather than the system command prompt. This is fine but it's too MATLAB-like, I'd prefer the elegance of having my function available from the system prompt. </p> <p>I'm new to Python and I'm not sure how to proceed at this point. Since I'm new, I'd appreciate links on how to implement proposed solutions. Ideally, I'm looking for a simple solution (aren't we all!) because the code needs to be portable between multiple Mac and Linux machines. </p>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. USCommunity
    1. USRAAC
    plurals
    1. PL
      singulars
      1. LTLinked
    2. PL
      singulars
      1. LTLinked
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POimproving speed of Python module import
      1. USRAAC
      1. VTFavorite
    2. VO
      singulars
      1. POimproving speed of Python module import
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. POimproving speed of Python module import
      1. UShek2mgl
      1. VTFavorite
    1. COCheck that it's producing .pyc versions of the Python modules - loading those is a bit faster. But those numbers are quite plausible even if the pyc files are there.
      singulars
      1. POimproving speed of Python module import
      1. USThomas K
    2. COAlso, if you have a lot of .egg directories on `sys.path`, it looks for modules inside each one, which slows things down. Use a distribution package manager or pip to install them in a better layout. You're unlikely to get a major speed up, though.
      singulars
      1. POimproving speed of Python module import
      1. USThomas K
    3. COI had noticed the pyc suggestion in an earlier question, but I don't know where to look for the pyc versions of the modules. Right now I'm on a Mac.
      singulars
      1. POimproving speed of Python module import
      1. USRAAC
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload