Databases
StackOverflow2013
Postsdbo
POHTTP 504 when processing uploaded zip of images
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POHTTP 504 when processing uploaded zip of images
    primarykey
    data
    text
    <p>I am new to web development, and I am working on a basic image gallery app (learning exercise) using Django. I have it set up so I can upload a zip full of images all at once to create a new album. This all seems to work OK, but I am getting an HTTP 504 error when the uploaded file is especially large.</p> <p>I gather (please correct me if I am wrong) this error means my app is too slow to return an HTTP response. I am guessing this is because it takes a long time to unzip and process (create a Pic object in the DB and create thumbnails) all the images.</p> <p>Is there a way to return a response (say to some intermediate page) while still performing the processing in the background - maybe using threads? What is the proper way to handle this? Is it time for me to start learning Javascript/AJAX?</p> <p>Thank you!</p> <hr> <h3>Models:</h3> <pre><code>from django.db import models from blog.models import Post class Album(models.Model): title = models.CharField(max_length=128) slug = models.SlugField() description = models.TextField() parent = models.ForeignKey('self', null=True, blank=True) pub = models.BooleanField() date_created = models.DateTimeField(auto_now_add=True) date_published = models.DateTimeField(null=True, blank=True) date_modified = models.DateTimeField(auto_now=True) def __unicode__(self): return self.title class Pic(models.Model): image = models.ImageField(upload_to='pics/%Y/%m') title = models.CharField(max_length=128) caption = models.TextField(blank=True, null=True) albums = models.ManyToManyField('Album', null=True, blank=True) posts = models.ManyToManyField(Post, blank=True, null=True) date_taken = models.DateTimeField(null=True, blank=True) date_uploaded = models.DateTimeField(auto_now_add=True) date_modified = models.DateTimeField(auto_now=True) def __unicode__(self): return self.title </code></pre> <h3>View:</h3> <p><sub>I'm doing this manually because I didn't grok the Django admin when I started. I think it might be better to use admin customization here.</sub></p> <pre><code>def new_album(request): if request.method == "POST": form = AlbumForm(request.POST, request.FILES) if form.is_valid(): from gallery.pic_handlers import handle_uploaded_album pics = handle_uploaded_album(request.FILES['pic_archive']) a = form.save() a.slug = slugify(a.title) a.save() for pic in pics: pic.albums.add(a) return HttpResponseRedirect('/gallery/album/%s/' % a.slug) else: form = AlbumForm() return render_to_response('new_album.html', { 'form' : form, }, context_instance = RequestContext(request)) </code></pre> <h3>Additional processing:</h3> <pre><code>def handle_uploaded_album(pic_archive): destination = open(join(settings.MEDIA_ROOT,pic_archive.name), 'wb+') for chunk in pic_archive.chunks(): destination.write(chunk) destination.close() today = datetime.date.today() save_path = 'pics/{0}/{1:02}/'.format(today.year, today.month) tmp_path = 'tmp/' z = zipfile.ZipFile(join(settings.MEDIA_ROOT,pic_archive.name), 'r') pics = [] for member in z.namelist(): if '/' in member or '\\' in member: # don't deal with any directories inside the zip # this also solves the '__MACOSX' issue continue if splitext(member)[1] in IMG_EXT: z.extract(member,join(settings.MEDIA_ROOT,tmp_path)) im = File(open(join(settings.MEDIA_ROOT,tmp_path,member), 'rb')) # create a Pic from this file pic = Pic() pic.title = member pic.image.save( join(save_path, member), im, True) create_thumbnails(pic) im.close() # remove extracted images remove(join(settings.MEDIA_ROOT,tmp_path,member)) # TODO: save date taken if available pics.append(pic) z.close() remove(join(settings.MEDIA_ROOT,pic_archive.name)) return pics def create_thumbnails(pic): fname, ext = splitext(pic.image.path) img = Image.open(pic.image.path) img.thumbnail((512,512), Image.ANTIALIAS) img.save(fname + '_m' + ext) img.thumbnail((128,128), Image.ANTIALIAS) img.save(fname + '_s' + ext) </code></pre>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. This table or related slice is empty.
    1. USaganders3
    plurals
    1. PL
      singulars
      1. LTLinked
    2. PL
      singulars
      1. LTLinked
    3. PL
      singulars
      1. LTLinked
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    2. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POHTTP 504 when processing uploaded zip of images
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. POHTTP 504 when processing uploaded zip of images
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. POHTTP 504 when processing uploaded zip of images
      1. This table or related slice is empty.
      1. VTUpMod
    1. This table or related slice is empty.
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload