StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

POHow to optimize upload routine using Delphi 2010?
primarykey
Id
9476744
data
AcceptedAnswerId
9492180
AnswerCount
1
ClosedDate
CommentCount
4
CommunityOwnedDate
CreationDate
2012-02-28T05:13:11.807
FavoriteCount
1
LastActivityDate
2014-11-30T14:18:29.843
LastEditDate
2014-11-30T14:18:29.843
LastEditorUserId
1816580
OwnerUserId
1165880
ParentId
0
PostTypeId
1
Score
7
ViewCount
1372
LastEditorDisplayName
text
Body
My yet to be released Delphi 2010 application allows users to upload their files to my servers. Right now I'm using HTTPS POST to send the files, the (simplified) algorithm is basically: <ol> <li>Split File into "slices" (256KB each)</li> <li>For each slice, POST it to server</li> </ol> ie. for a 1MB file: <pre><code>--> Get Slice #1 (256KB) --> Upload Slice #1 using TidHTTP.Post() --> Get Slice #2 (256KB) --> Upload Slice #2 using TidHTTP.Post() --> Get Slice #3 (256KB) --> Upload Slice #3 using TidHTTP.Post() --> Get Slice #4 (256KB) --> Upload Slice #4 using TidHTTP.Post() </code></pre> I'm using Indy 10. I (ab)used my profiler over and over and there are not much left to optimize except changing the upload routine itself. I'm also using multi-threading, and even though I did my best to optimize my code, my benchmarks still tell me I can do better (there are other well optimized software that do achieve a much better timing...almost twice as fast as my upload routine!) I know it's not my server's fault...here are the ideas that I still need to explore: <ol> <li>I tried grouping slices in a single POST, naturally this resulted in a performance boost (20-35%) but resuming capability is now reduced.</li> <li>I also thought about using SFTP / SSH, but I'm not sure if it's fast.</li> <li>Use web sockets to implement resumable upload (like <a href="http://code.google.com/p/delphionrails/">this component</a>), I'm not sure about speed either.</li> </ol> Now my question is: is there something I can do to speed up my upload? I'm open to any suggestion that I can implement, including commandline tools (if license allows me to ship it with my application), provided that: <ol> <li>Resumable upload is supported</li> <li>Fast!</li> <li>Reasonable memory usage</li> <li>Secure & allow login/user authentication</li> </ol> Also, because of major security concerns, FTP is a not something I'd want to implement. Thanks a lot!
Tags
<performance><delphi><upload><indy><resume-upload>
Title
How to optimize upload routine using Delphi 2010?
singulars
PostAcceptedAnswerId
1. PO
 singulars
 PostTypePostTypeId
 PTAnswer
PostParentId
1. This table or related slice is empty.
PostTypePostTypeId
1. PTQuestion
UserLastEditorUserId
1. USArtjom B.
UserOwnerUserId
1. USTheDude
plurals
PostLinksPostIdRelatedPostId
1. PL
 singulars
 LinkTypeLinkTypeId
 LTLinked
PostLinksRelatedPostIdPostId
1. PL
 singulars
 LinkTypeLinkTypeId
 LTLinked
PostsAcceptedAnswerId
1. This table or related slice is empty.
PostsParentIdCreationDate
1. PO
 singulars
 PostTypePostTypeId
 PTAnswer
VotesPostIdCreationDate
1. VO
 singulars
 PostPostId
 POHow to optimize upload routine using Delphi 2010?
 UserUserId
 This table or related slice is empty.
 VoteTypeVoteTypeId
 VTUpMod
2. VO
 singulars
 PostPostId
 POHow to optimize upload routine using Delphi 2010?
 UserUserId
 This table or related slice is empty.
 VoteTypeVoteTypeId
 VTUpMod
3. VO
 singulars
 PostPostId
 POHow to optimize upload routine using Delphi 2010?
 UserUserId
 This table or related slice is empty.
 VoteTypeVoteTypeId
 VTUpMod
CommentsPostId

Querying!

Guidance

A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.