Databases
StackOverflow2013
Postsdbo
POtwisted not sending entire file with twisted client and server tcp transfer
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POtwisted not sending entire file with twisted client and server tcp transfer
    primarykey
    data
    text
    <p>Edit: since I was appending via text the file was not being saved properly, I decided to rewrite the way I originally was hoping to and save the file as a stream instead: Twisted server: </p> <pre><code>from twisted.internet import reactor, protocol import os,json class Echo(protocol.Protocol): f = file def dataReceived(self, data): try: try: print format(json.loads(data)) print "got jason" self.f=open("test.png","wb") self.transport.write("ready") except: print "filedata incoming!" self.f.write(data) except: print "unknown error" #happens if we don't receive json first def connectionLost(self, reason): if self.f!=file:self.f.close() def main(): """This runs the protocol on port 8000""" factory = protocol.ServerFactory() factory.protocol = Echo reactor.listenTCP(8000,factory) reactor.run() # this only runs if the module was *not* imported if __name__ == '__main__': main() </code></pre> <hr> <h2>original post below</h2> <p>Twisted sends like 99.9% of the file and then that seems to be it, I'm thinking I am writing the file incorrectly.</p> <p>Twisted Server:</p> <pre><code>from twisted.internet import reactor, protocol import os,json class Echo(protocol.Protocol): def dataReceived(self, data): try: print format(json.loads(data)) print "got jason" self.transport.write("ready") except: print "filedata incoming!" f = open("test.png","a") f.write(data) f.close() def main(): """This runs the protocol on port 8000""" factory = protocol.ServerFactory() factory.protocol = Echo reactor.listenTCP(8000,factory) reactor.run() # this only runs if the module was *not* imported if __name__ == '__main__': main() </code></pre> <p>Twisted Client:</p> <pre><code>from twisted.internet import reactor, protocol import os,json fname="pic.png" class EchoClient(protocol.Protocol): """Once connected, send a message, then print the result.""" def connectionMade(self): fsize = os.path.getsize(fname) self.transport.write(json.dumps({"file":{"size":fsize}})) def sendFile(self): print "sending file" f = open(fname,"rb") self.transport.write(f.read()) f.close() print "closing conn" self.transport.loseConnection() def dataReceived(self, data): "As soon as any data is receive" print "Server said: ", data self.sendFile() def connectionLost(self, reason): print "connection lost" class EchoFactory(protocol.ClientFactory): protocol = EchoClient def clientConnectionFailed(self, connector, reason): print "Connection failed - goodbye!" reactor.stop() def clientConnectionLost(self, connector, reason): print "Connection lost - goodbye!" reactor.stop() # this connects the protocol to a server runing on port 8000 def main(): f = EchoFactory() reactor.connectTCP("localhost", 8000, f) reactor.run() # this only runs if the module was *not* imported if __name__ == '__main__': main() </code></pre> <p>Basically the server is running and listening, the client connects and immediately sends json, server receives packet and tells send client the 'ok', the client then sends the file; then the server receives the file and writes it to disk. I'm just testing things out so this program might not make much sense, especially the use of file append-- but I noticed that after the transfer and final write the file is just about the same size as the original, but not quite and is smaller by about 300 bytes and therefore just about useless. Am I sending the file incorrectly? Or just writing it incorrectly? Oh yea, I'm testing the server and client on the same computer.</p> <p>Ultimately I plan on sending files as large as 1GB to and from two local computers for backup purposes and want the files to be written as a stream of data, I don't like the append method I'm using but I don't know how to reference the file object without actually opening the file first, and that's something I only want to do when I first receive the json object.</p> <p>Thanks!</p>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. USscape
    1. USscape
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    2. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POtwisted not sending entire file with twisted client and server tcp transfer
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. POtwisted not sending entire file with twisted client and server tcp transfer
      1. This table or related slice is empty.
      1. VTUpMod
    1. This table or related slice is empty.
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload