Databases
StackOverflow2013
Postsdbo
POCan I avoid handling a file twice if I need the number of lines and I need to append to the file?
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POCan I avoid handling a file twice if I need the number of lines and I need to append to the file?
    primarykey
    data
    text
    <p>I am writing a file to disk in stages. As I write it I need to know the line numbers that I am writing to use to build an index. The file now has 12 million lines so I need to build the index on the fly. I am doing this in four steps, with four groupings of the value that I am indexing on. Based on some examples I found elsewhere on SO I decided that to keep my functions as clean as possible I would get the linesize of the file before I start writing so I can use that count to continue to build my index.</p> <p>So I have run across this problem, theoretically I don't know if I am adding the first chunk or the last chunk to my file so I thought to get the current size I would</p> <pre><code>myFile=open(r'C:\NEWMASTERLIST\FULLLIST.txt','a') try: num_lines=sum(1 for line in myFile) except IOError: num_lines=0 </code></pre> <p>When I do this the result is always 0-even if myFile exists and has a num_lines >0</p> <p>If I do this instead:</p> <pre><code>myFile=open(r'C:\NEWMASTERLIST\FULLLIST.txt') try: num_lines=sum(1 for line in myFile) except IOError: num_lines=0 </code></pre> <p>I get the correct value iff myFile exists. byt if myFile does not exist, if I am on the first cycle, I get an error message. </p> <p>As I was writing out this question it occurred to me that the reason for the value num_lines=0 on every case the file exists is because the file is being opened for appending to so the file is opened at the last line and is now awaiting for lines to be delivered. So this fixes the problem</p> <pre><code>try: myFile=open(r'C:\NEWMASTERLIST\FULLLIST.txt') num_lines=sum(1 for line in myFile) except IOError: num_lines=0 </code></pre> <p>My question is whether or not this can be done another way. The reason I ask is because I have to now close myFile and reopen it for appending:</p> <p>That is to do the work I need to do now that I have the ending index number for the data that is already in the file I have to </p> <pre><code>myFile.close() myFile=open(r'C:\NEWMASTERLIST\FULLLIST.txt','a') </code></pre> <p>Now, here is where maybe I am learning something- given that I have to open the file twice then maybe getting the starting index (num_lines) should be moved to a function</p> <pre><code>def getNumbLines(myFileRef): try: myFile=open(myFileRef) num_lines=sum(1 for line in myFile) myFile.close() except IOError: num_lines=0 return num_lines </code></pre> <p>It would be cleaner if I did not have to open/handle the file twice.</p> <p>Based on Eric Wendelin's answer I can just do:</p> <pre><code>myFile=open(r'C:\NEWMASTERLIST\FULLLIST.txt','a+') num_lines=sum(1 for line in myFile) </code></pre> <p>Thanks</p>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. USPyNEwbie
    1. USPyNEwbie
    plurals
    1. PL
      singulars
      1. LTLinked
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    2. PO
      singulars
      1. PTAnswer
    3. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POCan I avoid handling a file twice if I need the number of lines and I need to append to the file?
      1. This table or related slice is empty.
      1. VTUpMod
    2. VO
      singulars
      1. POCan I avoid handling a file twice if I need the number of lines and I need to append to the file?
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. POCan I avoid handling a file twice if I need the number of lines and I need to append to the file?
      1. USpufferfish
      1. VTFavorite
    1. COSearching google for a better way to count lines in python I reached this http://stackoverflow.com/questions/845058/how-to-get-line-count-cheaply-in-python.
      singulars
      1. POCan I avoid handling a file twice if I need the number of lines and I need to append to the file?
      1. USMacarse
    2. COI was wondering if that was the best way to count lines, but figured I'd go with the original question to avoid confusing the issue with a different count.
      singulars
      1. POCan I avoid handling a file twice if I need the number of lines and I need to append to the file?
      1. USErik
    3. COMy solution for line counting was based on that question
      singulars
      1. POCan I avoid handling a file twice if I need the number of lines and I need to append to the file?
      1. USPyNEwbie
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload