Databases
StackOverflow2013
Postsdbo
POPython: divide an array into section
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POPython: divide an array into section
    primarykey
    data
    text
    <p><strong>Update: I managed to fix the issue with the help of Jeremy's function that break my data set in to 50 chunks. I have posted the final answer.</strong></p> <p>I have the following code the reason I want to break the array into chunks is that I am trying to use an api that only allows 50 requests at a time. Also I am java developer who is trying to move to python. What I want to do is break the array into 50 chunks and feed them to the api. </p> <p>I have a text file that has long list of Ids, I and based on the Id that i read in I am constructing the URL.</p> <pre><code>import simplejson as json import sys import urllib import traceback, csv, string # "base" API URL URL_BASE = 'Some URL' # set user agent string urllib.version = "Data Collection Fix it" page_ids = [] def divide_list(list_, n): for i in range(0, len(list_), n): yield list_[i:i + n] def issue_query(): iFile = open('ReadFromThisFile.txt', "r") lines = iFile.readlines() #print len(lines) for line in lines: ids = string.split(line) ids = ids[0] page_ids.append(ids) url = URL_BASE indicies = range(len(page_ids)) File = open("WriteToThisFile.csv", "w") for indicies in divide_list(page_ids, 50): count = 0 fiftyIds =[] url = URL_BASE for id in indicies: str(id).strip url += str(id) + '|' print url fiftyIds.append(str(id)) count += 1 print count rv = urllib.urlopen(url) j = rv.read().decode("utf-8") #sys.stderr.write(j + "\n") data = json.loads(j) for id in fiftyIds: try: s = int(data["query"]["pages"][id]["revisions"][0]["size"]) sys.stderr.write("%d\t%d\n" % (int(id), s)) File.write("%d\t%d\n" % (int(id), s)) #print ("%d\t%d\n" % (int(id), s)) # do something interesting with id and s except Exception, e: traceback.print_exc() File.close() iFile.close() issue_query() </code></pre> <p>I know many experience python developers might give me negative points for asking a simple question like this but I couldn't find any good examples on google or here. So sorry for any trouble if in case I have repeated a question.</p> <p>Thanks, </p>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. USNull-Hypothesis
    1. USNull-Hypothesis
    plurals
    1. PL
      singulars
      1. LTLinked
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    2. PO
      singulars
      1. PTAnswer
    3. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POPython: divide an array into section
      1. This table or related slice is empty.
      1. VTUpMod
    1. COWhy would Perl developers care about your Python abilities? ;-)
      singulars
      1. POPython: divide an array into section
      1. USCameron
    2. COpossible duplicate of [How do you split a list into evenly sized chunks in Python?](http://stackoverflow.com/questions/312443/how-do-you-split-a-list-into-evenly-sized-chunks-in-python)
      singulars
      1. POPython: divide an array into section
      1. USkennytm
    3. COIn Python a list is a list, and an array is this : (http://docs.python.org/library/array.html#module-array)
      singulars
      1. POPython: divide an array into section
      1. USeyquem
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload