Databases
StackOverflow2013
Postsdbo
POAdding multiple arrays to a MySQL Table
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POAdding multiple arrays to a MySQL Table
    primarykey
    data
    text
    <p>I wrote a script to scrape trough multiple urls, add the useful information with help of BeautifulSoup to two arrays (ids and names) and than add the values of these arrays to a MySQL Table where ids[0] and names[0] is row0 of the table and so on...</p> <p>However my code is very ugly and i am sure there is a way better approaches than mine.</p> <p>Can anybody give me a hint? I specificly need an input on how to iterate trough the two arrays...</p> <p>Thanks in advance!</p> <pre><code>#!/usr/bin/env python from bs4 import BeautifulSoup from urllib import urlopen import MySQLdb #MySQL Connection mysql_opts = { 'host': "localhost", 'user': "********", 'pass': "********", 'db': "somedb" } mysql = MySQLdb.connect(mysql_opts['host'], mysql_opts['user'], mysql_opts['pass'], mysql_opts['db']) #Add Data SQL Query data_query = ("INSERT INTO tablename " "(id, name) " "VALUES (%s, %s)") #Urls to scrape url1 = 'http://somepage.com' url2 = 'http://someotherpage.com' url3 = 'http://athirdpage.com' #URL Array urls = (url1,url2,url3) #Url loop for url in urls: soupPage = urlopen(url) soup = BeautifulSoup (soupPage) ids = soup.find_all('a', style="display:block") names = soup.find_all('a', style="display:block") i = 0 print ids.count while (i &lt; len(ids)): try: id = ids[i] vid = id['href'].split('=') vid = vid[1] except IndexError: id = "leer" try: name = names[i] name = name.contents[0] name = name.encode('iso-8859-1') except IndexError: name = "" data_content = (vid, name) cursor.execute(data_query, data_content) emp_no = cursor.lastrowid i = i + 1 </code></pre>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. USRiscie
    1. USRiscie
    plurals
    1. PL
      singulars
      1. LTLinked
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. COI think i found an answer: `for id, name in newlist(ids, names): #do something with it... print(id, name)` Can someone confirm this is the best approach? => http://stackoverflow.com/questions/1663807/how-can-i-iterate-through-two-lists-in-parallel-in-python
      singulars
      1. POAdding multiple arrays to a MySQL Table
      1. USRiscie
    2. COCorrected: `for id, name in zip(ids, names): #do something with it... print(id, name)`
      singulars
      1. POAdding multiple arrays to a MySQL Table
      1. USRiscie
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload