Databases
StackOverflow2013
Postsdbo
POUsing Simple HTML DOM to Scrape?
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POUsing Simple HTML DOM to Scrape?
    primarykey
    data
    text
    <p>Simple HTML DOM is basically a php you add to your pages which lets you have simple web scraping. It's good for the most part but I can't figure out the manual as I'm not much of a coder. Are there any sites/guides out there that have any easier help for this? (the one at php.net is a bit too complicated for me at the moment) Is there a better place to ask this kind of question?</p> <p>The site for it is at: <a href="http://simplehtmldom.sourceforge.net/manual.htm" rel="nofollow">http://simplehtmldom.sourceforge.net/manual.htm</a></p> <p>I can scrape stuff that has specific classes like <code>&lt;tr class="group"&gt;</code>, but not for stuff that's in between. For example.. This is what I currently use...</p> <pre><code>$url = 'http://www.test.com'; $html = file_get_html($url); foreach($html-&gt;find('tr[class=group]') as $result) { $first = $result-&gt;find('td[class=category1]',0); $second = $result-&gt;find('td[class=category2]',0); echo $first.$second; } } </code></pre> <p>But here is the kind of code I'm trying to scrape.</p> <pre><code>&lt;table&gt; &lt;tr class="Group"&gt; &lt;td&gt; &lt;dl class="Summary"&gt; &lt;dt&gt;Heading 1&lt;/dt&gt; &lt;dd&gt;&lt;a href="#123" class="ViewProfile"&gt;Cat&lt;/a&gt;&lt;/dd&gt; &lt;dd&gt;&lt;a href="#032" class="ViewProfile"&gt;Bacon&lt;/a&gt;&lt;/dd&gt; &lt;dt&gt;Heading 2&lt;/dt&gt; &lt;dd&gt;&lt;a href="#143" class="ViewProfile"&gt;Narwhal&lt;/a&gt;&lt;/dd&gt; &lt;dd&gt;&lt;a href="#642" class="ViewProfile"&gt;Ice Soap&lt;/a&gt;&lt;/dd&gt; &lt;/dl&gt; &lt;/td&gt; &lt;/tr&gt; &lt;/table&gt; </code></pre> <p>I'm trying to extract the content of each <code>&lt;dt&gt;</code> and put it to a variable. Then I'm trying to extract the content of each <code>&lt;dd&gt;</code> and put it to a variable, but nothing I tried works. Here's the best I could find, but it gives me back only the first heading repeatedly rather than going to the second.</p> <pre><code>foreach($html-&gt;find('tr[class=Summary]') as $result2) { echo $result2-&gt;find('dt',0)-&gt;innertext; } </code></pre> <p>Thanks to anyone who can help. Sorry if this is not clear or that it's so long. Ideally I'd like to be able to understand these DOM commands more as I'd like to figure this out myself rather than someone here just do it (but I'd appreciate either). </p> <p><strong>TL;DR:</strong> I am trying to understand how to use the commands listed in the manual (url above). The 'manual' isn't easy enough. How do you go about learning this stuff?</p>
    singulars
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. PTQuestion
    1. USCully
    1. USCully
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. POUsing Simple HTML DOM to Scrape?
      1. This table or related slice is empty.
      1. VTUpMod
    1. COI pretty much hate Simple DOM. The hellish mixture of objects and arrays you get back is... hellish. PHPQuery is kind of cool, but ultimately I moved to Python and Beautiful Soup for this type of task.
      singulars
      1. POUsing Simple HTML DOM to Scrape?
      1. USJAL
    2. COYeah, ideally I'd rather use Python, but then I'd have to learn something that ends up being more work for me. I've had a look at PHPQuery and can't make head nor tails of it. I just wish there was an easy way to learn these things... or even if there was a book or something that I could work through.
      singulars
      1. POUsing Simple HTML DOM to Scrape?
      1. USCully
    3. COJust my suggestion, because I had the same problem learning and concluded that the 'Simple DOM' is anything but. I consider it to be truly awful, and wholeheartedly recommend seeking any other alternative possible.
      singulars
      1. POUsing Simple HTML DOM to Scrape?
      1. USJAL
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload