Databases
StackOverflow2013
Postsdbo
PO
 

Note that there are some explanatory texts on larger screens.

plurals
  1. PO
    primarykey
    data
    text
    <p><strong>Edit, Dec 2013:</strong> Google has deprecated the old <code>Xml</code> service, replacing it with <a href="https://developers.google.com/apps-script/reference/xml-service/xml-servic" rel="nofollow noreferrer"><code>XmlService</code></a>. The script in this answer has been updated to use the new service. The new service requires standard-compliant XML &amp; HTML, while the old one was forgiving of such problems as missing close-tags.</p> <hr> <p>Have a look at the <a href="https://developers.google.com/apps-script/articles/XML_tutorial" rel="nofollow noreferrer">Tutorial: Parsing an XML Document</a>. (As of Dec 2013, this tutorial is still on line, although the Xml service is deprecated.) Starting with that foundation, you can take advantage of the XML parsing in Script Services to navigate the page. Here's a small script operating on your example:</p> <pre><code>function getProgrammeList() { txt = '&lt;html&gt; &lt;body&gt; &lt;div&gt; &lt;div&gt; &lt;div id="here"&gt;hello world!!&lt;/div&gt; &lt;/div&gt; &lt;/div&gt; &lt;/html&gt;' // Put the receieved xml response into XMLdocument format var doc = Xml.parse(txt,true); Logger.log(doc.html.body.div.div.div.id +" = " +doc.html.body.div.div.div.Text ); /// here = hello world!! debugger; // Pause in debugger - examine content of doc } </code></pre> <p>To get the real page, start with this:</p> <pre><code>var url = 'http://blah.blah/whatever?querystring=foobar'; var txt = UrlFetchApp.fetch(url).getContentText(); .... </code></pre> <p>If you look at the documentation for <a href="https://developers.google.com/apps-script/reference/xml/xml-element#getElements%28String%29" rel="nofollow noreferrer"><code>getElements</code></a> you'll see that there is support for retrieving specific tags, for example "div". That finds direct children of a specific element, it doesn't explore the entire XML document. You should be able to write a function that traverses the document examining the <code>id</code> of each <code>div</code> element until it finds your programme list.</p> <pre><code>var programmeList = findDivById(doc,"here"); </code></pre> <hr> <h3>Edit - I couldn't help myself...</h3> <p>Here's a utility function that will do just that.</p> <pre><code>/** * Find a &lt;div&gt; tag with the given id. * &lt;pre&gt; * Example: getDivById( html, 'tagVal' ) will find * * &lt;div id="tagVal"&gt; * &lt;/pre&gt; * * @param {Element|Document} * element XML document or element to start search at. * @param {String} id HTML &lt;div&gt; id to find. * * @return {XmlElement} First matching element (in doc order) or null. */ function getDivById( element, id ) { // Call utility function to do the work. return getElementByVal( element, 'div', 'id', id ); } /** * !Now updated for XmlService! * * Traverse the given Xml Document or Element looking for a match. * Note: 'class' is stripped during parsing and cannot be used for * searching, I don't know why. * &lt;pre&gt; * Example: getElementByVal( body, 'input', 'value', 'Go' ); will find * * &lt;input type="submit" name="btn" value="Go" id="btn" class="submit buttonGradient" /&gt; * &lt;/pre&gt; * * @param {Element|Document} * element XML document or element to start search at. * @param {String} elementType XML element type, e.g. 'div' for &lt;div&gt; * @param {String} attr Attribute or Property to compare. * @param {String} val Search value to locate * * @return {Element} First matching element (in doc order) or null. */ function getElementByVal( element, elementType, attr, val ) { // Get all descendants, in document order var descendants = element.getDescendants(); for (var i =0; i &lt; descendants.length; i++) { var elem = descendants[i]; var type = elem.getType(); // We'll only examine ELEMENTs if (type == XmlService.ContentTypes.ELEMENT) { var element = elem.asElement(); var htmlTag = element.getName(); if (htmlTag === elementType) { if (val === element.getAttribute(attr).getValue()) { return element; } } } } // No matches in document return null; } </code></pre> <p>Applying this to your example, we get this:</p> <pre><code>function getProgrammeList() { txt = '&lt;html&gt; &lt;body&gt; &lt;div&gt; &lt;div&gt; &lt;div id="here"&gt;hello world!!&lt;/div&gt; &lt;/div&gt; &lt;/div&gt; &lt;/html&gt;' // Get the receieved xml response into an XML document var doc = XmlService.parse(txt); var found = getDivById(doc.getElement(),'here'); Logger.log(found.getAttribute(attr).getValue() + " = " + found.getValue()); /// here = hello world!! } </code></pre> <p><strong>Note:</strong> See <a href="https://stackoverflow.com/questions/16858731/html-div-nesting-using-google-fetchurl/16860598#16860598">this answer</a> for a practical example of the use of these utilities.</p>
    singulars
    1. This table or related slice is empty.
    1. PODoes Google Apps Script have something like getElementById?
      singulars
      1. PTQuestion
    1. PTAnswer
    1. USCommunity
    1. USMogsdad
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PODoes Google Apps Script have something like getElementById?
      singulars
      1. PTQuestion
    1. This table or related slice is empty.
    1. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTAcceptedByOriginator
    2. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTUpMod
    3. VO
      singulars
      1. PO
      1. This table or related slice is empty.
      1. VTUpMod
    1. COI was curious, so I wrote the utility function!
      singulars
      1. PO
      1. USMogsdad
    2. CONot that this isn't an elegant solution for OP's dilemma, but I was under the assumption that using the Xml service really depends on a well formed XML doc. I would be curious to see how would this work in the scenario above if there was a missing `</div>` or `</pre>` closing tag in there somewhere? Or in a case where the page creator didn't wrap it in a valid xhtml structure like `<pre>Something<pre>`?
      singulars
      1. PO
      1. USGreg
    3. COThe XML service is surprisingly tolerant of missing end tags, it appears to close unresolved tag pairs automatically; e.g. `<html><div><div></html>` will parse with both nested `div`s closing at the `html` end. Regarding point 2... everything is wrapped in something - SOME container will have the programme list, it might just be buried deep - you'd need to see the specific site source to know. If the author didn't provide unique identification of the target element, though, it gets tricky, but you can search for `.Text`, e.g. for `p` or `h1` text, and then select elements relative to that.
      singulars
      1. PO
      1. USMogsdad
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload