Databases
StackOverflow2013
Postsdbo
PODownloading *.mp4 files with Python
 

Note that there are some explanatory texts on larger screens.

plurals
  1. PODownloading *.mp4 files with Python
    primarykey
    data
    text
    <p>I'm trying to download and save lecture videos from a website. While I've been successful in downloading the files, they won't play in my media player. Here is the code I'm using:</p> <pre><code>from bs4 import BeautifulSoup import re import urllib2 snippet = open('Python/SNA Page Source Revised.txt', 'r') soup = BeautifulSoup(snippet) links = [link.get('href') for link in soup.find_all('a')] videos = [] for link in links: match = re.search('.*mp4.*', link) if match: videos.append(link) vidNum = 1 for video in videos: f = urllib2.urlopen(video) with open('Data Analysis/Social Network Analysis/Video '+vidNum+'.mp4', 'wb') as code: code.write(f.read()) vidNum += 1 </code></pre> <p>Everything seems to work fine, but when I try to play one of the videos, I get this error: "Python (v2.7) requires to install plugins to play media files of the following type: text/html decoder" In addition, if I download the video from the website manually, the file is approximately 22.8MB, but when I use my script, the file is only 7.8kB. </p> <p>Am I doing something wrong with the way I'm downloading the file? Any help would be greatly appreciated.</p> <p>Also: I'm operating on an Ubuntu 12.04 LTS operating system using Python v2.7.</p> <p><em><strong></em>****</strong><em>EDIT</em><strong><em>*</em>***</strong></p> <p>Here is the code I'm using based on responses I've received:</p> <pre><code>import requests r = requests.get('https://class.coursera.org/sna-003/lecture/download.mp4?lecture_id=2', auth=('myUsername', 'myPassword')) with open('Data Analysis/TestFile.mp4', 'wb') as fd: fd.write(r.content) </code></pre> <p>Here is the output of r.content:</p> <pre><code>&lt;!DOCTYPE html&gt; &lt;html itemtype="http://schema.org" xmlns:fb="http://ogp.me/ns/fb#"&gt;&lt;head&gt;&lt;meta content="IE=Edge,chrome=IE7" http-equiv="X-UA-Compatible"/&gt;&lt;meta content="!" name="fragment"/&gt;&lt;meta content="NOODP" name="robots"/&gt;&lt;meta charset="utf-8"/&gt;&lt;meta content="Coursera" property="og:title"/&gt;&lt;meta content="website" property="og:type"/&gt;&lt;meta content="http://s3.amazonaws.com/coursera/media/Coursera_Computer_Narrow.png" property="og:image"/&gt;&lt;meta content="https://www.coursera.org/" property="og:url"/&gt;&lt;meta content="Coursera" property="og:site_name"/&gt;&lt;meta content="en_US" property="og:locale"/&gt;&lt;meta content="Take free online classes from 80+ top universities and organizations. Coursera is a social entrepreneurship company partnering with Stanford University, Yale University, Princeton University and others around the world to offer courses online for anyone to take, for free. We believe in connecting people to a great education so that anyone around the world can learn without limits." property="og:description"/&gt;&lt;meta content="727836538,4807654" property="fb:admins"/&gt;&lt;meta content="274998519252278" property="fb:app_id"/&gt;&lt;meta content="Take free online classes from 80+ top universities and organizations. Coursera is a social entrepreneurship company partnering with Stanford University, Yale University, Princeton University and others around the world to offer courses online for anyone to take, for free. We believe in connecting people to a great education so that anyone around the world can learn without limits." name="description"/&gt;&lt;meta content="http://s3.amazonaws.com/coursera/media/Coursera_Computer_Narrow.png" name="image"/&gt;&lt;meta content="app-id=736535961" name="apple-itunes-app"/&gt;&lt;script&gt;window.onerror = function(message, url, lineNum) { // First check the URL and line number of the error url = url || window.location.href; // 99% of the time, errors without line numbers arent due to our code, // they are due to third party plugins and browser extensions if (lineNum === undefined || lineNum == null) return; // Now figure out the actual error message // If it's an event, as triggered in several browsers if (message.target &amp;amp;&amp;amp; message.type) { message = message.type; } if (!message.indexOf) { message = 'Non-string, non-event error: ' + (typeof message); } var errorDescrip = { message: message, script: url, line: lineNum, url: document.URL } var err = { key: 'page.error.javascript', value: errorDescrip } window._204 = window._204 || []; window._204.push(err); window._gaq = window._gaq || []; window._gaq.push(err); }&lt;/script&gt;&lt;title&gt;Coursera.org&lt;/title&gt;&lt;link href="https://d1rlkby5e91r2j.cloudfront.net/e47434615f57601f9b9ccaf255a589e8550d328d/css/home.css" rel="stylesheet" type="text/css"/&gt;&lt;link href="https://d1rlkby5e91r2j.cloudfront.net/e47434615f57601f9b9ccaf255a589e8550d328d/pages/auth/css/auth.css" rel="stylesheet" type="text/css"/&gt;&lt;script data-baseurl="https://d1rlkby5e91r2j.cloudfront.net/e47434615f57601f9b9ccaf255a589e8550d328d/" id="_mobile"&gt;(function(el) { // Override certian behaviour if the page is for our mobile app. // TODO(priya) Remove this conditional behaviour once I want to push this behaviour // for regular authentication pages on mobile/smaller screens as well. // Currently I'm keeping existing behaviour same and only adding mobile specific // layouts ot /mobilesignup page (which is what isMobileApp = true signifies). if ("false" == "true") { var head = document.getElementsByTagName('head')[0]; // Add viewport meta tag var viewport = document.querySelector('meta[name=viewport]'); var viewportContent = 'width=device-width, initial-scale=1.0, user-scalable=no'; if (!viewport) { viewport = document.createElement('meta'); viewport.setAttribute('name', 'viewport'); head.appendChild(viewport); } viewport.setAttribute('content', viewportContent); // Add responsive css var link = document.createElement('link'); link.rel = 'stylesheet'; link.type = 'text/css'; link.href = el.getAttribute("data-baseurl") + "pages/auth/css/auth_responsive.css"; head.appendChild(link); } })(document.getElementById("_mobile")); &lt;/script&gt;&lt;/head&gt;&lt;body&gt;&lt;div id="fb-root"&gt;&lt;/div&gt;&lt;div id="origami"&gt;&lt;div style="position:absolute;top:0px;left:0px;width:100%;height:100%;background:#f5f5f5;padding-top:5%;"&gt;&lt;div id="coursera-loading-nojs" style="text-align:center; margin-bottom:10px;display:none;"&gt;Please use a &lt;a href="/browsers"&gt;modern browser &lt;/a&gt; with JavaScript enabled to use Coursera.&lt;/div&gt;&lt;div&gt;&lt;span id="coursera-loading-js" style="display: none; padding-left:45%"&gt;loading   &lt;img src="https://d2wvvaown1ul17.cloudfront.net/site-static/images/icons/loading.gif"/&gt;&lt;/span&gt;&lt;/div&gt;&lt;noscript&gt;&lt;div style="text-align:center; margin-bottom:10px;"&gt;Please use a &lt;a href="/browsers"&gt;modern browser &lt;/a&gt; with JavaScript enabled to use Coursera.&lt;/div&gt;&lt;/noscript&gt;&lt;/div&gt;&lt;/div&gt;&lt;!--[if gte IE 8]&amp;gt;&amp;lt;script&amp;gt;document.getElementById("coursera-loading-js").style.display = 'block';&amp;lt;/script&amp;gt;&amp;lt;![endif]--&gt; &lt;!--[if lte IE 7]&amp;gt;&amp;lt;script&amp;gt;document.getElementById("coursera-loading-nojs").style.display = 'block'; window._204 = window._204 || []; window._gaq = window._gaq || []; window._gaq.push( ['_setAccount', 'UA-28377374-1'], ['_setDomainName', window.location.hostname], ['_setAllowLinker', true], ['_trackPageview', window.location.pathname]); window._204.push( ['client', 'home'], {key:"pageview", value:window.location.pathname}); &amp;lt;/script&amp;gt;&amp;lt;script src="https://eventing.coursera.org/204.min.js"&amp;gt;&amp;lt;/script&amp;gt;&amp;lt;script src="https://ssl.google-analytics.com/ga.js"&amp;gt;&amp;lt;/script&amp;gt;&amp;lt;![endif]--&gt; &lt;!--[if !IE]&amp;gt; --&gt;&lt;script&gt;document.getElementById("coursera-loading-js").style.display = 'block';&lt;/script&gt;&lt;!-- &amp;lt;![endif]--&gt;&lt;script src="https://d1rlkby5e91r2j.cloudfront.net/e47434615f57601f9b9ccaf255a589e8550d328d/js/core/require.js" type="text/javascript"&gt;&lt;/script&gt;&lt;script data-baseurl="https://d1rlkby5e91r2j.cloudfront.net/e47434615f57601f9b9ccaf255a589e8550d328d/" data-debug="0" data-locale="" data-timestamp="1386838999742" data-version="e47434615f57601f9b9ccaf255a589e8550d328d" id="_require" type="text/javascript"&gt;if(document.getElementById("coursera-loading-js").style.display == 'block') { (function(el) { // prevent throw require.onError = function(err) { window._204 = window._204 || []; window._204.push({key: 'requireErr', value: err}); }; define("pages/auth/authConfig", function() { return {"coursera_url": "https://www.coursera.org/", "environment": "production"}; } ); require.config({ enforceDefine: false, waitSeconds: 14, baseUrl: el.getAttribute("data-baseurl"), urlArgs: el.getAttribute("data-debug") == "1" ? "v=" + el.getAttribute("data-timestamp") : "", shim: { "underscore": { exports: '_' }, "backbone": { deps: ['underscore', 'jquery'], exports: 'Backbone' } }, paths: { "jquery": "js/core/jquery", "underscore": "js/core/underscore", "backbone": "js/core/backbone", "i18n": "js/core/i18n._t" }, callback: function() { require(["pages/auth/routes"]); // bootup coursera }, config: { i18n: { locale: (window.localStorage ? localStorage.getItem("locale") : '') || el.getAttribute("data-locale") } } }); })(document.getElementById("_require")); }&lt;/script&gt;&lt;script type="text/javascript"&gt;define("pages/home/models/user.json", [], function(){ return null; }); &lt;/script&gt;&lt;/body&gt;&lt;/html&gt; </code></pre> <p>I find this weird, though, because it just looks like the source code of the website, but yet when I view r.url I get an actual website that I can load in my browser and it prompts me to save or view the video. Even when I try to pass the new url I get from that, which I assume contains my cookie information, I still get the same content back. I don't understand where I'm going wrong.</p>
    singulars
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PTQuestion
    1. USRay
    1. USbrittenb
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    2. PO
      singulars
      1. PTAnswer
    1. VO
      singulars
      1. PODownloading *.mp4 files with Python
      1. This table or related slice is empty.
      1. VTApproveEditSuggestion
    1. COYou're probably downloading the HTML of the download page instead of the file itself. Have you tried the URL in a browser?
      singulars
      1. PODownloading *.mp4 files with Python
      1. USJoshua Brodie
    2. COYes, I have. Here is an example URL: https://class.coursera.org/sna-003/lecture/download.mp4?lecture_id=2 When I view the output from urllib2.urlopen(video).read() it's XML data and there is a data-baseurl, but that URL can't be loaded in a browser. Here is an example: https://d1rlkby5e91r2j.cloudfront.net/e47434615f57601f9b9ccaf255a589e8550d328d
      singulars
      1. PODownloading *.mp4 files with Python
      1. USbrittenb
    3. COApparently you need to set some kind of cookies so download wouldn't fail.
      singulars
      1. PODownloading *.mp4 files with Python
      1. USplaes
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload