StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

POpython subprocess.Popen vs os.popen
primarykey
Id
17916876
data
AcceptedAnswerId
17916976
AnswerCount
1
ClosedDate
CommentCount
0
CommunityOwnedDate
CreationDate
2013-07-29T05:51:04.877
FavoriteCount
0
LastActivityDate
2017-11-12T10:43:49.760
LastEditDate
2017-11-12T10:43:49.760
LastEditorUserId
1358712
OwnerUserId
1200784
ParentId
0
PostTypeId
1
Score
0
ViewCount
8904
LastEditorDisplayName
text
Body
I'm trying to get the output of the following shell command in my python script, <pre><code>hadoop fs -ls /projectpath/ | grep ^d | grep -v done | head -1 | awk {'print $8'} </code></pre> I can successfully get the output through <code>os.popen</code> as follows: <pre><code>import os cmd = "hadoop fs -ls /projectpath/ | grep ^d | grep -v done | head -1 | awk {'print $8'}" p = os.popen(cmd,"r") while 1: line = p.readline() if not line: break print line </code></pre> But <code>os.popen()</code> is deprecated since python 2.6 so I wanted to replace the above snippet with the <code>subprocess.Popen()</code> function. But the code snippet for <code>subprocess.Popen()</code> below gives a different result than the code snippet above. <pre><code>import subprocess as sub import shlex cmd = "hadoop fs -ls /projectpath/ | grep ^d | grep -v done | head -1 | awk {'print $8'}" args = shlex.split(cmd) p = sub.Popen(args,stdout=sub.PIPE,stderr=sub.PIPE) output, errors = p.communicate() print output </code></pre> The above command just gives output for <code>'hadoop fs -ls /projectpath/'</code> part of the command. I have tried consulting several references (<a href="http://docs.python.org/2/library/subprocess.html#popen-objects" rel="nofollow noreferrer">http://docs.python.org/2/library/subprocess.html#popen-objects</a>, <a href="https://stackoverflow.com/questions/3791465/python-os-system-for-command-line-call-linux-not-returning-what-it-should">Python, os.system for command-line call (linux) not returning what it should?</a>) for <code>subpocess.Popen()</code> but cannot get it to execute the command in the string cmd. Can anyone point out what I'm doing wrong?
Tags
<python><subprocess>
Title
python subprocess.Popen vs os.popen
singulars
PostAcceptedAnswerId
1. PO
 singulars
 PostTypePostTypeId
 PTAnswer
PostParentId
1. This table or related slice is empty.
PostTypePostTypeId
1. PTQuestion
UserLastEditorUserId
1. USluzik
UserOwnerUserId
1. USrohanag
plurals
PostLinksPostIdRelatedPostId
1. PL
 singulars
 LinkTypeLinkTypeId
 LTLinked
PostLinksRelatedPostIdPostId
1. This table or related slice is empty.
PostsAcceptedAnswerId
1. This table or related slice is empty.
PostsParentIdCreationDate
1. PO
 singulars
 PostTypePostTypeId
 PTAnswer
VotesPostIdCreationDate
1. This table or related slice is empty.
CommentsPostId
1. This table or related slice is empty.

Querying!

Guidance

A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.