StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

POhttpwebrequest getting weird characters instead of html code
primarykey
Id
18745801
data
AcceptedAnswerId
18748231
AnswerCount
1
ClosedDate
CommentCount
8
CommunityOwnedDate
CreationDate
2013-09-11T15:49:05.947
FavoriteCount
0
LastActivityDate
2013-09-11T18:20:15.870
LastEditDate
2013-09-11T18:12:19.823
LastEditorUserId
1115360
OwnerUserId
2447291
ParentId
0
PostTypeId
1
Score
1
ViewCount
686
LastEditorDisplayName
text
Body
iam trying to crawl some sites. It works like a charm. But there is a major problem. On some pages (not mutch) I'm getting some weird characters instead of html code. It looks like this: <code>;�<cS��u�/�qYa$�4l7�.�Q�7&��O�� Z�D}z��/�� u��V��lWY|�n5�1�We��GB�U��g{�� |Ϸ��*�Q��0��nb�o�߯��[b��/��@CƑ��D{{/n��X�!� �Et�X"��?��˩��8\y��&</code> If I'll open it in my browser, there is no Problem at all. I dont understand why. My HTTP Header says: <blockquote> Accept:text/html,application/xhtml+xml,application/xml;q=0.9,/;q=0.8 Accept-Encoding:gzip,deflate,sdch Accept-Language:de-DE,de;q=0.8,en-US;q=0.6,en;q=0.4 Cache-Control:max-age=0 Connection:keep-alive User-Agent:Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/29.0.1547.66 Safari/537.36 </blockquote> I think it has something to do with the Accept <pre>request.Accept = "*/*"</pre> Thats my webrequest: <pre><code>Public Class Http Dim cookieCon As New CookieContainer Dim request As HttpWebRequest Dim response As HttpWebResponse Public Function GetRequest(ByVal Params() As Object) Dim url As String = Params(0) Dim mycookie As String = Params(1) 'request.AllowAutoRedirect = True request = CType(HttpWebRequest.Create(url), HttpWebRequest) request.CookieContainer = New CookieContainer() request.Method = "GET" request.Timeout = 20000 request.UserAgent = "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/29.0.1547.66 Safari/537.36" 'request.ContentType = "application/x-www-form-urlencoded" request.Accept = "*/*" If Not mycookie Like "nocookie" Then request.Headers("Cookie") = mycookie End If response = CType(request.GetResponse(), HttpWebResponse) Dim html(1) As String html(0) = request.Address.ToString() html(1) = New StreamReader(response.GetResponseStream()).ReadToEnd() Return html End Function </code></pre> Thanks.
Tags
<vb.net>
Title
httpwebrequest getting weird characters instead of html code
singulars
PostAcceptedAnswerId
1. PO
 singulars
 PostTypePostTypeId
 PTAnswer
PostParentId
1. This table or related slice is empty.
PostTypePostTypeId
1. PTQuestion
UserLastEditorUserId
1. USAndrew Morton
UserOwnerUserId
1. USPonch0
plurals
PostLinksPostIdRelatedPostId
1. PL
 singulars
 LinkTypeLinkTypeId
 LTLinked
PostLinksRelatedPostIdPostId
1. This table or related slice is empty.
PostsAcceptedAnswerId
1. This table or related slice is empty.
PostsParentIdCreationDate
1. PO
 singulars
 PostTypePostTypeId
 PTAnswer
VotesPostIdCreationDate
1. VO
 singulars
 PostPostId
 POhttpwebrequest getting weird characters instead of html code
 UserUserId
 This table or related slice is empty.
 VoteTypeVoteTypeId
 VTUpMod
CommentsPostId

Querying!

Guidance

A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.