Weird Question on Search Engine Results > Product Forums

Unanswered Active Topics

Forums Search Members

Forums > Projects > Friendly Urls

Subject: Weird Question on Search Engine Results

Prev Next

You are not authorized to post a reply.

Author

Messages

Jason Koskimaki User is Offline

Registered Users

Nuke Wiz
Posts:194

8/23/2006 12:49 PM
I customzed a version of the url rewriter for my website. I remember reading somewhere about weird issues with some search engines. I am not an expert so am wondering if there may be something I am missing? Namely, I use the urlrewriter to generate URLs such as mysite com/events/2323/monthly-meeting.aspx. If that is the URL that is displayed on my link and address bar is that the URL the search engine sees? Or is there some 'hidden' url it picks up instead? I thought DNN may do some behind the scenes server url redirect or something that a search engine was picking up and thus ithe search engine would recognize the DNN way of listing a URL (mysite com/events/tabid/343/ctl/ctlname/mid/434/id/2323/monthlymeeting.aspx instead of my url rewritten way). Note that I am using a customized url rewriter and not the one from DNN or released here by Scott. Anyone's thoughts on this? I'm trying to figure out why my searches aren't picking up in yahoo and wanted to make sure it was not dnn related. Jason

Social Networking Site for Young Professionals - My DNN Site w/ lots of Ventrian Modules

Scott McCulloch User is Offline

Administrators

Nuke Master
Posts:12598

8/23/2006 6:04 PM
It depends how you do it, if you are using response.redirect, the URL shown will be the internal url, ctl=etc. As this actually redirects the client to the url. However, if you use the RewritePath method, it will do it on the server side, so your URL will still look like mysite com/events/2323/monthly-meeting.aspx to the client. If you go to google and type in site:www.ventrian.com, you can see the friendly URLs in there such as http://www.ventrian.com/resources/blog.aspx

Scott McCulloch Site Administrator

Jason Koskimaki User is Offline

Registered Users

Nuke Wiz
Posts:194

9/12/2006 12:00 AM
OK. Something is definitely wrong here. I index these pages in msn but not yahoo or google. Whereas many more obscure links get indexed but NONE of these pages. And I have tons of them and they all indexed fine with my old format. Anyone have an idea? The code I added is here: http://www.ventrian.com/Support/ProductForums/tabid/118/forumid/35/postid/10876/view/topic/Default.aspx I know with this format when I do a request querytstring in asp.net it does not work . I was not sure how request.querystring works with friendly URLs? Perhaps there is something I have to do to indicate that these are friendly parameters and not a directory structure? Is there other stuff with URL rewriting I don't know about? Is there hidden stuff browsers or spiders can see beyond the text in the address bar? Jason

Social Networking Site for Young Professionals - My DNN Site w/ lots of Ventrian Modules

Jason Koskimaki User is Offline

Registered Users

Nuke Wiz
Posts:194

9/12/2006 12:45 AM
OK. I went ahead and posted this on dotnetnuke.com too to see who could help. And I found this link which is very interesting. Anyone have thoughts on it? http://todotnet.com/archive/2006/07/01/7472.aspx jason

Social Networking Site for Young Professionals - My DNN Site w/ lots of Ventrian Modules

Jason Koskimaki User is Offline

Registered Users

Nuke Wiz
Posts:194

9/12/2006 12:56 AM
Aha! A possible solution....perhaps I am not mad after all? :) http://scottwater.com/blog/archive/2006/07/17/ASPNET-20-UrlRewriting-Fix.aspx

Social Networking Site for Young Professionals - My DNN Site w/ lots of Ventrian Modules

Jason Koskimaki User is Offline

Registered Users

Nuke Wiz
Posts:194

9/12/2006 1:37 AM
Now after posting this, I found out I am running on asp.net 1.1 so this does not apply to me. But it makes me think that search engines are getting wrong return codes for my pages. Although I did download this httpheader tool here: http://livehttpheaders.mozdev.org/ And verified it did show valid 200 pages but perhaps there is something with google and yahoo where the use a different type agent that does see an error when it shouldnt. Jason

Social Networking Site for Young Professionals - My DNN Site w/ lots of Ventrian Modules

Scott McCulloch User is Offline

Administrators

Nuke Master
Posts:12598

9/12/2006 3:46 PM
Hmm, I'm not sure what the problem is, if a page is requested and the page url is rewritten on the server side (nothing to do with the client), why would the client notice anything different? Your code ends up going through RewriterUtils.RewriteUrl right?

Scott McCulloch Site Administrator

Jason Koskimaki User is Offline

Registered Users

Nuke Wiz
Posts:194

9/13/2006 8:25 AM
Posted By smcculloch on 9/12/2006 3:46 PM Hmm, I'm not sure what the problem is, if a page is requested and the page url is rewritten on the server side (nothing to do with the client), why would the client notice anything different? Your code ends up going through RewriterUtils.RewriteUrl right? This is the area I am confused about as that's what I thought. However, it appears as if the server returns various codes to the agent such as 301, 302, 200, etc..... letting it know if it is a redirect, page moved, page not found, etc....and I think there is a code returned during url rewrites. In the one case I found info on (apparently similar but different than my scenario) in asp.net 2.0 there is a bug in the framework which in some cases depending on how your page is rendered, with url rewriting (calling rewriteURL) it would return an invalid code by mistake so the search engine would not index it. Jason

Social Networking Site for Young Professionals - My DNN Site w/ lots of Ventrian Modules

Scott McCulloch User is Offline

Administrators

Nuke Master
Posts:12598

9/14/2006 7:01 AM
Hmm, there is a utility called fiddler, that would allow you to look at the http codes being passed back and forth. Anyone had experience with it?

Scott McCulloch Site Administrator

Jason Koskimaki User is Offline

Registered Users

Nuke Wiz
Posts:194

9/14/2006 7:11 PM
I tried that utility. It is simple and awesome. I have an idea of what is going on here if this makes sense. I have a hacked way of doing this url rewrite which may have a problem at this line.... context.RewritePath(sendToUrlLessQString, String.Empty, queryString) my "sendToUrlLessQString" includes querystring params. So perhaps even though it looks good in the url string, search engines can detect the rewrite path and see that the file structure is not there. I am going to try removing my parms (events/evenid and locations/locID) from the "sendToUrlLessQString". Note also that because I am not passing them in request.querystring() does not work for me and I parse url manually in my code. Jason

Social Networking Site for Young Professionals - My DNN Site w/ lots of Ventrian Modules

Scott McCulloch User is Offline

Administrators

Nuke Master
Posts:12598

9/14/2006 8:07 PM
Did that utility give you any redirects codes on the request? I thought all of this is server side, so I am suprised anything gets sent to the client.

Scott McCulloch Site Administrator

You are not authorized to post a reply.

Forums > Projects > Friendly Urls > Weird Question on Search Engine Results

ActiveForums 3.7