Register   Login
     
  Latest Posts  
Logo same size as other photos?
by marshal on 9/07/2008 4:44 PM
RE: Filter does not honor max articles after upgrading
by StatisticsIO on 9/07/2008 5:51 AM
RE: Filter does not honor max articles after upgrading
by smcculloch on 9/07/2008 4:25 AM
Filter does not honor max articles after upgrading
by StatisticsIO on 9/07/2008 4:02 AM
RE: controlling comment layout - to the right of article
by dax on 9/07/2008 12:40 AM
Search Results Showing Article Title Twice...
by dax on 9/06/2008 11:50 PM
Chnage Custom Field Default Text
by tmahmud on 9/06/2008 11:01 PM
RE: PA Template for Habitat for Humanity
by jemcder on 9/06/2008 8:42 PM
comment box size
by rdyar on 9/06/2008 8:35 PM
RE: controlling comment layout - to the right of article
by rdyar on 9/06/2008 8:21 PM
  Forums  
Subject: How to stop Google spider looking for a deleted page?
Prev Next
You are not authorized to post a reply.

Author Messages
GlenWinUser is Offline
Gold Membership
Nuke Master
Nuke Master
Posts:671


1/03/2008 2:35 PM  

After deleting a page named   /COMMUNITY/EventsAnnoucements.aspx  Google kept looking for this page and hence throw the General exceptions ....   Does anyone know ant trick to stop Google from looking for a deleted page ?
 
AssemblyVersion: 04.05.05
PortalID: -1
PortalName:
UserID: -1
UserName:
ActiveTabID: -1
ActiveTabName:
RawURL: /COMMUNITY/EventsAnnoucements.aspx
AbsoluteURL: /COMMUNITY/EventsAnnoucements.aspx
AbsoluteURLReferrer:
UserAgent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
DefaultDataProvider: DotNetNuke.Data.SqlDataProvider, DotNetNuke.SqlDataProvider
ExceptionGUID: d263df9f-c590-4c88-bfc3-3feb85ff47d7
InnerException: Unhandled Error:
FileName:
FileLineNumber: 0
FileColumnNumber: 0
Method: System.Web.UI.Util.CheckVirtualFileExists
StackTrace:
Message: System.Exception: Unhandled Error: ---> System.Web.HttpException: The file '/COMMUNITY/EventsAnnoucements.aspx' does not exist. at System.Web.UI.Util.CheckVirtualFileExists(VirtualPath virtualPath) at System.Web.Compilation.BuildManager.GetVPathBuildResultInternal(VirtualPath virtualPath, Boolean noBuild, Boolean allowCrossApp, Boolean allowBuildInPrecompile) at System.Web.Compilation.BuildManager.GetVPathBuildResultWithNoAssert(HttpContext context, VirtualPath virtualPath, Boolean noBuild, Boolean allowCrossApp, Boolean allowBuildInPrecompile) at System.Web.Compilation.BuildManager.GetVirtualPathObjectFactory(VirtualPath virtualPath, HttpContext context, Boolean allowCrossApp, Boolean noAssert) at System.Web.Compilation.BuildManager.CreateInstanceFromVirtualPath(VirtualPath virtualPath, Type requiredBaseType, HttpContext context, Boolean allowCrossApp, Boolean noAssert) at System.Web.UI.PageHandlerFactory.GetHandlerHelper(HttpContext context, String requestType, VirtualPath virtualPath, String physicalPath) at System.Web.UI.PageHandlerFactory.System.Web.IHttpHandlerFactory2.GetHandler(HttpContext context, String requestType, VirtualPath virtualPath, String physicalPath) at System.Web.HttpApplication.MapHttpHandler(HttpContext context, String requestType, VirtualPath path, String pathTranslated, Boolean useAppConfig) at System.Web.HttpApplication.MapHandlerExecutionStep.System.Web.HttpApplication.IExecutionStep.Execute() at System.Web.HttpApplication.ExecuteStep(IExecutionStep step, Boolean& completedSynchronously) --- End of inner exception stack trace ---
Source:

Steve TopilnyckyUser is Offline
Gold Membership
Nuke Wiz
Nuke Wiz
Posts:165


1/03/2008 9:17 PM  
You can use the ROBOTS.TXT file and disallow that url and the web crawlers will not follow the link.

--
Regards,
Steve Topilnycky
Top Cat Computing | Marine Corps League - Westchester County Detachment | ArGoStuff | Young Marines of Westchester
Steve TopilnyckyUser is Offline
Gold Membership
Nuke Wiz
Nuke Wiz
Posts:165


1/03/2008 9:24 PM  

Here is some more info and example on how to use it:

http://www.robotstxt.org/orig.html

http://en.wikipedia.org/wiki/Robots.txt


--
Regards,
Steve Topilnycky
Top Cat Computing | Marine Corps League - Westchester County Detachment | ArGoStuff | Young Marines of Westchester
Scott McCullochUser is Offline
Administrators
Nuke Master
Nuke Master
Posts:11517


1/04/2008 5:59 AM  
It would be good if the rewriter supported this as a page moved http code, some of bruce's code did this I think.

Scott McCulloch
Site Administrator
Déclic VidéoUser is Offline
Gold Membership
Nuke Master
Nuke Master
Posts:593


5/11/2008 12:11 PM  

Yes, I confirm. I have just installed Bruce Chapman URLMaster, and it does 301 redirect (on deleted webpage).
Just perfectly !!

DV FX


Non linear video editing software, tips and tricks, tutorials... Déclic Vidéo FX
TareqUser is Offline
Gold Membership
Nuke Addict
Nuke Addict
Posts:53

7/29/2008 6:32 AM  

There are few ways you can do it. Robots.txt willstop the spider from indexing it but not removing it.

If you want it not to index you can also add certain keywords to stop it from being indexed such as noindex.

You can use Google Webmaster Tools. Once you create your account you can login and see a tab for tools. Under there you will see a option for remove urls. You can submit your link there to be removed. You can also remove a whole directory or site if you like.

Another good option is to do 301 redirect if you have moved your page. It helps keeps you Google ranking as well.

 

Hope wthis info will help you.


Fowara.com
Planet Tutorials
You are not authorized to post a reply.
Forums > General > DotNetNuke Questions > How to stop Google spider looking for a deleted page?



ActiveForums 3.7