Tony M Posted June 20, 2010 Posted June 20, 2010 How to configure My site to enable If-Modified-Since Header ( http://www.feedthebot.com/ifmodified.html )?
Byron Posted June 20, 2010 Posted June 20, 2010 The server already sends a Last Modified header for html pages but not for php or cgi pages. Why do you want this enabled? I'm not sure but you might be able to do this with htaccess?
Tony M Posted June 20, 2010 Author Posted June 20, 2010 Why do you want this enabled? The problem is that I have more than 520 pages and all of My pages are now .php , so if this "If Modified Since" is disabled "Google" will crawl and crawl and crawl.... every day the same pages and the same contents because he receives that these pages are changing every seconds (and this is not true, I only change these 520 pages only once per Year, or per month...). I do not have a big problem about this, but Your Servers Might, because "Google" might send more than one requests (or pings) per second, so My account will be overloaded and You might Ban or Terminate My account. (I noticed that almost any php website on the internet do not use this "If Modified Since") (I do not know or have an experience about this thing or what can happen) So I want to know is this ok (so that "Google" crawl and crawl a website without stopping and might not affect very badly on My account) or it might affect very badly My account or Your servers? (sorry for My Big questions : but this question concern every account or users that use .php and have more than 100 pages )
Byron Posted June 21, 2010 Posted June 21, 2010 I really don't think this is going to be a problem since Google crawls everybody's site as often as they want on our server. As far as why we don't send a Last Modfied header for php pages, I can't say and so that's why I'm moving this to djbob.
laiam Posted June 21, 2010 Posted June 21, 2010 cant you just echo a meta revisit tag? echo '<meta name="revisit-after" content="60 days"> '; Yeah I realize robots don't exactly pay attention to it most of the time but...
Ashoat Posted June 21, 2010 Posted June 21, 2010 We support it by default. If you're not getting it on a dynamic (scripted) page, you might need to add to manually. http://www.feedthebot.com/tools/if-modified/
Tony M Posted June 21, 2010 Author Posted June 21, 2010 You might need to add to manually. Ok, Djbob , How can I add to manually?
Byron Posted June 22, 2010 Posted June 22, 2010 This will add the Last Modified header to all of your files that end in php. This goes in your root .htaccess file. <FilesMatch \.php$> Header set last-modified "Mon Jun 21 00:32:50 EDT 2010" </FilesMatch> You would have to manually change the date when you edited your files.
Recommended Posts