Search Engine, Site Updates | featured news

Relieving High Server Load by Blocking Search Bots

Coding

Over the years, whenever the site was slow to load up, I always went through the same routine. I checked traffic logs to see if it was due to a sudden increase in traffic. If not, I would look at the mysql slow query log to see if there were slow queries bogging up the database. If that wasn’t the culprit, then I would take a look at the access logs to see if there were any irregular activities from search engine bots.

 

Pages Not Indexed by Google Because of Autofresh

Pages Not Indexed by Google Because of Autofresh

About a year ago, I decided to add an autorefresh to pages that contain feeds so that content would always stay fresh. I set it to autofresh every 3 minutes. I could have been done this via ajax, but my ajax kung fu wasn’t good enough then (or now). I went with the easiest method, which is a simple meta tag addition to those pages. I got the idea from Drudge Report.

It was fine for about a year until the week of the Panda Update 2.2, when all pages with the autorefresh would give the Googlebot errors and not get indexed.

 

Google's Panda Update Took a Big Bite Out of My Traffic

Google's Panda Update Took a Big Bite Out of  My Traffic

Google have been tweating their search algorithms this year to battle content farms and scrapers. They named this tweak Panda Update. In February of this year, they released the first version, which was aimed at lowering the rankings of content farms - i.e. eHow, ezinearticles.com, and wisegeek.com. I don’t consider my site a content farm, but I did saw a 40% decrease in traffic as soon as the new algorithm went live.

 

Google's New Search Algorithm Change Took Out 40% of My Google Traffic

Google's New Search Algorithm Change Took Out 40% of My Google Traffic

Last Thursday, Google launched a new tweak to their search algorithm. It was targeted at content farms, which many consider to be spammy sites whose content are created solely to attract search engine traffic for specific keywords.

I do notice more and more of these sites on Google’s search results. For me, the main offender is ezinearticles.com. Most of the articles I get from there are completely useless. They’re just keywords being repeated over and over again with a bunch of fillers. I can see why Google wants to push those sites further down their search rankings.

 

Want Your Articles on Google Instantaneously? Digg it.

Want Your Articles on Google Instantaneously? Digg it.

I'm just starting to submit stories from my blog to Digg, hoping against hope that they'll get some Digg love and drive some traffic back here. So far, no luck. The only Digg love my blog entries get is from me - and ONLY me. But I noticed a nice side effect - articles submitted to Digg almost instantly appear in Google's search results. Nice! Sure, the link goes to Digg, but from there, potential users can get here. It's a good trade-off.

 

New Feature: Search

You may have noticed a search bar at the top the page. It's brand spanking new. It searches the top newspaper sites (CNN, NY Times), aggregation sites (Google News, Digg), blog search sites (Twitter, Technorati), and video sites (YouTube, Hulu) for any news topic and lays them out like a newspaper rack. Now, you can instantly get the latest news and buzz on any news topic. Here are some examples:

Barack Obama
http://www.wopular.com/newsracks/barack+obama

Air France
http://www.wopular.com/newsracks/air+france

The Tonight Show
http://www.wopular.com/newsracks/tonight+show

 

Subscribe to this RSS topic: Syndicate content