Click to Play

Mobile Marketing: Why Not?
Did you know that the average U.S. mobile subscriber sends and receives more text messages than phone calls? Additionally, there are approximately 4.1 billion...

Recent Articles

Controlling Your User Generated Blog Content
When thinking about a blog, one big thing that a lot of companies are concerned with is control. They are worried about what may get posted on their blog...

Widget Development Checklist
This is post two of a three part series on how to use widgets for marketing. Widget development can be costly and time consuming. It is important to ask...

SEO Guide For Webmaster Tools
Google Webmaster Tools is a free service that provides a wealth of information directly from Google. Once you have verified a site with Google, they'll give you...

Understand The Use Of Natural Language Optimization
Not long ago we got word that a new search engine will launch in May that will rely heavily on Natural Language Processing (NLP). And we have even heard Eric...

Why Allinanchor Is Important
It is a known fact that the number of links to a particular website play a crucial role in deciding its position on the search engine ranking results. But, how important...

Checking Your Site For Clean Web Links
Link building continues to be an important part of marketing and optimizing web sites and web marketers can often get distracted by quantity goals rather...


06.04.09

Tips To Not Creating Duplicate Content In WordPress

By Barry Welford

The best way to ensure a web page ranks well in Google keyword searches is to make sure it is the only one on the web that includes the content on the page. In this way you avoid several web pages all having a somewhat equal possibility of being judged relevant for the particular keyword search. This increases the chance that this unique page will outrank other quite independent web pages that cover the same topic. That's the theory and it seems to work out well in practice.

Wordpress is a great software for producing blogs but out-of-the-box the WordPress content management system produces a series of pages that all contain the same content. Just see the concerns expressed in this WebmasterWorld thread about WordPress And Google: Avoiding Duplicate Content Issues where several coding suggestions were offered to avoid the problems. More recently, David Bradley has suggested that something called the canonical link element can be the solution to Avoiding Duplicate Content Penalties.

We should quickly add that this is not an inherent weakness of WordPress alone since many other CMSs will suffer from similar problems. It is a well known problem and you can find an excellent article on how to Avoid Duplicate Content on Wordpress Websites, which gives the appropriate steps to take. The most important step of all is to have the right robots.txt file.

I wondered how well people were grappling with this duplicate content problem and decided to check out some of the Technorati's Blogger Central / top 100 blogs. In particular I thought a check of their robots.txt files would give an indication on whether they had tried to solve the problem. Here is what I found for the robots.txt files for the most popular 8 blogs.

The Huffington Post
# All robots will spider the domain
User-agent: *
Disallow:

# Disallow directory /backstage/
User-agent: *
Disallow: /backstage/

TechCrunch
User-agent: *
Disallow: /*/feed/
Disallow: /*/trackback/

Relax and Enjoy Free* Managed Hosting till
the Summer Solstice 21st June 2009

Engadget
(empty)

Boing Boing
User-agent: *
Disallow: /cgi-bin

Mashable!

User-agent: *
Disallow: /feed
Disallow: /*/feed/
Disallow: /*/trackback/
Disallow: /adcentric
Disallow: /adinterax
Disallow: /atlas
Disallow: /doubleclick
Disallow: /eyereturn
Disallow: /eyewonder
Disallow: /klipmart
Disallow: /pointroll
Disallow: /smartadserver
Disallow: /unicast
Disallow: /viewpoint

Continue reading this article.

About the Author:
Barry Welford, President of SMM Internet Marketing Consultants works with business owners and senior management on Internet Marketing strategy and action plans to grow their companies. He is a moderator at the Cre8asite Forums and writes on Business and the Internet in four blogs, Senior Money Memos, BPWrap, StayGoLinks and The Other Bloke's Blog.
About DevWebProNL
DevWebProNL is for professional developers ... those who build and manage applications and sophisticated websites. DevWebProNL delivers via news and expert advice New Strategies In Development.





DevWebProNL is brought to you by:

SecurityConfig.com NetworkingFiles.com
NetworkNewz.com WebProASP.com
DatabaseProNews.com SQLProNews.com
ITcertificationNews.com SysAdminNews.com
LinuxProNews.com WirelessProNews.com
CProgrammingTrends.com ITmanagementnews.com






-- DevWebProNL is an iEntry, Inc. publication --
iEntry, Inc. 2549 Richmond Rd. Lexington KY, 40509
© 2009 iEntry Inc. All Rights Reserved Privacy Policy Legal

archives | advertising info | news headlines | free newsletters | comments/feedback | submit article


Delivering IT Solutions DevWebPro DevWebPro Home Page About Article Archive News Downloads WebProWorld Forums Jayde iEntry Advertise Contact