To avoid undesirable content in the search indexes, webmasters can instruct spiders not to crawl certain files or directories through the standard robots.txt file in the root directory of the domain. Additionally, a page can be explicitly excluded from a search engine's database by using a meta tag specific to robots (usually ). When a search engine visits a site, the robots.txt located in the root directory is the first file crawled. The robots.txt file is then parsed and will instruct the robot as to which pages are not to be crawled. As a search engine crawler may keep a cached copy of this file, it may on occasion crawl pages a webmaster does not wish crawled. Pages typically prevented from being crawled include login specific pages such as shopping carts and user-specific content such as search results from internal searches. In March 2007, Google warned webmasters that they should prevent indexing of internal search results because those pages are considered search spam.
For some Organic Traffic is the bread and butter of PPC and Affiliate advertising income. The landing pages of Organic Traffic provides an opportunity for bloggers to make some decent money. The general idea behind organic traffic is to optimize your website so it’s friendly to search engine bots which allows your website to be properly indexed from Google and other major search engines.
Number two is http://flickr.com, a photo sharing site. To get traffic with this site you have to create interesting, niche targeted images or take interesting niche targeted photos or screenshots, sign up, upload the photos using proper tags (keywords) to make the traffic targeted, and say in the description of the photo: “Feel free to use this image, but give credits to http://www.yourwebsite.com.”, and then you’re getting permanent, targeted, free traffic forever from people sharing your photos and crediting your link.
#6 Go on podcasts! In 13 years of SEO and digital marketing, I’ve never had as much bang for the buck. You go on for 20 minutes, get access to a new audience and great natural links on high dwell time sites (hosts do all the work!). Thanks for including this tip Brian, I still don’t think the SEO community has caught on to the benefits of podcast guesting campaigns for SEO and more…it’s changed my business for sure.
The majority of web traffic is driven by the major commercial search engines, Google, Bing, and Yahoo!. Although social media and other types of traffic can generate visits to your website, search engines are the primary method of navigation for most Internet users. This is true whether your site provides content, services, products, information, or just about anything else.