Search Engine Marketing - PPC Management Services

Search Engine Robots - How They Work, What They Do (Part II)

If your site isn't found in the search engines, it is probably because the robots couldn't deal with it. It could be something as simple as not being able to find the site, or it may be more complicated issues involving the robot's not being able to crawl the site or figure out what your pages are all about.

Submitting your site to the major search engines: that will help with the "can't find it" problem. Even having links pointing back to your site can be enough to attract the search engine robots. Google, for example, suggests that you may not have to submit your pages; they will find your site if you have a link pointing back to it from at least one other site on the web.

If the robots can find your site but can't make sense of it, then you may need to look at the content and technology used on your pages. Frames, Flash, dynamically generated pages, and invalid HTML source code can cause problems when the search engine robot tries to access your web pages. While some search engines are beginning to be able to index dynamically generated pages and Flash (e.g. Google and AllTheWeb), use of some of these technologies can hinder your ability to be indexed by the search engine robots.

Text in images cannot be read by the search engine robots. Using ALT image text is an important way to help the robots "read" your images. Websites with extensive images rely heavily on ALT text to present their content. How Do I Get The Most Out Of Indexing?

If you know what to "feed" the spidering robots you will help yourself with search engine ranking.

Having a website full of good content is the major factor. Search engines exist to serve their visitors, not to rank your website. You need to be sure to present yourself in your site in the way that will be most useful to the search engine visitor. Each search engine has its own idea of what is important in a page, but they all value text highly. Making sure that the text on your pages includes your most important keyword phrases will help the search engine evaluate the content of those pages.

Making sure that you have good title and meta tags will further assist the search engines in understanding what your page is about. If the text on the page is about widgets, the title is about widgets, and the meta tags are about widgets, the search engine will have a pretty good idea that you are all about widgets. When their visitors search for widgets, the search engines know to list your site in the results.

A sitemap page is a very good way of giving the search engine robot every opportunity to reach your website pages. Since robots click through the links of your web pages, make sure that at least your most important pages are included in the sitemap; you may even want to include all your pages there, depending on the size of your site. Be sure to add a link to the sitemap page from each page on your site.

Another important consideration is that of keeping all of your pages within a small number of "clicks" from your top page. Many robots will not follow links more than two or three levels deep, so if your "widgets" page can only be reached from your home page by following multiple links (e.g. home page >> about us page >> products page >> widgets page), the robot may not crawl deep enough to get to the widgets page. Testing Your Website For Search Engine Robot Accessibility

To get an idea just what the search engine robot "sees" on your page, you can look at the Sim Spider tool. You may be surprised at how different your site looks to the robot. You can find this tool at http://www.searchengineworld.com/cgi-bin/sim_spider.cgi

You will see text and ALT image text show up in the results. If your entire website is built in Flash, you will see nothing at all because robots don't understand Flash movies. The Bottom Line

When it comes to search engine robots, think simply. Lots of good content and text, hyperlinks the robots can follow, optimization of your pages, topical links pointing back to your site and a sitemap will help insure the best results when the robots come visiting.

Resources

*SpiderSpotting - Search Engine Watch http://searchenginewatch.com/webmasters/spiders.html

*Robotstxt.org List of robots and protocols for setting up a robots.txt file. http://www.robotstxt.org/

*Spider-Food Tutorials, forums and articles about Search Engine spiders and Search Engine Marketing. http://spider-food.net/

*Spiderhunter.com Articles and resources about tracking Search Engine spiders. http://www.spiderhunter.com/

*Sim Spider Search Engine Robot Simulator Search Engine World has a spider that simulates what the Search Engine robots read from your website. http://www.searchengineworld.com/cgi-bin/sim_spider.cgi

Daria Goetsch is the founder and Search Engine Marketing Consultant for Search Innovation Marketing, a Search Engine Optimization company serving small businesses. She has specialized in Search Engine Promotion since 1998, including three years as the Search Engine Specialist for O'Reilly Media, Inc., a technical book publishing company.

Copyright © 2002-2005 Search Innovation Marketing. http://www.searchinnovation.com All Rights Reserved.

Permission to reprint this article is granted if the article is reproduced in its entirety, without editing, including the bio information. Please include a hyperlink to http://www.searchinnovation.com when using this article in newsletters or online.

MORE ARTICLES:

SEO Link Building and Copywriting Service Relaunched by Search Engine Optimization Firm Brick Marketing
Brick Marketing has realized the importance of incorporating and combining link building into all aspects of online marketing for each of their clients. They have since re-launched their link building service for those interested in introducing online marketing in their business model.

Why PPC And SEO (Search Engine Optimization) Are The Most Popular Web Site Promotion Methods
There has to be a reason why PPC (pay-per-click) ads and SEO (search engine optimization) are the two most popular website promotion tools on the World Wide Web today. As a matter of fact, it is not too difficult to figure out why these two website promotional methods are so popular. It is quite simple ? they work. Actually they are very fast and effective in getting traffic to a web site. Internet Marketing can be overwhelming for some but if you leave it to the reputable professionals you can expect great results. Picture this situation. You select a few keywords come up with some attractive headlines and then launch a PPC ad campaign with Google Adwords. The next thing you know is that your site is receiving a steady flow of traffic...

Search Engine Marketing Agency, Target Marketing Solutions, Announces Four New SEM/SEO/PPC Clients
More and more companies are utilizing search engine marketing as a key advertising strategy for reaching potential customers. Through the use of website analytics, search engine marketing provides trackable and actionable data to maximize advertising effectiveness.

New Law Firm Marketing Subsidiary Combines Web Design and Search Engine Optimization for Lawyers
For over a year, Adviatech has been providing web design and search engine optimization for lawyers. Now they have launched a subsidiary to specialize on the niche service.

Engine77 -- Search Engine Internet Optimization Firm Unveils New SEO Technology and Service
Infinidigm, Inc., a search engine optimization, search engine marketing, and software development firm, announces its cornerstone search engine marketing and search engine optimization technology-based service called Engine77. Engine77 is a robust software platform and service used to optimize web sites, perform market research, and develop sites based upon the analysis.

Internet Marketing Expert Shows How Search Engine Optimization and RSS Can Boost Public Relations Visibility
TopRank CEO Lee Odden to Speak at Bulldog Reporter's Advanced Public Relations Technology in Practice Event

PPC Summit Workshops: Learn Search Engine Marketing in Two-Day Seminars from Search Industry Experts
PPC Summit unites some of the foremost minds in the pay per click advertising world to change the way the subject is taught. Targeted at a range of skill levels and suitable for a wide variety of professionals, participants acquire new skills and leave with a solid understanding of search engine marketing. The team is bringing their seminars to cities all over North America, as well as London in the UK, in 2007.

BrainPulse Technologies: Launches Advanced Internet Marketing / Search Engine Optimization (SEO) Services
BrainPulse has stepped forward to revolutionize Internet marketing and SEO Services to help global businesses achieve their internet marketing goals effectively and in a planned strategical manner to enhance the marketing campaing effectiveness and maximize the return on investments.

Search Engine Optimization Firm, Brick Marketing Revises Search Engine Optimization Service
Brick Marketing, an internet marketing company, has recently revised and re-launched their search engine optimization services to adjust with growing trends. Brick Marketing has acknowledged that a revision of this product and the way it was offered to our clients had to be revised in order to stay competitive with other agencies. Potential customers can now be accustomed to similar pricing strategies has other players in the industry. The online marketing industry is a very fast moving industry with changes occurring sometimes over night. In order for firms and consultants to stay in a competitive range a watchful eye must be kept on all offerings in order to be able to provide only the best solution for clients.

Bill Casey Opens Full-Service Web Site Design, Development and Search Engine Optimization (SEO) Firm
New Atlanta web site design and SEO firm gives small and medium sized businesses a simple and effective path to creative, profitable web sites. Bill Casey Consulting provides all the web services a business needs, gauges its success on the profitability of its clients' sites, and streamlines the development process to lessen client burdens.

Search Engine Optimization Firm, Epiar Inc., Unveils New Paid Search Advertising Service
After months of testing, Epiar has taken pay-per-click (PPC) advertising to the next level with the launch of its new service to the general public. Epiar is introducing the service at the New York Search Marketing Expo Conference Oct. 6-8.

Local Search Engine Marketing Expert to Speak at Search Engine Strategies Conference in Chicago
Janet Driscoll Miller, a local leading search engine marketing expert, will be speaking at the Search Engine Strategies Conference in Chicago on Monday, December 4, 2006. Miller is the president and CEO of Search Mojo, a search engine marketing firm.

Twelve Horses Expands Search Engine Optimization, Search Engine Marketing Services
Through hiring SEO expert Eric Morgan Twelve Horses has expanded its service offering to include SEO. Twelve Horses is a Reno based company that currently provides web design, web development, and email marketing services to clients on a national basis.

Atlanta Search Engine Marketing Firm Prominent Placement is Finalist for Three American Marketing Association Awards
Prominent Placement, Inc., a leading Atlanta search engine marketing firm, received three Atlanta Marketer of the Year (AMY) Finalist Awards from the American Marketing Association (AMA). All three of the firm's entries were selected as finalists out of 130 total submissions.

Search Engine Marketing Agency Launch Mobile Search Marketing Service
With close to 3 billion mobile device users worldwide, Search Engine Marketing Agency Neutralize has responded to client demand with the launch of Mobilize.