Monday, September 6, 2010

A gateway is like a bridge, right?

Well, the concept of a bridge is not completely wrong.  "A gateway is a network that acts as an entrance to another network," therefore, acting like a bridge. (wiki)  One kind of gateway is that of library gateways which are created by specialists or librarians to support academic needs.  The other kind of gateway is that of subject specific databases also known as vortals.  Such databases are about a specific subject and are created by subject specialists or organizations. Gateways and subject specific databases assist searchers in locating resources that are in the "invisible web." Resources located in the invisible web are inaccessible through regular search engines because they require pass words, include documents behind firewalls, archived material, and other obstacles.  In order to access such material, one needs to find direct links to such documents or websites.  Use library gateways when looking for accurate academic content and subject specific databases when searching for direct links to specific topics. Examples of such networks are: Academic Information (Library Gateway) and Expedia (Travel, Subject Specific DB).

I had no idea about such bridges!  I have experienced problems when searching for specific pdf files online because many are blocked off.  However, if I search with specific criteria and point directly to the link I can get through! Beneficial information for the future. Previously, I was not familiar with any library gateways but I was familiar with some subject specific databases even though I was not aware of it.  I usually search for hotels or travel packages through expedia and I find it so much better than using an entire search engine with thousands of responses about "cruises" or "Boston."  A question I asked after reading about subject specific databases was, "How do they differ from subject directories?" As I visited each kind, I quickly noticed that subject specific databases are like search engines for one specific subject only such as travel, educational references, computer software, etc.  A subject directory is just that, a directory to various subjects.  A directory usually consists of various subject categories and subcategories.  For example, on a directory you may find "Health" as a category and then "health and fitness" and  "food and diet" as sub categories. Through re-reading the Bare Bones Tutorials, I am coming to understand the differences and similarities in search engines, subject directories, and subject specific databases.  Aside from noticing the differences, I am coming to appreciate their uses and the benefits of having access to such technological tools.

Metasearchers vs. Subject Directories

Metasearch Engines search various databases at the same time from a single site thus providing you with a quick list(s) of results from multiple databases.  This can assist you in finding out which search engine would best meet your immediate needs.  Metasearchers are fast and provide you with quick results but they do not offer as many results as search engines.  One example of a metasearcher is: dogpile.

Subject Directories are not search engines.  Instead of using "spiders" to maintain their pages, they employ human editors. Subject directories can run individually, partner up with  one another, or partner up with a search engine (Gigablast).  Since the selection of resources is reviewed by humans, a higher quality of content is provided through subject directories.  Updating resources is a thougher job when carried out by humans, therefore, more dead links appear under subject directories than in search engines. One example of a subject directory is: looksmart.

Reading this made me think, "Do we really need anything else aside from search engines?"  I don't think we NEED other things but I think that they are beneficial to have.  We usually conduct searches for different purposes such as for pleasure, work, and academic reasons.  Therefore, we need various methods of meeting those different needs.  If we are conducting research for an academic reason then maybe we should stick with search engines to provide us with a broad choice of resources.  However, if we want to narrow our search and find more reliable material then we can turn to a subject directory.  If we are just browsing for a subject of interest such as health or education, then maybe it would be less time consuming to browse using a subject directory instead of an entire search engine.

"You mean there are spiders crawling inside my computer?!"

That was my first thought as I learned about how search engines work. Yes, a little naive but you must understand that I never wondered about how web information was sorted or accumulated.  All I ever knew was that I had to type something in and then take the time to sort out the best response.  Truth is that "spiders" are used by search engines to compile databases.  These figurative spiders search the web and index pages which are then stored in a database.  The spiders regularly return to the sites that they have indexed and make updates if needed. Therefore, a search engines is made up of only the sites that have been indexed and not the entire web.  Search Engines will vary in speed, size, pages indexed, and their ranking criteria which will in turn affect your searches.  A search engine will always have results for your searches but that may present a problem.  For example, if the search criteria or key words are not specific you may be faced with thousands of responses, many of which are not relevant or reliable.  Examples of search engines are: Google (Individual) and Gigablast (partnered with subject directories).

Here is a website that helped me visualize what "spiders" do in a search engine:

http://www.webconfs.com/search-engine-spider-simulator.php

http://www.webconfs.com/spider-view-article-9.php