Rapidig.com – A Rapidshare search engine to help you find Rapidshare links for your desired keywords.

How Rapidig.com works?
Rapidig.com has robots that crawl all over the www and find rapidshare links and update our Rapidshare links database. We have three more ways to update our database. You can find them in Submit RapidShare Links page.

Why Rapidshare search engine?
If you had experience of using rapidshare.com, you know that you can not search links in rapidshare.com. So What is solution?
A Rapidshare search engine like rapidig.com.

This article is not intended as a gentle introduction to CSEs. For that, you may want to start with this overview of Google Custom Search Engines or this article showing how to build a good Custom Search Engine.

Let’s look at an example of customization. With CSEs, it’s easy to say “build me a search engine that searches the entire web, but gives these hand-picked resources (pages, groups of pages, or entire sites – you choose) a ’boost’ in the rankings, so that they tend to show up high on the results page.” In fact, this may be one of the most common use cases, and it’s supported naturally in the basic CSE user interface.

A little experience with the CSE, however, shows that the standard amount of “boost” that you can apply often isn’t enough to help your “weaker” pages (weaker, as in lower ranking in a “normal” Google search) overcome the stronger ones that Google normally ranks highly. The standard boost may indeed help them rank higher in your CSE than they would in a “normal” search, but often they’re not boosted high enough, and they can still be lost in the sea of results past the first page or two. Thankfully, CSEs provide a way to custom tune the amount of boost. To take advantage of this feature, you need to delve into the land of XML annotations.

A little Google Co-op background is in order before we go further. Many people may not realize that CSEs are built on top of the extremely powerful Google Co-op Topics “engine.” Some of the advanced functionality of Co-op Topics is hinted at, but not really directly exposed, in the CSE docs and user interface. To get at this functionality, you must understand several more advanced topics, and must also be willing to get your hands dirty with a little bit of XML code.

Specifically, you need to develop an understanding of what’s happening on the “Advanced” page of the Google CSE control panel, the land of context files and annotation files. This is not “rocket surgery” (as usability expert Steve Krug would say), but it’s somewhat more involved than filling in forms. It’s probably on the order of difficulty of creating your first web page, learning basic CSS, or writing Excel spreadsheet macros.

A custom wine search engine

Let’s start with a simple CSE, one that will help us explore the world of wine. If you’re following along, now is the time to go create a CSE just like the one we’re using. To do that, create a new CSE with the following sites. To be sure to get the same results we’ll show here, specify “wine” (no quotes) for your “Search engine keywords”, and check “Search only included sites.”

http://en.wikipedia.org/wiki/Wine
http://www.winespectator.com/Wine/Home/
http://www.wineloverspage.com/
http://www.wine-searcher.com/
http://www.intowine.com/
http://www.wineinstitute.org/
http://www.winemag.com/homepage/index.asp
http://www.erobertparker.com/
http://www.tasting-wine.com/
http://www.winebusiness.com/
http://www.terroir-france.com/

Let’s try out a query. Go to your new Custom Search Engine’s homepage and search for “tasting” (no quotes). You should see results very similar to those shown below.

Let’s assume that these results seem pretty reasonable, but that when we look closely, we decide we’d like to make some adjustments. For example, the first result under “tasting” is from Wikipedia, and while of good quality, we think that the 5th result, labeled “Tasting wine: tasting techniques…” is a better choice. Since this is a custom search engine after all, we should be able to adjust these results as we see fit.

In order to make this kind of adjustment, we need to roll up our sleeves and take a look at what makes this CSE tick. Let’s start by going to the “Advanced” page of the Control panel, where we find sections devoted to “Annotations” and “Context.” Let’s get familiar with these entities, one at a time. A context contains the structural definition of a Custom Search Engine, viewable in text form (specifically, in an XML representation). It contains almost all of the visible stuff you entered in the “New search engine” wizard, such as the name, description, keywords, etc. What it does not contain is any information about the specific sites you’ve included (dramatic foreshadow: remember this factoid when we talk about “Annotations” a little bit later). The easiest way to see a context is to simply click on the “Download” link (shown just above the yellow “warning area” on the bottom half of the page). When you do this, you’ll see something like this in your browser window:

Let’s go ahead and save this XML to a file. This will allow us to edit the context definition and upload our changes back to Google, giving us complete control over the process of customizing our search engine. To save the context to a file (these instructions are for Firefox; your steps will differ slightly for IE), simply click on File->Save Page As, and choose a filename and directory to save the file in. The filename wine-context.xml is a reasonable choice.

Hint: while the link labeled “download” strongly implies saving a file somewhere, that’s a bit misleading. You can always come back and click on this link and simply display the XML in your browser, as you did a moment ago, without any intention of saving anything. This is often a quick way to see the details of how your CSE is structured. I try to think of “download” here as more like “preview,” which reminds me that it’s an easy way to simply view my XML – a useful function when customizing a CSE!

After saving the context file, let’s once again look at it in our browser. All default context files are going to have a section called <Background Labels> that looks something like the one you’re looking at. Background labels are where you define the basic controls you have at your disposal for customizing your search engine. Think of a context file as a place where you can create new “knobs and switches,” such as one for deciding whether or not a page (actually, a URL) appears in your CSE results, one for determining whether or not its ranking in the result list gets promoted or demoted, etc. Let’s make the connection: if you want to include a URL (or set of URLs) in your CSE, you’ll tag (or “annotate”) the URL(s) with the first label, the one with the mode=”FILTER” setting. This tells the CSE to include these URL(s) in the search results if they match the user’s query. If you want to exclude URLs, they must be tagged with the second label, the one with the mode=”ELIMINATE” setting. We’ll talk a lot more about how you actually go about annotating URLs in a moment.

For now, let’s study the context file a bit more. The background labels that appear in our context file were determined by one of the choices made when the CSE was created (this setting is also shown on the “Basics” page of the control panel, shown below). Choosing “Search only included sites,” as we did, produces the “FILTER” and “ELIMINATE” background labels, labels that are useful for this “gross level adjustment” of including or excluding pages and sites. We can apply these labels to any pages we want, thereby tagging them to either be included or excluded from our CSE.

Let’s see what happens when we instead choose “Search the entire web but emphasize included sites” (go ahead and make this change on the “Basics” page of the Control Panel). Now, viewing the context file by once again clicking on “download” from the Advanced page, we see a slightly different set of background labels, reflecting a slightly different goal. Below we show the context file, with the background labels that result from this choice (if you’re following along at home, your label names, which are generated uniquely for each user and CSE by Google, will be slightly different):

In this case, we’ve told Google that we want our CSE to include the entire web (and this is an implicit function, so there’s no need for a label like “FILTER” to include sites), but we want to emphasize certain sites. For the emphasized sites, we’re going to apply the “BOOST” label. You can see that the “BOOST” label also has a “weight” attribute, and the default value for this is “0.69999999”. This brings us back to our initial requirement: how do we assign a higher level of boost to certain pages? It’s pretty obvious that this is going to be done by changing the “weight” attribute, and it turns out that weights can have values between -1.0 and +1.0. Furthermore, a negative weight is used to imply a “demotion,” that will de-emphasize (in the results) URLs that it’s applied to, and a positive weight is a “promotion,” which will emphasize URLs. So the solution to our problem is simple: to get higher boost, we need to set a higher weight on our “BOOST” label.

Thinking about this for a moment, we can see that it’s not enough to just raise the weight value on the BOOST label, for that would emphasize all of our “boosted” sites by the same amount. Instead, what we need is some granularity – the ability to apply different weights to different URLs, so that we can raise or lower them individually. The solution to this is straightforward: we need to create multiple background labels, each with mode=”BOOST”, but with different weights.

Adjusting the filter

There’s one more subtle point we need to cover before we can assemble all the pieces. It turns out that we glossed over the “FILTER” mode when we introduced it earlier and said that it’s used to include URLs in a CSE. What FILTER actually does is this: it tells the Custom Search Engine to only include URLs that have been labeled with the FILTER label. That is, it’s a strict filter: only labeled URLs show up, and all others are “filtered” out. This is how Google implements the ability to limit a CSE’s search scope to only selected sites. If we look closely at our second context file, we note that it has a BOOST and an ELIMINATE label, but no FILTER label. This makes sense because this is the context file that we would use for searching the whole web (except for those sites that we might explicitly exclude, hence the need for the ELIMINATE label) while “boosting” our selected sites.

To get the fine-grained adjustments we want, it’s helpful to list our requirements out like this:

1. include only URLs that I’ve labeled for inclusion
2. boost certain URLs that I’ve labeled for promotion
3. exclude certain URLs that I’ve labeled for exclusion

Having done this, it’s clear we need three “knobs,” or background labels. We can now write the XML for these background labels:

<Label name=”_cse_vvfrmdvd_ai” mode=”FILTER” />
<Label name=”boost-high” mode=”BOOST” weight=”1.0″ />
<Label name=”_cse_exclude_vvfrmdvd_ai” mode=”ELIMINATE” />

For the moment, please simply accept the label names we chose. We’ll explain them in a few minutes. You’ll notice that we simply used the existing labels from our very first example (the default context file generated when we selected “Search only included sites”), and added a new one with our “custom boost.” Now we can put all the pieces of the context file together, which we show below. If you’re following along with this tutorial, be sure to edit your wine-context.xml file and make it look exactly like this (your label names will be slightly different, since Google generates unique labels for each CSE). All you’re actually doing is adding the line with the BOOST label to your original context file. Add this line exactly as shown.

Once we’ve saved the context file, we need to make these labels known to our CSE by uploading them. As you might expect, you do this on the Advanced page of the Control Panel, in the “Context” section on the bottom half of the page, using “Browse” (to select your modified context file) and “Upload” to perform the upload. Google checks the format and contents of your file, and will notify you whether it successfully uploaded it, or found problems. If Google finds a problem, there’s a good chance it’s due to a missing or misplaced character, typically a “<”, “>”, “/”, or “,” in your file.

Annotating with labels

We’re now going to talk about how to use these labels. This is where we return to the concept of “tagging” or “annotating” that I referred to a few minutes ago. Normally, annotating goes on mostly “behind the scenes” as an implicit part of other activities. If you’ve created a CSE, you’ve already been annotating URLs in one of several different ways, even though you may not have recognized it as such:

1. Implicitly on the “Sites” page of the CSE control panel: including a site tags it with the “FILTER” label, telling the CSE to include the site (its URLs) in results; excluding a site tags it with the “ELIMINATE” label.
2. Explicitly, with the Google Marker bookmarklet, which allows you to apply labels, on the fly, as you browse pages on the web.

Annotation files

It turns out there’s yet another way – one that is far more flexible than the other two, but at the cost of being a little bit more complex and error-prone. You can do your tagging in an “annotation file,” which is an XML or tab-delimited representation of the tag/URL combinations, with a text editor (e.g., Windows notepad). Once created, the annotation file can be easily uploaded to the Google server. Annotations are pretty easy to understand: here’s an example of the annotation we’ll use to boost our preferred wine tasting page in our Wine CSE (XML version).

<Annotation about=”www.tasting-wine.com/*” >
<Label name=”boost” />
</Annotation>

The annotation has two key parts: the URL (or URL pattern) being labeled, which is specified in the about attribute of the <Annotation> element, and the label, which is specified by name in the <Label> element. So this annotation assigns our “boost” label to the “www.tasting-wine.com/*” URL pattern (this pattern matches all URLs on the www.tasting-wine.com/ domain). It specifies that all URLs coming from this domain should receive our custom boost, which is weighted at 1.0 (as defined in our context file).

Individual annotations must be contained within an annotation file, which has a specific format. A complete annotation file is shown below. Fortunately, it turns out that we don’t have to write this annotation file from scratch. As I mentioned, anything you do with URLs in a CSE is really supported, often “under the covers,” by annotation. For example, when you add sites on the sites page of the Control Panel, or through the Google Marker bookmarklet, this is really just an easy way of adding an annotation. These existing annotations can be downloaded and edited in a text editor, in much the same way that we did with the context file.

Let’s go ahead and download the existing annotations that were automatically created for us when we first specified the wine CSE. You’ve probably already anticipated how to do this: from the Advanced page. The link to do this is a little bit buried on the page. Look for the sentence that says “Download all your current annotations in the TSV format or XML format.” at the top of the upper light gray area of the page, and click on the XML format link. As with the context file, the XML is displayed in your browser and can be saved to a file. Do so now, saving the file as something like “wine-annotations.xml”. Using a text editor, modify the annotation file by inserting the <Label name=”boost” /> phrase for the existing <Annotation about=”www.tasting-wine.com/*” > element. When you’re done, the modified annotation file should look like the file shown below (note: except for the “boost” label, which should be identical, your label names will be slightly different because they were uniquely generated by Google). The section of the file that I modified is highlighted.

We should be able to just upload this file, and have it replace our existing annotations. While I was working on this article, however, I found that this action didn’t always produce the desired results (this may be a short-term bug). Just to be sure, we’re going to delete our existing annotations before uploading. To do this, go to the Sites page and delete all sites. (Note: be careful working on your own CSE; once you delete sites from the Sites page, you cannot recover them). Now return to the Advanced page, and using the “Browse” and “Upload” buttons in the “Annotations” section, find and upload the wine-annotations.xml file.

Testing our CSE

It’s now time to try out a search on our newly customized engine. Go to the Preview page and search on “tasting”. You should get results like those shown below, with our preferred wine tasting site boosted to the top of the results:

If all went according to Hoyle, you’ve now successfully tuned your CSE to provide a boost to a particular set of URLs (all those coming from the www.tasting-wine.com domain). You can, of course, tune at an even finer level of granularity, in several ways. You can use more specific URL patterns, including fully specifying a web page and applying a boost to that page. You can also create multiple different labels, each with a different level of boost, and selectively apply these labels to different URLs and URL patterns, as appropriate.

At this point, you have all the tools you need to experiment with different “boost weights.” Adjusting results (promoting and demoting URLs) is not an exact science, but with a little practice and experimentation, you should be able to have the kind of influence over the results page that you want.

John Biundo and Eric Enge of Stone Temple Consulting both worked in the tech industry for over two decades. Eric’s also the creator of the Custom Search Guide.

A surprisingly little-known fact is that Google, and some trusted partners, have quietly annotated a large number of web sites with standard labels. The fruits of this labor are quite visible in Google if you search on medical terms like “prostate cancer” or “bird flu”.

The results that you see, with the “refinement interface” prominently displayed above the list of search results, is another aspect of Google Topics, the platform that underlies Google Custom Search Engines. The same refinement UI you see here is available to authors of CSEs.

See Custom Search Engine Topic Refinement for a detailed tutorial on how to take advantage of the powerful topic refinement user interface provided by the Google Topics platform in your own CSEs.

The labels used in Google’s main search have an additional special property. Unlike the labels you create in your own CSE, the Google labels are public, which means they’re available to be used by anyone’s Custom Search Engine. This turns out to be a very powerful concept. Let’s look at a couple of examples of how you can exploit this power:

• If you build a medical-related CSE, you can use the standard Google medical labels to enhance your CSE. You can, for example, declare that you want your CSE to “boost all the sites that have been labeled ’medical_authorities’ or ’for_health_professionals’ in your results”. With this declaration , your site automatically promotes results that have been vetted by established medical authorities like Mayo Clinic, National Library of Medicine, Centers for Disease Control, and New England Journal of Medicine. Amazingly, you (and your users) automatically leverage thousands of hours of work done by medical experts!
• Or you can use the labels to create the same kind of refinement interface that Google uses in its main search (the UI you see when you search on “bird flu”) in your own CSE .

In addition to the medical domain, Google (and an impressive list of partners) have annotated many other “Topics”, including: destinations, autos, computers and video games, and other areas. It’s reasonable to expect that this annotation will continue – in fact, Google has a program that encourages users to help with the massive task of annotating the web.

More Fun with Standard Labels

In addition to these domain-specific labels, Google has labeled thousands of sites with labels like “blogs”, “faq”, “forums”, “news”, “reviews”, and “stores”. With these labels, and a little imagination, you can do all kinds of clever things, like:

• create a blog search engine in about 30 seconds by telling your CSE to search only sites that have been labeled “blogs” .
• a variation on that theme: create a vertical blog search engine (e.g., search across all SEO sites, but favor blogs in the results, or search all .edu sites, but show only blogs) .
• eliminate shopping sites from your results (e.g., create a vitamins/health food search engine that screens out shopping/stores sites, leaving just
  information/blogs/articles ).

Sample Code

Below are the relevant context files for each of the examples described above, along with some discussion.

Example 1: How to boost all the sites that have been labeled ’medical_authorities’ or ’for_health_professionals’ by the Google Health Topic community in your results.

Sample context file for example 1:

Adding the two labels to the BackgroundLabels section of your context file will do the trick. Be careful about using any “FILTER” type labels in your context file, as these may work to eliminate the Google labeled sites.

Let’s explore this a bit further. Let’s say you have actually annotated a large number of medical sites yourself, which you wish to define as the “universe” of results for your CSE. Within that universe, you wish to promote the Google labeled “medical_authorities” and “for_health_professional” sites. In this case, you will use a “FILTER” type label to limit the CSE results to only those sites you’ve labeled. Within that set, the Google labeled sites will be boosted. In this scenario, sites that you have not specifically annotated will not be included, even if they have been labeled by Google with one of the standard labels.

One final note: the boost weight selected is 0.69999999. The reason for this is somewhat arbitrary. This is the weight Google uses when you generate a default CSE with the CSE “wizard”, and choose to search the whole web, but boost your selected set of sites. There is very little documentation on how to choose the right weight value, and since this seems to be the default number that Google has settled upon, it’s what I chose.

Example 2: How to use standard labels to create the same kind of refinement interface that Google uses in its main search for medical terms.

Sample context file for example 2:

This context file defines a sophisticated topic refinement hierarchy, very much like the one used by Google for health-related searches. We haven’t mentioned any BackgroundLabels in this file, so by default, this CSE will search the whole web. Adding a combination of “FILTER”, “BOOST”, and “ELIMINATE” labels can allow you to very specifically define the scope and rankings used in your CSE, in addition to providing the advanced topic refinement user interface.

Example 3: How to use standard labels to create a blog search engine.

Sample context file for example 3:

This one is pretty straightforward. It simply performs a filter on the standard label “blogs” – causing only those sites to be included in search results.

Example 4: How to use standard labels to create a domain-specific blog search engine.

Sample context file for example 4:

The only difference between example 3 and example 4 is the addition of a second “FILTER” type label. The interaction between multiple “FILTER” labels can be thought of as “intersection”, or “AND”. Only URLs that meet all of the “FILTER” conditions (labeled “blogs” by Google, and labeled “seo_site” by the CSE owner), will be included in the results.

Note that this context file implies the existence of an annotation file where URLs/URL patterns have been associated with the label “seo_site”.

Example 5: How to use standard labels to screen shopping/sales sites from your results.

Sample context file for example 5:

This example proved to be an interesting exercise. If you create a CSE using this context file, and search on “vitamins”, you’ll see that it does indeed screen out some of the commercial sites that sell vitamins (compared to the same search on www.google.com). I was a bit skeptical, so I compared a search on “health food”, and found that a good number of commercial sites did, in fact, pass the screen and make it into my search results. This lead me to wondering what kind of sites Google has labeled as “stores”, and how extensive this labeling is.

To test this question, I created another, very similar, and quite unusual, CSE. Take a look at the following context file.

This context file does two, somewhat contradictory things. It creates a refinement interface that allows me to see all search results, for whatever term I search on (try “health food”), that have been labeled “stores”. It does this by specifying “FILTER” on the refinement label (the Label tag within the FacetItem element). Recall, however, that we also have a background label in place that eliminates all URLs that are labeled “stores”. Since a background label is, by default, in effect for all queries, our refinement would produce no results! Not terribly interesting. However, we can temporarily disable the effect of background labels with the very convenient “ignorebackgroundlabels” attribute (we set it to “true” to disable background labels). Doing this turns off all background labels while we are using refinements (i.e., when we click on the “stores” label in the refinement user interface).

All the above sounds more complicated than it really is. The easiest way to make sense of it is to simply create a test CSE, cut and paste the above code into a text file, and upload it (as the context file) on the advanced page of the control panel. Then try a few queries on the preview page.

After playing with this test CSE for a bit, it seems clear that Google has made a good start at labeling commercial sites, and that this could be very valuable for CSE builders. But it definitely needs more work. The good news is that you can create your own annotation file, using the “stores” label, and it is merged seamlessly with the standard set of Google annotations. So if you want to use this technique, you can simply set up a context file like the one shown in the example, then keep track of commercial sites that show up in your results, and annotate them with the “stores” label, and voila, they’ll disappear like magic.

John Biundo and Eric Enge of Stone Temple Consulting both worked in the tech industry for over two decades. Eric’s also the creator of the Custom Search Guide.

We do know that users care about searching. When a user begins a search, they want to find something. Since their real work begins when they are done searching, they want the search to be done fast, perhaps even instantly. We have all experienced it – where we do an initial search, find that the results are not what we want, we refine our search, and try it over again. Fundamentally, this whole process is a waste of our time until we get the result we want.

So here is the promise of custom search engines – if we find one we know and trust, we can find the answer we are looking for faster.

So now that we know what users are looking for, can we deliver it? Yes we can! The trick is to find those things that custom search engines can do better than core search. What I learned from discussions with Google Custom Search Engine creator Shashi Seth, is that Google does not know the user’s context. In other words – if a user types in “Ford”, are they looking for information on the company, a place to buy one, reviews of Fords, information on how they are manufactured, and so forth.

In simple terms, we don’t know if the query is being made by a consumer, a media person, or an automobile engineer. If we knew these things, we might be able to provide better results. However, it gets slightly more complicated – web sites don’t typically do a good job of indicating what type of audience they are tailored for either. So what to do?

Enter the CSE. Google’s Custom Search Engines enable human editors (Subject Matter Experts, or SMEs) to filter Google’s core search results. What this means is that the SME can decide what sites to include or exclude from the results, and they can decide to attach weighting parameters to the results to either increase or decrease the rankings of particular sites.

Using this mechanism, the SME can create a CSE that is specifically targeted to a given audience. For example, they can create a CSE for automobile engineers, that includes only those sites that provide engineering and design related information (design magazines, related patent filings, any sites where relevant forums have been setup, etc.).

This will provide the auto engineer a directly relevant result, without the clutter of sites that are intended for other audiences. Ultimately, this will save them time and energy in going their work.

So now that we have the idea, let’s look at a couple of examples. First a comparison of a CSE designed to provide medical information to doctors, as compared to core Google search (the Google results are on the right):

As you can see, more relevant results have been brought up to the first page of the results, increasing the chances of the doctor getting their answer right away. Let’s also compare the results of a CSE designed for patients with core Google search results (the Google results are on the right):

You see that they both have been optimized for their audiences. So CSEs do in fact address a real problem in algorithmic search. Our experience in reviewing CSEs is that about 10% of the people fully understand this issue at this point. But more and more people will come to understand it over time, and this will create increasing usage.

About the Author

Eric Enge is the President of Stone Temple Consulting. Eric is also a founder in Moving Traffic Incorporated, the publisher of Custom Search Guide, a directory of Google Custom Search Engines, and City Town Info, a site that provides information on 20,000 US Cities and Towns.

Stone Temple Consulting (STC) offers search engine optimization and search engine marketing services, and its web site can be found at: http://www.stonetemple.com.

Google’s new Custom Search Engine (Google CSE) program enables web site owners to define their own search engines. CSE provides a deceptively simple form-based interface for building a domain-specific search engine on top of the Google search platform. This means that the builder gets to focus on selecting valuable content and tuning the ranking criteria, while Google does all the “heavy lifting” of crawling, indexing, ranking, and displaying results.

The main task of building a CSE is to determine which sites/URLs (including flexible URL patterns) are searched, and to define a set of rules that guide the ranking of results. Specifically, the CSE program allows four major methods for altering the search results:

1. Which sites will be included in the displayed results
2. Sites whose ranking should be raised
3. Sites whose ranking should be lowered
4. Sites which should be excluded from the results

Conceptually, this program is about allowing subject matter experts (SMEs) to provide editorial oversight of the CSE results. Google recognizes that there are inherent limitations in the use of link based ranking schemes to provide optimal search results. SMEs can now define vertically oriented search engines whose results are manually tweaked.

A key part of this program is that site owners can use more than one SME to build their CSE. In fact, the program includes a collaboration feature, where other SMEs can be recruited to contribute their expertise to the CSE. This adds a “social media” aspect to the building of search engines that is truly unique, and should make for a very interesting dynamic.

Once the CSE is defined, the site owner places a search box on their site. It may look something like this:

When a user performs a search, they are brought to a web page that looks much like the traditional Google search results page. However, there are two important differences:

1. The site owner can choose to have the search results appear in an iframe on their own site (or, alternatively, they can be hosted by Google on Google.com).
2. The site owner can customize the look and feel of the page to make it look more like their existing site.

Here is an example of a results page:

Last, but certainly not least, Google plans to share the ad revenue from the resulting search results pages, through the site owner’s existing AdSense accounts. Many site owners will find this a very attractive part of the program.

There are many interesting implications to this program. In a single stroke, Google has effectively recruited millions of SMEs to help improve their search results. The potential exists for a substantial amount of search volume to take place through highly trusted resource sites across the web, where trusted and recognized experts put together vertically oriented CSEs that provide superior results in their area of expertise.

This program also has the potential to help Google gain market share in another way. You can imagine users arriving at a site with a CSE, having found the site through another search engine, and getting converted into using a Google CSE, due to the power of the editorial input.

Because Google shares in the ad revenues, there is an incentive for them to promote third party custom search engines. This dynamic is critical to the whole notion of Google creating a distributed search platform, which leverages the work of SMEs, while still retaining their ability to monetize search. One should not be surprised to find Google actively promoting, and indeed perhaps even redirecting some search traffic, to the most successful CSEs. Doing so will help ensure a more satisfying search experience, which ultimately will boost Google’s market share and bottom line.

Site owners benefit, because they can now build a search asset for themselves. For companies whose web site is viewed as a major asset, the ability to build the world’s best search engine in their area of expertise will be a compelling idea.

In addition, end users benefit, because they get access to search engine results that combine the best of algorithmic search with editorial input. This will translate into finding what they are searching for more quickly. This is ultimately the bottom line that will drive the success of the entire program.

How it Works

Getting started is actually quite easy. You can build a basic CSE entirely through the use of a 1 page form. It’s a compelling experience:

First, you fill in a text box to specify a list of sites that will receive a increased rankings in your own CSE (that is, pages from this list will tend to rank more highly in your CSE’s results than they would on the regular Google search engine). Other than that, there are only 4 major things to think about:

1. The name of your CSE
2. A description of the CSE
3. Whether you want to limit the CSE solely to the sites you specify, or prefer to include results from the entire web, but simply improve your chosen sites’ rankings.
4. Whether you want third party contributions to your CSE to be by invitation only, or to be open to anyone that’s interested.

It’s a very straightforward process. The challenge for people who are defining CSEs will be to walk the line between adding deep editorial value by truly identifying the best sites, and serving their own commercial interests. We believe that the best CSEs will be those that are built with pure editorial goals in mind. But we will probably see many different variants across the market.

Of course in the end, like any other web service, those sites that offer the best end-user experience and value (the best search results) will have a competitive advantage, attracting and retaining more users. In this way, competition among similar CSEs is likely to produce higher quality results – a good thing for the end user.

Advanced Capabilities

For those who want more control, the CSE program offers more advanced capabilities. For example, an SME may want to provide a particular page or site a larger rankings increase than the default increase they get through the use of the form. Using a type of file known as a “Context File”, the SME can assign different levels of ranking increases, with weighting levels of +0.5, +0.75, or +1.0 (the highest). The form defaults to a +1.0 weighting for selected sites.

In addition, the Context File provides the ability to demote site rankings, with weighting levels of -0.5, -0.75, or -1.0 (the largest level of demotion). This additional control provides the SME with a substantial ability to tweak the final search engine results from their CSE. The format of the Context File will be familiar to those who have worked with the Google Co-Op Topics program. We will provide an article in a couple of days to define how this works.

Summary

Google has always favored the algorithmic approach to search because of the obvious scaling advantages over the human editorial approach. Computer algorithms can evaluate many times more web pages than humans can in a given time period. Of course the flip side of this argument is that machines lack the ability to truly understand the meaning of a page. With CSEs, Google may have formed the perfect marriage between human editorial expertise and scalability, and may be paving the way for a significant change in how search is performed.

CSEs scale by allowing, indeed encouraging, collaboration. Google makes it easy for a CSE owner to open up the editorial process to a whole community. A CSE owner can invite others to participate, and allow their editorial inputs — their votes on whether to promote/demote or include/exclude pages and sites — to flow directly into the CSE. Google seems to be saying this: a custom search engine can be a shared, community-powered asset. All parties who receive benefit from the asset (the web site owner, who can monetize the CSE, and the user, who gets a much improved search experience) are motivated to continue to invest in it.

The potential for a virtuous circle emerges: as the CSE gets better, more people are incented to use it and improve it, leading to better search and more users. Thus, we see an elegant approach for scaling human editorial input to the search experience. While Google may not be the first to attempt it, with CSEs, they’re attempting to build a platform that does it better than anyone else.

For those of us who looked closely at the Google Co-Op program back when it was launched in May, we now have a clear picture about where Google has been heading with it. Custom Search Engines represent a powerful, and novel, new market initiative by Google. Various other players, such as Rollyo, Gigablast, and Northern Light, have already established that there is a market out there for Custom Search Engines. But now you can get it from Google, it’s straightforward to build, it’s free, and you get a rev share of the advertising revenue to boot.

About the Authors

Eric Enge is the President of Stone Temple Consulting. Eric is also a founder in Moving Traffic Incorporated, the publisher of Custom Search Guide, a directory of Google Custom Search Engines, and City Town Info, a site that provides information on 20,000 US Cities and Towns.

John Biundo is a Principal Consultant, specializing in SEO/SEM, at Stone Temple Consulting.

Whether you love the new name or not–personally, I think it’s a huge improvement on Windows Live Search–you owe it to yourself to go and try Microsoft’s revamped search offering when it launches on June 3. And by “try” I don’t mean enter one search query and make up your mind, I mean give it a solid week or two. You might just find that Bing pleasantly surprises.

At least, it surprised me. I’ve been playing with Bing for a couple of weeks now and I’ve been looking forward to today’s announcement. I’m not sure if Bing is good enough to break my Google habit, but there’s a lot under the hood to make me seriously consider switching from the all powerful, all knowing, Google.

It’s best to think of Bing not as a search engine, but a decision engine–which is exactly how Microsoft is pitching it. While it may seem like a term you create, so as not to appear you’re going head-to-head with Google, I think decision engine is a great way of describing Bing. Microsoft wanted to build a user interface that helped the estimated 42% of us that are constantly unsatisfied with our initial search results, and I think it has achieved that in Bing.

“Today, search engines do a decent job of helping people navigate the Web and find information, but they don’t do a very good job of enabling people to use the information they find,” said Steve Ballmer, Microsoft CEO in a statement about the launch. “When we set out to build Bing, we grounded ourselves in a deep understanding of how people really want to use the Web. Bing is an important first step forward in our long-term effort to deliver innovations in search that enable people to find information quickly and use the information they’ve found to accomplish tasks and make smart decisions.”

Now, before I show you some of the cool new features, let’s acknowledge that Bing clearly draws from the advances made by search engines before it–Ask.com arguably made the first move in changing the “first ten links” approach to search results. That said, I think Bing brings its own personality to the table.

Head-to-Head

OK, so let’s look at a few of the new features. For fun, I’ll start off with a comparison with Google.

So, despite by Carolina Hurricanes losing to the Pittsburgh Penguins, I’m still interested in the Stanley Cup finals. So, let’s start there.

First Google:

Pretty good. We have news, relevant results, and some YouTube videos.

Now Bing:

Better than Google? Let’s see, I have recent scores, relevant results, and you’ll see to the left (and bottom) of the screen that Bing has some neat refining options.

OK, so perhaps you could argue that Bing is just using a different UI, not necessarily better. OK, let’s take a look and some other cool features in our search result, shall we?

While the snippets used by Google and Bing are helpful, what if I could get further information about a web page, without actually leaving my search results? Well, simply move your mouse over each search result and Bing will provide an expanded snippet–even drawing meta data, if available.

What if you’re more of an audio-visual kind of person? Click the “Videos” tab and you’ll not only get video results, but you can mouse over each thumbnail and it plays right there and then!

How about static images? OK, so when you click on “images” you expect to see images of, well, the Stanley Cup. But what if I want to see images of players celebrating with the greatest prize in hockey? Well, Bing will help me find similar images:

Et voila, I can browse similar images until my heart is content.

Not a hockey fan? Here are a few other neat things that come standard with Bing.

Shopping search is built in–complete with user reviews and scoring.

What about travel? Tell Bing your departure airport and destination, and it will help you find the best price and predict if that price is on the rise or fall.

Summary

There’s a lot to like about Bing and really only one thing not to like–it’s owned by Microsoft. Not that it means it should be dismissed, but I know a lot of us will likely not touch anything created by Microsoft. That would be a real shame, because Bing is the best advance in search technology in the past few years. Sure, it’s far from perfect, but it’s equally far from its Live Search predecessor.

I plan on giving Bing a fair shot at replacing Google as my default search engine. It’s got about a 20% chance of succeeding, but that’s a big improvement over Live Search’s “when hell freezes over” chance.

by Andy Beal

“Speaking as a computer scientist, I view all of these as sort of poor man’s email systems,” he said this afternoon at Morgan Stanley’s technology conference. (Live notes here.) What’s he talking about?

“In other words, they have aspects of an email system, but they don’t have a full offering. To me, the question about companies like Twitter is: Do they fundamentally evolve as sort of a note phenomenon, or do they fundamentally evolve to have storage, revocation, identity, and all the other aspects that traditional email systems have? Or do email systems themselves broaden what they do to take on some of that characteristic?

I think the innovation is great. In Google’s case, we have a very successful instant messaging product, and that’s what most people end up using.

Twitter’s success is wonderful, and I think it shows you that there are many, many new ways to reach and communicate, especially if you are willing to do so publicly.”

Schmidt also plugged Google’s new Twitter account. But he flubbed Twitter’s famous 140 characters-per-message limit in the process, describing @google as a place to “go ahead and listen to our ruminations as to where we are and what we’re doing in 160 characters or less.”

Source: http://www.businessinsider.com/

The new search engine — called Wolfram Alpha — differs from conventional search engines in that users can ask questions using natural language and the search engine uses “knowledge models” to bring you the right answer. But does it really work, and will it be a Google killer? Wolfram says “yes” to the first question and “no” to second, insisting that Google and Wolfram Alpha will co-exist and offer different forms of searching. We’ll have a better idea of how well it all works when Wolfram Alpha goes live this May.

Source: http://dvice.com/

We decided to compile a list of Top 5 new torrent search engines, its the beginning of September 2008 we bring you some new players in this field (except Torrentz which is 5 years old).  The list includes only public websites, which allows you to search for torrents without registration or ratio requirements.

Note: These search engines do not host the torrents on their servers.

Usniff

Usniff is a new real-time search engine that lets you search on 8 different torrent websites (The Pirate Bay, mininova, etc.) simultaneously. Its features include searching for torrents on 8 popular torrent sites simultaneously, filter search results by keyword, size, seeds, peers, and source. Adding Usniff torrent search in Firefox search bar makes searching more easy.

NowTorrents

NowTorrents is a great torrent search engine that only shows real-time search results unlike some other sites. It has great, clear, and easy to read layout, fast results and support for Firefox and IE-7 plugins. NowTorrents makes torrent findable and is extremely easy finding the right torrents. Another neat feature is that NowTorrents is able to detect and remove fake/dead torrents.

PizzaTorrent

Pizzatorrent is a name to be remembered. Other than that it’s got features similar to YouTorrent. There’s the standard search bar in which you type your query. Results are ordered by type, i.e. movies, music, TV shows, and other. The top ranked torrents are displayed at the top of the list. Information includes date, size, seeds, peers, and the engine from which they’ve been pulled. PizzaTorrent scans Mininova, PirateBay, Vuze, SumoTorrent, IsoHunt and NewTorrents among others.

YouTorrent

If you appreciate the ease of use and quick facility of search engines you’ll love YouTorrent. It is the first legal torrent search-engine. Typing in a keyword will pull date, size, seeds, peers and engine for each torrent, results can be ordered according to your preferences. YouTorrent grabs only legal torrents from Mininova, The Pirate Bay, SumoTorrent, Monova, and Vuze among others. New features are coming up, these include Boolean searches, advanced search, more engine selections, and a Firefox plugin.

Torrentz

Torrentz.com is similar to any other torrent search engine that does not actually store torrents but give you a radical search by its indexing servers. The function of this search engine that stands out from the rest is that it not only search torrents but also it searches within every torrent for possible matches. And the indexed torrents are only those that have atlease 1 active seed which makes it one of the most reliable search engines for finding active torrents. (This site is 5 years old through)

Start searching now, you will find almost everything on the internet using these search engines. If you think we missed any new search engine, let us know in the comments.

Source: http://www.addictivetips.com/

Source: http://rangit.com/