Tuning and configuring enterprise site search

We all know that a good enterprise site search experience not only positively fosters the brand but also compensates for any navigational and UX related deficiencies.
So, let’s talk enterprise site search and look at considerations you should have when improving the search experience for your site and your users.

Understanding how your users search is of course paramount –

Couple of Prerequisites please:

1. Partnering with business is a must. Direct-loaders (people who go straight to your site and then use your site’s search facility) need their searches to be looked after by the business, the guys who understand the products and how they are marketed and sold to the customer.

2. Deep understanding of the target site. Rely on yourself. Familiarize yourself with the site. Get to know the users. Peruse through the persona matrix.

Begin with a Search Term Analysis by extracting the analytics data associated with site search (This data may be hooked with Coremetrics/Omiture, etc, or the search engine logs/reporting platform, depending on what your site search product is).

Look for searches which retrieve zero results. These are the list of terms that users have entered and yielded zero results. Check for the following issues which may be leading to the zero results

-Misspelled Words
-Users entering terms that do not relate to the meta data
-Users searching for content which you do not have
-Technical issues with the way your search product is configured

Remedies may include
-implementing a spelling correction feature
-optimization of site content (adding content what the customers are searching for)
-optimization of meta data (usage of Beauty on the site when the customer means Makeup). The dreaded industry jargon – leave it at home.
-understanding and reacting to the language of the customer (hmm, personas anyone?)
– reconfiguring the way content is indexed (tweaking the relevance rankings, stop words. Consideration of pure content, product pages, brand pages, video, images, etc.)

Next, extract a ‘commonly searched for terms‘ report. Typically, a small number of search terms account for a high percentage of site queries. Yes, the classic 80/20 rule of long tail shows itself once again. This should be a top priority to ensure that the most popular search terms return optimal results by fine tuning them individually.

Then, extract a report which contains a list of Uncommonly Searched Terms. This report may fill a gap, and is especially crucial for a multi channel retailer where a user may search by entering a Sku # which they perhaps noted down from a TV show or a brick and mortar. This report may represent fewer searches but in the long run it can pay off to track these less popular searches over time. This report can show emerging and waning customer interests, which you can then translate into trends and implement appropriate fixes.

Embarking on improving search tuning can be a daunting task. However by taking a carefully planned approach the process can be tactically simplified.

Does the search product meet the site’s objectives? Perform a gut check and ask the following questions-

Is it fast enough?
Are the results accurate enough?
Are the displayed results on the page complete enough?
Does it integrate well with the rest of your systems?
Does it fit your business goals and deliver on your brand’s promise?
Are users finding what they need?

If the answers to these questions are not satisfactory then it makes sense to tune up the search engine.

Configure or Reconfigure your search product

Beyond the issues of server load, simultaneous users, response time there are some adjustable functions you could look into. The existing configurations may be no longer valid and should be revisited often.

Some common configuration options-

Turning on and tuning predictive search

Many users have come to expect that a search engine will offer them tips and suggestions on the results page. These suggestions could take the form of spelling corrections. If your search engine offers spelling suggestions, you may be able to modify the dictionary that supplies the corrections to add common misspellings found in your search logs. Synonyms are another form of suggestion offered by many search solutions. It is important for the search engine to recognize and interpret the language the user is accustomed to.
It is estimated that 20-30% of all search terms used on the internet contain a misspelling or a typo. If that is the case and your search engine doesn’t manage to auto correct them or the typo is on a made-up word such as a brand or product name, then your customers will get zero results, the dreaded dead-end.

The solution; find out the terms that customers are using that return zero or few results and setup a synonym to the term that does match products.

Some examples where you would use synonyms include :
– Numbers – equate 2 with ii and two
– Acronyms – to equate product-acronyms with the full product title e.g. LOTR -> Lord of the Rings
– Common misspellings e.g. cart kart
– Made-up product titles with spaces taken out e.g. (wii) motion plus = motionplus
– UK / US spellings (if not auto-corrected) e.g. color colour, metre meter

Tweaking the relevance ranking

Most search engines feature some type of relevance ranking for results. Sometimes the method or algorithm for ranking results is transparent to users, and sometimes it is purposefully obscure. Some solutions allow you to adjust the algorithm to give more weight to certain results. For example, it might make sense to tell the search engine to calculate a higher relevance score for content found in a particular channel of your site (e.g. depending on user needs, product descriptions might rank higher than press releases; product pages w/videos may rank higher than product pages w/images).

Revisit your Stop Word List

In most circumstances, there’s no point in a search engine searching for words that are so common that they appear in large numbers of product titles or descriptions. It results in too many, often irrelevant, results for the customer and wastes the search engine’s resources in matching them. Typically these words include ‘a’, ‘an’, ‘of’, ‘the’ ‘i’, ‘is’ etc but the business really ought to work out for itself which words are so common that the search engine should ignore them. This may include some words that are core to the product set being sold e.g. a entertainment retailer might get the search engine to ignore DVD, CD etc. Be wary of adopting the standard set provided by the search tool vendor. For example, a ‘stop word list’ provided by a search tool vendor may include the word ‘that’, but for a CD retailer, this would not be an appropriate stop word if it meant that it made searches for CDs by ‘Take That’ of lower relevance than results that don’t contain the word ‘that’. Try it, you’ll find there’s a band called “Take”

Enforced or Automatic Phrasing

If your customers are getting too many results for certain search phrases, of which you find that many are irrelevant, then you should instruct your search engine to only consider results where there is an exact match to the phrase (words and their order). e.g. “32gb ipod touch” – assuming you didn’t want the search engine to return 4/8/16gb ipods or ipod nanos in the results set)

Search Keyword Redirects

Sometimes it is desirable to redirect a customer to the landing page that makes the best representation of a product or product set that the customer is looking for. This gives the customer a better experience than the presentation of a product list (which may well not show the full range of potential product type matches on page 1). It is a common occurrence for customers to search for types of products e.g. Toys for 5 Year Olds, so a redirect for such types of searches would be a good idea.

Best Bet Results

Frequent searches and most important pages could have a ‘best bet’ result. You are probably familiar with seeing paid advertisements on public search engines like Google. In these cases, organizations have paid for their listing to be associated with particular keywords. The idea of tying certain results to keywords works well for site search, too—even when paid advertising is not part of the game.

The perfect site search is a moving target. The out of the box search engine is a myth. It has to be constantly nurtured and tweaked to cater to the evolving demands of the consumer related to the evolving product catalog of your site.

Advertisements

One thought on “Tuning and configuring enterprise site search

  1. This is a fantastic breakdown on a ‘how to’ of site search tweaking. Nicely done. We are going to be implementing these methods in our criteria. Do you mind if I get in touch offline with questions?

    Thanks

    Jack

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s