Waarom heeft Big Data een relatie met Enterprise Search

Ik las vandaag een artikel op CMS Wire dat in gaat op de vraag waarom de Big Data movement en bedrijven die zich daarmee bezighouden, ineens zoveel interesse hebben voor Enterprise Search technologie.


Making Insights Actionable

Adding structure to unstructured data is the foundation of gaining insight. Like turning a lump of clay into a finished sculpture, this does not happen by accident. It takes strategically designed technology and targeted knowledge to overcome entropy and create order out of chaos.

This is one reason why big software companies are acquiring search engine companies. Vivisimo, Endeca and others have mature and highly capable “indexing pipelines” that add structure to big data content prior to indexing. These “indexing pipelines” are crucial for ensuring that the insights gained from your big data are accurate and reliable.

If the steps taken to add structure fall short (i.e. dates are not normalized, entity extraction is incomplete), then the accuracy of the data behind the insights becomes questionable. In politics, as we recently saw, if your survey is flawed, you are not going to gain accurate poll numbers.

In business, if your data structure is flawed, you are not going to gain actionable business insights. Worse yet, you might not realize your data structure is flawed and make misinformed decisions that hurt your business.


Big Data gaat niet alleen om gestructureerde informatie uit databases. Het vakgebied “Business Intelligence” houdt zich al jaren bezig met het combineren en analyseren van informatie uit databases en de resultaten op een “human friendly” manier te presenteren aan medewerkers.

De kern is om hier ongestructureerde data bij te betrekken. Ongestructureerde data geeft inzicht in “The Why Behind The What”.

Attivio heeft hier haar oplossing omheen gebouwd. Bezoek hun site eens om meer te weten te komen over de combinatie van gestructureerde en ongestructureerde informatie.

12 tips voor het succes van Enterprise Search


Onderstaande opsomming komt van http://www.kmworld.com/Articles/Editorial/ViewPoints/12-Tips-for-Enterprise-Search-Success-86525.aspx

  1. Invest in a search support team: Before you do anything else set up a search support team with the skills, enthusiasm, organizational knowledge and networks to get the best of the current search application(s).Even if the team is initially a team of one put the budget, headcount and job descriptions in place so that it can grow ahead of the requirements for support.
  2. Get the best out of the current investment in search: There is usually much that can be done to improve the current search applications once the search team and the search vendor focus in on options and priorities. The information gained from search log files is a very important element of defining search requirements and setting benchmarks for any new search application.
  3. Enterprise search is an approach and not a technology: Implementing one single all-encompassing search application is unlikely to be successful and usually carries more risks than benefits. Enterprise search is about creating a managed search environment that enables employees to find the information they need to achieve organizational and/or personal objectives.
  4. Set search within an information management context: If the organization does not see information as a business asset it will never invest enough into search and is very susceptible to competitive and reputation risks. An information management strategy owned by a senior manager is an essential prerequisite to successful search.
  5. Content quality is essential for quality search: Current search technology can cope with poor quality content but there should be guidelines for content and metadata quality. It is of little benefit to the organization if a search lists twenty relevant documents with a content quality that renders them unfit to be trusted.
  6. Understand user requirements and monitor user satisfaction: Relevance is a personal measure of information value. Basing a business case on anecdotal information about the current search application and what other organizations have achieved with a particular piece of technology is not a suitable basis for an investment decision.It could be your career prospects that suffer.
  7. Search then browse then alert then search then alert…..: Users need to be able to search when needed, browse when needed and set up alerts as needed. These three processes need to be linked together to provide an effective information discovery environment.
  8. Provide location-independent search: The search application should be as effective via remote access desktops, smartphones and tablets as it is on a large screen monitor in the IT department. Not all search vendors have recognized the need for innovation in user interfaces for mobile devices.
  9. Undertake intelligent log analysis: Search log analysis needs to be conducted on a regular basis by a team that understands the activities and language of the business so that emerging issues in search failure can be identified at the earliest possible opportunity.
  10. Search is a dialogue: Aiming to get the most relevant documents at the top of the search results list is a waste of effort. In an enterprise environment users will have complex queries that require them to be able to refine their query and re-evaluate the results with the minimum of effort.
  11. Procure value not functionality: When the time comes to invest in a new search application specify requirements on what you expect the search application to deliver and not on what features you would like to have supplied.
  12. Search is a journey: The process of ensuring that search is meeting user requirements never comes to an end. Every day there are new employees, new business challenges, new business opportunities and new developments in search technology.