topic Re: semantic search in alfresco in Alfresco Archive

semantic search in alfresco

jmarti — Fri, 30 May 2008 14:03:03 GMT

Hi,I'm wondering about the possibility of implementing "semantic search" in Alfresco? Not sure if "semantic" is the right word… What I would like to get is: - Search for a word. - You get docs containg and/or related to that doc. - You also get relations between those docs. G

Re: semantic search in alfresco

jbarmash — Fri, 30 May 2008 16:57:08 GMT

I am not aware of any semantic modules. There was a bit of a talk to enable RDF-type stuff as a community project, but no movement on that yet.

Most likely you'll have to start from scratch.

Since our search is based on lucene, if there are any lucene modules that enable semantic-type search, that would be your best bet.

Re: semantic search in alfresco

stevereiner — Fri, 30 May 2008 18:15:45 GMT

Its coming (early beginnings hopefully soon):

Semantics for Alfresco:
http://forge.alfresco.com/projects/semantics/
    * Provides a Flex UI (FlexSpaces add-on) and Flex components for semantic tag management, semantic search, and semantic tag clouds
      (later Flex and/or Ajax components for Alfresco 3.0)
    * REST style api to semantic services implemented in Java (RDF, semantic tagging, etc.)
    * Automatic generation of semantic metadata from content
    * Search leveraging semantic metadata with Lucene
    * Auto-tagging, microformat tagging, RDF semantic tagging
    * Ontologies, taxonomies, semantic instance data
    * Semantic web (Linked data) technologies: RDF, SPARQL, OWL
    * Calais (Reuters / ClearForest) open api (free service)
    * Calais first, later Apache UIMA and GATE via UIMA
    * Alfresco ECM: Auto generation of semantic metadata from content with Calais and UIMA, semantic data relations with content nodes, semantic tagging, semantic search
    * Alfresco WCM: Integration to create and manage web sites leveraging the semantic services ( use within web site / web app, optionally expose semantic web metadata externally)
    * Alfresco Collaboration: Support semantic tags and other features with collaboration features (blogs, wikis, 3.0 sites, etc.)

FlexSpaces
http://forge.alfresco.com/projects/flexspaces/
http://forums.alfresco.com/viewtopic.php?f=36&t=11876

Steve Reiner
http://www.integratedsemantics.org
http://www.integratedsemantics.com

Re: semantic search in alfresco

jmarti — Mon, 02 Jun 2008 07:54:16 GMT

sounds great, I will give it a try as soon as it gets out.

Re: semantic search in alfresco

stevereiner — Wed, 12 Nov 2008 05:50:15 GMT

I had been delayed on the Semantics for Alfresco project
By teaming up with Alexander Polev who started a similar project (Calais integration), hopefully we will have the first part sooner (auto tagging with Calais, multiple tag clouds)

http://forge.alfresco.com/projects/calais/
http://forge.alfresco.com/projects/semantics/

also registered a google code project
http://code.google.com/p/semantics4alfresco/

Steve

Re: semantic search in alfresco

ttague — Wed, 12 Nov 2008 20:13:22 GMT

Steve:

Tom Tague from Calais here.

Good to hear that this project may be regaining some traction.

I wanted to encourage you and Alexander to seriously consider storing the Calais URI's for extracted entities, events and relationships as well as the values themselves. We'll be blogging about it in the next day or so - but our next release (1/09) will allow you to de-reference many of the entity URIs - providing you with a path from unstructured text to semantic metadata to the linked data world of Freebase, DBpedia, etc. Should enable some pretty interesting content enhancement and exploration opportunities.

Regards,

Tom

Re: semantic search in alfresco

stevereiner — Sat, 15 Nov 2008 00:07:58 GMT

Here is a link to Tom's blog post about Calais 4

Life in the Linked Data Cloud - Calais Release 4 Coming Jan 09

"The Gist: Release 4 of Calais will be a big deal. In that release we’ll go beyond the ability to extract semantic data from your content. We will link that extracted semantic data to datasets from dozens of other information sources, from Wikipedia to Freebase to the CIA World Fact Book. In short – instead of being limited to the contents of the document you’re processing, you’ll be able to develop solutions that leverage a large and rapidly growing information asset: the Linked Data Cloud."

http://www.opencalais.com/node/9501

Steve

Re: semantic search in alfresco

stevereiner — Tue, 25 Nov 2008 07:20:15 GMT

http://integratedsemantics.org/2008/11/24/calais-integration-semantics-for-alfresco-sneak-peak-part-1/

"Here is a sneak peak video of semantic auto-tagging and multiple semantic tag clouds coming in the next release of FlexSpaces+AIR / FlexSpaces+Browser. This uses the Calais Integration Alexander and I have been working on, the Open Calais service, and Alfresco. The Calais integration auto-tag action can also be used from the "run action" UI in the Alfresco web client (now called Explorer)."

"Things in the works: Flex UI for tag suggestions, storing URIs in the integration for future linked data use, storing geo-location info from Calais 3.1, and map UI to display geo-location points to filter search results."

Steve

Re: semantic search in alfresco

erictice — Wed, 29 Apr 2009 13:52:03 GMT

How is this project coming along? I am curious as to the granularity you plan to allow. For instance, we would be looking for words in a given document. In our business that is potentially a word from original scriptures of the bible. Will it also support languages other than English? We would primarily be looking for Greek or Hebrew words.

Re: semantic search in alfresco

stevereiner — Wed, 29 Apr 2009 23:41:30 GMT

The Calais integration alfresco server extension and Calais Flex UI in FlexSpaces is complete:
http://forums.alfresco.com/en/viewtopic.php?f=32&t=15766

The Calais service now supports French in addition to English and will be adding more languages
(check http://opencalais.com/non-english forum topic)
Note that Calais meta-data extraction is currently focused on business and news type content.

Adding support for open source / customizable engines is currently on the back burner.

Re: semantic search in alfresco

stevereiner — Wed, 27 Jul 2011 00:50:50 GMT

Note: Calais / OpenCalais is not open src, its an"open api" web service that is free for low volumes. IKS / Apache Stanbol is a completely open src / free stack (when it uses OpenNLP instead of the optional use of OpenCalais).

Zaizi is working on an Alfresco integration to IKS / Apache Stanbol. Integrated Semantics will be doing additional UI for Apache Stanbol + Alfresco http://code.google.com/p/semantics4alfresco/ (has links to IKS, Apache Stanbol, Zaizi projects too)

I think IKS and Apache Stanbol are exploring support for semantic search (maybe tied in with Solr faceted search, since they are using Solr)