Semantic Web Ontology Portal Evaluation Approach

Introduction

This wiki page supports ESIP's evaluation of semantic repository solutions in particular providing insight into;

1. what current and future ESIP Semantic Technologies Committee (STC) community requirements (CR) are,
2. a comparative evaluation of different technology stacks/approaches; with the aim of assessing different solutions based upon how well they satisfy CR as defined within this document, and
3. a business cost justification model that could be used to justify funding semantic web technology stacks.

All ESIP members (and anyone else with an account on this wiki) are encouraged to contribute towards this document.

Comparing Semantic Repository Implementations

In general in this document:

• 'ontology' refers to any semantic artifact, whether expressed in OWL/RDF, another OWL representation, or a simpler form like Excel or CSV that can be converted into a semantic artifact.
• URI is used to mean a unique web identifier, aka IRI; it usually but not always is a URL.

Features/Services

These are the functions we'd like to see offered by the repository:

Ingest capabilities

• It should be possible for a person with an ESIP account to upload their semantic resources to the repository
• It should be possible for a person with an ESIP account to upload new versions of their semantic resources to the repository.

Search capabilities

User-specific search and update capabilities

• A logged in user (i.e., one with an ESIP account) should be able to query to obtain a list of their own resources in the repository
• A logged in user needs to be able to update their own information in the repository (i.e., profile including things like passwords, email addresses, etc.). Relevant updates need to proliferate to the resources that user has uploaded.

General search and update capabilities

• Users should be able to specify a term (e.g., seaIce) and have the portal return all concepts that include that term. The ontology or resource that the concept comes with should be included in the result and the ability to further examine that resource (definitions of the terms, other metadata such as usage constraints, etc.). See this set of results for a search for the term "publisher" in the site vocab.cc for examples.

Display capabilities

What options are available for displaying and viewing concepts, ontologies, and metadata?

Protocols

Protocols describe how the repository makes its information, submissions, and entries available: what syntax, semantics, and specifications are supported in the data and commands that go into the system, and come out of it?

API support

How many/which features are available to other applications via API calls? Are these calls REST-based?

How is the URI for each concept in the repository represented? How is the URI for each artifact represented? Are the offered URIs versioned, unversioned, or both?

Authentication and Security

What types of login features are supported?

Support for Teams and Roles

Can teams be defined of multiple members? Can multiple members of a team edit the same ontology?

Cost

Costs are given in labor hours and funds required to start and operate the service.

Justifying Semantic Web Repository Business Costs

(see the [SW OPortal Discussion:Talk|Discussion] page for ideas.)

References

[1] ODM2 evaluation of MMI ORR: https://github.com/ODM2/ODM2/blob/07e4e30fc4d6763b8bcae771ffbb7228fc5a3f65/doc/ODM2Docs/concept_controlledvocabs.md