|Review Comment: |
The authors present Map-On, a web-based graphical mapping editor for creating R2RML mappings from ontologies to SQL databases. Map-On uses graphs to represent
the ontology, the database and the mappings, and allows the user to map elements of the ontology to the database tables, thus automatically creating R2RML mappings.
One of the critical aspects of OBDA is the difficulty of generating the mappings, as it requires extensive background knowledge, and is in general a time-consuming and error-prone task if performed manually.
The authors provide a description of the features and interface of the tool, of its technical architecture, and provide a step-by-step overview of the process of creating a mapping with Map-On.
The authors also present an introduction to R2RML mappings, a fairly extensive overview of other mapping editors or visualization tools, a user evaluation of Map-On, and a real-world project in which the tool was used successfully.
The tool has been made accessible through a custom guest read-only account.
The revised submission indeed addresses the aspects which were in my opinion most critical in the previous version, i.e., the lack of a user evaluation test, which is necessary to back up the claim that Map-On is a useful tool even for users not skilled in ontology and mapping design to generate ontology mappings, and the overall poor quality of clarity and readability of the paper.
Indeed, the authors present a user evaluation in which 5 users with no background knowledge of the Semantic Web or of OBDA are introduced to these subjects and to the tool, and are asked to perform three mapping tasks for a benchmark scenario. I have some experience with user evaluation tests on semantic-web related aspects, and I appreciate the difficulty of organizing such tests, so I commend the authors for doing so.
However, the validity of the test itself could be subject to some discussion, since the users were given a very brief introduction to the Semantic Web, ontologies, RDF, an R2RML mapping, the Map-On tool (each test took about 50 minutes, and the three tasks took more than 30 minutes total), so I'm not sure that the results of the test are very meaningful.
Specifically, the authors do not discuss the results of Task 2, which seems the most interesting, since average time was vastly superior to the other tasks. I would like to see at least some comment in this direction, possibly also addressing the user reaction when a proposed task took so long (was the user frustrated?).
More in general, I'm not sure there is enough evidence in the presented results to back the final claims made by the authors that the tool was successfull in achieving the desired goal during the tests. A more detailed discussion of the results would be appreciated.
The quality of the writing has been fairly improved throughout the paper (see minor comments below), with the notable exception of the new User testing section, which is quite poor. In fact, in some points it looks more like a rough draft, e.g., "Participant had a similar profile was; they were graduates and post-graduates" or "of languages such as OWL, RDF, SPARQL, and R2RML; either." or "The screen was recorded and the voice of the participants who were beforehand informed". Also, there is a discrepancy between one of the results reported in the text and in the tables: in Figure7, the completion time for Task 3 seems to be 3 or 4 minutes, while the paragraph above says 7 minutes.
I think a proof-read by a native english-speaking person of this section is necessary before the paper can be published.
1)pg.1: The queries can be processed with reasoning purposes..... -> The queries can be processed over the ontology for reasoning purposes in order to allow using hidden relations....
2)pg.1: Experts require from knowledge on the data schemas -> Experts are required to have knowledge of the data schemas
3)pg.1: creating R2RML mappings requires from advanced skills -> creating R2RML mappings requires advanced skills
4)pg.2: Indeed, and given a fixed screen space -> Indeed, given a fixed screen space
5)pg.2: and the most common used -> and the most commonly used
6)pg.3: The mapping editor presented in this paper, supports the creation -> The mapping editor presented in this paper supports the creation
7)pg.6: the mapping space where mapping belongs to. -> the mapping space to which the mapping belongs.
8)pg.7: the link to the tool is wrong, it should point to Map-On, not Click-On
9)pg.8: One person has been administering the test -> The test was administered by a single person.
10)pg.8: is easy to be understood by the -> is easy to understand for the
11)pg.8: Both, the ontology -> Both the ontology
12)pg.9: The user satisfaction was measured with -> The user satisfaction was measured through
13)pg.9: were the participants rated some -> where the participants rated some
14)pg.9: to the interface raised during the test -> to the interface were raised during the test