Review Comment:
The paper has improved in some respects from the previous version that I reviewed, but I am not convinced by how several of my main points of criticisms have been addressed (or not addressed). I will focus here on the main points of criticism from my previous review, quoting them with the authors' response below:
TK:
> - The restriction to OWL "individuals and concepts" is not well motivated. OWL
> axioms involving properties can be expected to be harder to understand, given
> that properties are logically more complex than individuals and classes.
> Therefore the restriction to individuals and classes is a serious one that
> limits the potential impact and usefulness.
Response:
> Restrictions on concept implicitly represent the TBox axioms in an ontology.
> We also agree that the axioms involving properties are harder to understand.
> For this reason we have refinement rules meant for property restrictions.
> Required rewritings are done in the Introduction (Page-3).
I am not satisfied with this answer. This restriction is still not well motivated. The authors only copy-pasted (you could also say "plagiarized") my sentences above ("OWL axioms [...] and usefulness") to their introduction, only replacing "classes" with "concepts".
TK:
> - The use of axioms like "cat subClassOf animal" to remove "has as pet an
> animal" if we already know "has as pet a cat" implies that we are starting
> from a consistent ontology. This means that we cannot use the presented
> approach as a method to find the errors in inconsistent ontologies, which
> actually is an important problem that such verbalization tools could help us
> with. This assumption and the resulting limitation are not discussed.
Response:
> We currently assume that the ontology is consistent. This details is included
> in Section 4.2. Considering the reviewer's comment, the mentioned point is
> included in the Future Work section.
The restriction to consistent ontologies is now mentioned but still not motivated. We only read once that "Currently we consider only those consistent ontologies for verbalization" in the technical parts of the paper and the evaluation section ends with a sentence about future work and inconsistent ontologies, which is again almost a verbatim copy of my review text. While we are now explicitly (but not very prominently) told that the approach assumes a consistent ontology, we still don't know why the authors think that this is a good restriction to make in the first place.
TK:
> - "if a role restriction R1 is implied by another role restriction R2 (i.e.,
> R2 ⇒ R1), then R1 can be said as a stricter version of R2.": That doesn't seem
> to be right. If R1 follows from R2 then R1 is less strict and not more.
> Whenever R1 is violated so is R2, but not necessarily vice versa. So, R2 can
> be violated while R1 is not, therefore R2 is "stricter" in its intuitive sense.
The response to this seems to be missing, and the text seems unchanged in the article.
TK:
> - The empirical evaluation doesn't seem to be a fair one, as the "traditional
> approach" is not really what is normally done. [...]
Response:
> In the empirical evaluation we wanted to show that even if we consider all the
> implicit axioms our systematic way of reduction could express the OWL
> statement in a much understandable way. It is true that existing approach
> generally considers a subset (mainly the explicit axioms) from the label-set
> for generating the NL text, however, this would not be equivalent to the
> verbalized text by the proposed approach.
It's true that the approaches are different, but the paper is written in a misleading way by claiming that it compares what is traditionally done with their approach. The baseline called "traditional approach" is not what other approaches are doing, and it seems quite obvious that the chosen baseline should be expected to perform much worse than what is normally done in existing work. So, it's really unclear what the current evaluation is telling us, and the paper hasn't improved in this respect. At the least, the label "traditional approach" is highly confusing and misleading.
My other main points of criticism from my first review with respect to unnecessary complexity and the use of formal language have been partly addressed or answered and can partly be seen as a matter of taste. Given that the other reviewers didn't report these as serious issues, I will not insist on them either and I can agree to consider them resolved, in contrast to the unresolved issues explained above.
|