Towards a benchmark for Semantic Web reasoners - an analysis of the DAML ontology library

Abstract

Introduction Bet hmarksare one important asp ex of pe rformance e aluation. This pap e conce trate on the de e86)1 t of a re1888) tative be1 hmark forSe71 tic We87 To thise te t we pe rform a statistical analysis of available Seab tic We b ontologie] in our case the DAML ontology library, andde7F e paramex]7 that can be use forthe ge1)F66x] of syntheK) ontologiex Theg syntheF1 ontologie can be use as workloads in be1 hmarks. Naturally, pe)661x]1j e aluation can also be pe1FjI#x using a re7 workload, viz. a workload that isobseK e on a re11)IF be ing use for normal ope -x7K)#6 Howe ve r, such workloads can usually not be applie ree78I7I in a controlle manne) Thee)x] synthe)j workloads are typicallyuse in pe rformance e aluations. SyntheF7 workloads should be areII77x tation or mo de ofthe re7 workload. Heloa it isne8K#K6x tome67#8 and characte]16 the workload one isting reingx7K to produce me7#Kx]1 synthejI workloads. This should allow us to syste7x]1)787 e aluate di#ee t rej#j#x] an