Skip to main content

Table 1 Summary table of the TIPS track evaluation metrics

From: Next generation community assessment of biomedical entity recognition web servers: metrics, performance, interoperability aspects of BeCalm

Name Description
MTBF The average elapsed time between AS failures (s)
MTTR Average time required to repair an AS failure, i.e. the time needed to start the server again after a period of downtime (s)
MAD The number of annotations per total number of responses (predictions/document)
MTDV Average time to annotate a document (i.e. answer a request) based on the size of the requested documents (B/s)
MTSA Average response time considering the number of annotations produced (s)
ART Average response time (s)