Skip to content

How are the advanced Co-occurrence ratios calculated?

1 min readAnalysis

Overview

All three ratios use source counts. A and B are the numbers of sources containing each code; I is the number containing both, anywhere in the source; U = A + B − I is the number containing either code. Under Overlap or Nearby, C counts sources where the selected rule is met. Repeated assignment pairs do not increase C.

What to do

  1. Same document: Jaccard = I/U; Dice = 2I/(A+B); overlap coefficient = I/min(A,B). Overlap and Nearby: relationship coverage = C/U; the other source ratios are 2C/(A+B) and C/min(A,B). These passage-rule ratios are not standard segment-level Jaccard, Dice or overlap coefficients.
  2. In the 10-source example, A = 4, B = 3, I = 2, U = 5 and C = 1. Same-document Jaccard is 0.400, Dice 0.571 and overlap 0.667. Under the Overlap rule, coverage is 0.200, 2C/(A+B) is 0.286 and C/min(A,B) is 0.333. A zero denominator is not applicable. Advanced ratios and CSV retain the additional ratios.

Terms in this answer