GlobalTap

GlobalTap — Supplementary Material

Companion to the ISMIR 2026 paper "GlobalTap: Globally Diverse Beat Tracking Benchmark via Crowdsourced Tapping." This page collects supplementary figures, tables, and a per-corpus rating breakdown.

How to view this page.
Privacy notice. Country panels are referred to by ISO codes, participant IDs do not appear, and the code repository uses portable placeholder paths via ${PROJECT_ROOT}.
Contents
  1. Per-corpus rating distributions
  2. Per-source breakdown of the mixed-corpora panel
  3. Recruitment, exclusions, and benchmark demographics
  4. Case-study playhead videos
  5. Supplementary robustness analyses
    1. Tapper-count convergence
    2. Exploratory country-panel analyses
    3. Complete metrical-preference analysis
    4. Beat metrics beyond F-measure
    5. Method settings and sensitivity
  6. Code repository & reproduction

1. Per-corpus rating distributions

Box-plot rating distributions for the four validation corpus groups (Mixed, Ballroom, MIREX, GlobalMood). The Mixed-corpora panel additionally overlays per-corpus mean Crowd vs. Reference ratings for the 13 constituent corpora, in distinct colors, to expose within-panel heterogeneity.
Figure S1. Per-corpus distributions of mean per-excerpt ratings (1–7 scale) for Crowd and Reference annotations across the four validation corpus groups. The summary statistics from this figure (per-corpus means, Δ, p-values, and effect sizes) are reported in Table 1 of the main paper. The mixed-corpora panel also shows the per-source Crowd and Reference means for its 13 constituent corpora.

2. Per-source breakdown of the mixed-corpora panel

The 100-excerpt Mixed-corpora panel comprises 13 source corpora. Wilcoxon signed-rank tests compare excerpt-level Crowd and Reference means within each source, with Benjamini–Hochberg correction across the 13 tests. None remain significant at α = .05 after correction.

Source corpus n Crowd Ref Δ p (Wilcoxon) pBH dz
ASAP 8 3.353.54−0.19.742.877−0.20
Beatles 8 4.894.07+0.82.055.178+0.83
Candombe 13 4.404.17+0.23.733.877+0.20
Carnatic 4 4.694.84−0.15.625.877−0.30
Cretan 3 5.365.63−0.27.500.812−0.80
Groove (MIDI) 8 4.454.79−0.33.312.580−0.44
GTZAN 8 4.794.95−0.16.844.914−0.23
GuitarSet 8 3.814.13−0.32.031.135−0.75
Hainsworth 8 4.094.72−0.63.008.102−1.31
Harmonix 8 5.084.20+0.88.078.203+0.74
RWC 8 4.244.20+0.04.938.938+0.04
TapCorrect 8 5.224.88+0.34.250.542+0.44
Turkish 8 4.443.90+0.54.016.102+1.39

Crowd and Ref columns are mean per-excerpt ratings on the 1–7 scale. Δ = Crowd − Ref. p from Wilcoxon signed-rank on excerpt-level means. pBH is the Benjamini–Hochberg-adjusted p-value across the 13 corpus tests.

3. Recruitment, exclusions, and benchmark demographics

Across the 200-excerpt GlobalTap benchmark and the 240-excerpt validation set, 1,479 tapping participants contributed 36,624 trials, and a separate panel of 130 approved listener raters contributed 6,487 ratings on the 240 validation excerpts.

Recruitment and exclusions (benchmark panel). Across the ten country panels, 2,160 people began a session: 707 completed it, 831 did not pass the tapping performance check, 134 declined a consent step, and 488 left before finishing. Of the 28,945 recorded trials, 23,493 passed the recording, marker-analysis, and post-trial checks. The 746 benchmark tappers are those with at least one such trial (698 who completed and 48 who left early). The period-relation analysis included 23,492 trials, and the phase analysis used the subset of 11,450 matched-rate trials. The per-export breakdown sits with the original session exports, which are not included (see data/SOURCES.md). The taps themselves are released in data/taps/. The listener-rating panel retained 130 of 139 starts, and those 130 raters contributed all 6,487 reported ratings.

Panel Reference source Excerpts Tappers Median tappers / excerpt Trials
Ballroom Expert beat grids 80 231 40 ~3,800
Mixed corpora 13 source corpora 100 104 36 ~3,550
MIREX Lab-tapper consensus (40 participants)20 102 67 ~1,350
GlobalMood validationNone (absolute-quality check) 40 296 110 ~4,400
GlobalTap benchmark Crowd-derived 200 746 117 ~23,500
Total— 4401,479—~37,000

The trial totals and median number of tappers per excerpt include only trials that passed the recording, marker, and post-trial checks.

VariableDistribution
Age (years)M = 33.1, SD = 11.1
Gender49.5 % female, 49.1 % male, 1.4 % non-binary / undisclosed
Years of formal musical trainingmedian 1 (IQR 0–4), with 33 % reporting none and 9 % reporting ≥ 10 years
Country-panel medians (training)1–6 years across panels
Gold-MSI (abbrev. 25-item, 1–7)overall M = 4.10, SD = 0.88, with country-panel means from 3.77 to 4.56

Demographics are for the 746 GlobalTap benchmark tappers. Country-panel medians for the 10-country GlobalTap benchmark are comparable across panels and span 1–6 years of formal musical training.

4. Case-study descriptions

The eight cases below cover excerpts of varying difficulty: three illustrate the structural divergences described in §3.6 (a phase offset, a tactus-level alternative, and bimodal pooled tapping), one is a high-consensus contrast case, and four are simple-alignment excerpts where the KDE peak tips track the optimizer beat grid throughout the song and Crowd / Reference clicks are closely aligned.

Candombe — phase offset The crowd taps about 140 ms after the expert annotation, at the same tempo.
GTZAN Disco — simple alignment KDE peaks track the optimizer grid through the entire window. Crowd and Reference clicks are closely aligned.
Viennese Waltz — tactus mismatch Crowd locks to the half-rate felt pulse. Reference grid is the notated tactus.
Pop (TapCorrect) — simple alignment Stable 4/4 pop track with a crowd-corrected reference annotation. KDE peak tips and the optimizer grid coincide throughout the listener window.
Ballroom — bimodal pooled tapping The pooled taps also show a pulse at the reference's rate, double the crowd grid's. The crowd grid follows every other reference beat.
Latin Ballroom — simple alignment Strong dance-floor isochrony. The displayed KDE consensus and the optimizer beats overlap virtually identically.
Ballroom — high-consensus baseline CV ≈ 0.024. Crowd and Reference are closely aligned.
Cretan — simple alignment (non-Western) The pooled KDE locks tightly onto the optimizer grid for the full 15 s window.

Each video concatenates the Crowd-consensus click overlay, then the Reference-annotation click overlay, back-to-back (~30 s total). If a video fails to load, the same excerpts are available as separate crowd_gs/gt click-overlay MP3s in audio_demos/.

Case-study excerpts — structural-divergence set: proyecto.1992_lobo_06 (Candombe phase offset), Albums-Chrisanne3-09 (Ballroom Viennese Waltz tactus), Media-105914 (Ballroom bimodal pooled tapping). Alongside them we release one high-consensus contrast case, Albums-AnaBelen_Veneo-13 (Ballroom, Crowd ≈ Reference). Simple-alignment set: gtzan_disco_00000 (GTZAN Disco), 054_youtube_UgL4N4Hf1dk (TapCorrect Pop), Albums-Latin_Jam-04 (Latin Ballroom), and cretan1 (Cretan). Source-corpus locations are documented in data/SOURCES.md.

5. Supplementary robustness analyses

Multiplicity. Corrections are applied within each family of tests, Benjamini–Hochberg across the 13 mixed-corpus rating comparisons (§2 above), and across all ten metric comparisons mir_eval returns for madmom versus Beat This!. The excerpt-level associations reported in the paper's §3.3 are uncorrected in the text, and every association that is significant there remains significant after Benjamini–Hochberg correction within that family. The country-panel comparisons in §5.2 are FDR-corrected across all 45 pairs.

5.1 Tapper-count convergence

Figure S2 shows convergence of participant-normalized tapping KDEs and their extracted peaks. Compared with the full consensus, KDE correlation reached .90 at 40 tappers and peak F-measure reached .90 at 30 tappers. At 90 tappers, the values were .985 and .971. The full consensus contains 114–120 tappers per excerpt (median 117).

A separate analysis ran independent groups through KDE, peak extraction, and optimization. Final-grid F-measure was .893 at N=20 and .918 at N=50. Agreement on period class was .850 and .885, respectively.

Two tapper convergence plots. Peak F-measure rises above point nine by 30 tappers against the full consensus. Independent groups remain below point nine at 50 tappers. KDE correlation converges more slowly.
Figure S2. Convergence as a function of tappers per excerpt. Circles compare subsamples with the full consensus. Squares compare independent groups. The dotted horizontal line marks .90.

5.2 Exploratory country-panel analyses

For each excerpt, we compared each trial's tapping period with a reference period, the median of the other nine panels' median periods on that same excerpt. Each trial was then classified as double rate (ratio .35–.65), matched rate (.80–1.25), half rate (1.75–2.25), or other/unclear.

Panel differences were clearest in which metrical level listeners chose. Japan showed the least double-rate and most half-rate tapping of any panel (7.5% / 20.1%). Egypt showed the opposite extreme, with the most double-rate and least half-rate tapping (28.1% / 9.4%). After accounting for differences between excerpts, participant-level permutation tests found that metrical choice varied across panels (p<.001). Tap timing (phase) showed no consistent differences across panels (p=.152). Of the 45 pairwise panel comparisons, 2 survived FDR correction (Japan–Mexico and Brazil–Japan, both q=.045), so we describe the phase evidence as weak rather than absent (panel_tests/phase_pairwise_panel_tests.csv). These comparisons are between recruitment panels on this sampled excerpt set, not against an expert or culturally authoritative ground truth. We grouped participants by where they were recruited, which may not reflect the music they are enculturated to, and we did not measure how familiar they were with individual excerpts.

We also asked whether tapping coherence is higher when an excerpt's source country matches the panel that tapped it. Across the five source countries with 20 benchmark excerpts each (US, KR, FR, MX, EG), an analysis that accounted for differences between excerpts and panels, and treated measurements from the same excerpt as related, estimated a match effect of +0.066 ISTC units (95% CI [−0.030, +0.161], two-sided p=.179), providing no reliable evidence of an own-country advantage.

5.3 Complete metrical-preference analysis

This analysis includes all 180 excerpts with independent expert beat references. Excerpts are grouped by the Crowd annotation's period relative to the reference. Rating differences are excerpt-level Crowd minus Reference means. An excerpt is classified as matched, double, or half rate when its crowd-to-reference period ratio falls within ±0.15 octaves (about ±11%) of 1×, 0.5×, or 2×, respectively. All remaining excerpts are grouped as other ratios. All nine half-rate excerpts favored Crowd, but double-rate and other-ratio cases had no consistent direction.

On matched-rate excerpts, an excerpt's phase offset is the median signed distance from each Crowd beat to the nearest reference beat within 150 ms, over the rendered 10–25 s window, and it counts as consistent at 20 ms or more. On 8 excerpts no Crowd beat came within 150 ms of a reference beat: the Crowd beats fell a third to half a beat from the reference's. These also count as consistent offsets. Script: supplementary_analyses/metrical_preference/structured_divergences.py.

Period relationnCrowd higherMedian difference
Matched rate14551−.143
Crowd half rate99+.748
Crowd double rate147−.238
Other ratio127+.393

5.4 Beat metrics beyond F-measure

Standard mir_eval metrics were computed with the GlobalTap consensus beat sequence as the reference and each tracker's beats as the estimate. The analysis therefore asks how each tracker agrees with the crowd consensus. The table and the paired tests use the 198 excerpts evaluable for both trackers. Two Beat This! outputs with fewer than two beats in the 10–25 s window were excluded from paired comparisons.

Following Davies, Degara & Plumbley (2009), CML is correct metric level and AML is any metric level, which credits double, half, and offbeat interpretations, each scored over the longest continuously correct stretch (CMLc/AMLc) or all beats (CMLt/AMLt), along with information gain, which measures how far the spread of beat errors departs from uniform, all computed with mir_eval defaults.

MetricmadmomBeat This!
CMLc.797.621
CMLt.807.636
AMLc.947.908
AMLt.956.935
Information gain.669.643

Paired excerpt-level tests favored madmom for all five metrics: CMLc, CMLt, and information gain at FDR q<.001, AMLc at q=.011, and AMLt at q=.024.

Pooled (pre-optimization) ISTC and pipeline-output CV were both associated with tracker–crowd agreement on this benchmark: ISTC with madmom (ρ=.39, p<.0001) and Beat This! (ρ=.27, p=.0001). CV with both Beat This! (ρ=−.24, p=.0006) and madmom (ρ=−.18, p=.009). The madmom correlations use all 200 excerpts and the Beat This! correlations the 198 it could evaluate. Script: supplementary_analyses/istc_cv_tracker_correlations/run_pooled_istc_cv_tracker_correlations.py.

5.5 Method settings and sensitivity

Pipeline settings were selected during development using checks and sensitivity analyses on the validation corpora (Ballroom, the mixed corpora, and MIREX), then used unchanged for all reported analyses, including the GlobalTap benchmark. Varying each setting one at a time by 18–50% across all 240 validation excerpts produced grids with F-measure .947–1.000 against the reported grids, with the tactus unchanged in 92.1–100% of cases. Each setting and the reason for its value are listed in METHOD_PARAMETERS.md.

Full CSVs, exclusion records, and scripts for these analyses are available in supplementary_analyses/.

6. Code repository & reproduction

The full pipeline source — every stage, the paper's optimizer, configs, and figure-regeneration scripts — is provided in this companion repository. The repository's README.md documents the pipeline architecture and the commands that regenerate the supplied result tables and figures, and that rebuild the consensus beat grids from the released tap data. Stages that need raw audio or the original session exports cannot be run from this repository alone. The consensus beat annotations are in data/annotations/ (200 benchmark and 240 validation excerpts, one beat time per line) and the de-identified benchmark taps behind them are in data/taps/.

Repository: https://github.com/williambotticelli-wells/GlobalTap
This supplementary HTML: https://williambotticelli-wells.github.io/GlobalTap/supplementary.html

GitHub Pages serves this document with figures loaded inline. For offline viewing, download the entire repository so relative figure and analysis paths remain available.


ISMIR 2026 companion supplementary. Code released under MIT. Derived per-stem CSVs released under CC BY 4.0.