How we rate conferences

# ConfBase Rating Framework v0.1-alpha

## Overview

The ConfBase Rating Framework evaluates institutional B2B conferences across 10 categories on a 1–5 scale, producing an overall **ConfBase Score (1.0–5.0)** and three pillar aggregates.

This framework is used by the ConfBase Rating Agent and human reviewers to produce consistent, evidence-based ratings of fintech and financial-services industry conferences.

## Scoring Scale

All questions use a 5-point scale:

- **5** = Exemplary / sets the standard
- **4** = Strong / clear quality
- **3** = Solid / meets bar
- **2** = Weak / below expectation
- **1** = Poor / absent

## ConfBase Score Formula

```
ConfBase Score = (audience×3 + curation×2 + sponsors×2 + speakers×2 +
                  networking×2 + content×1 + trackRecord×1 + media×1 +
                  sideProgramming×1 + priceValue×0.5) / 15.5
```

Rounded to 1 decimal place.

## Pillar Aggregates

| Pillar | Formula |
|--------|---------|
| Institutional Signal | (audience×3 + curation×2 + sponsors×2) / 7 |
| Content & Speakers | (speakers×2 + content + media) / 4 |
| Networking ROI | (networking×2 + sideProgramming + trackRecord) / 4 |

## Score Interpretation

| Range | Label | Meaning |
|-------|-------|---------|
| 4.5–5.0 | Tier 1 | Must-attend; defines the category |
| 4.0–4.4 | Strong | Worth a senior-team budget allocation |
| 3.5–3.9 | Solid | Good for vertical-specific value |
| 3.0–3.4 | Mixed | Send junior staff or skip |
| 2.5–2.9 | Weak | Only attend if speaking |
| <2.5 | Skip | Better alternatives exist |

---

## Category 1: Audience Quality (Weight: 3×)

**Why it matters:** The single most important institutional signal. A room of 1,000 founders is worth less to a hedge fund than 50 allocators.

### [AUD-01] What is the institutional vs retail mix?
- 5: ≥80% institutional (asset managers, banks, allocators, regulators, funds)
- 4: 60–80% institutional
- 3: 40–60% institutional (mixed)
- 2: 20–40% institutional (mostly retail/founder)
- 1: <20% institutional (retail-dominated)

### [AUD-02] What is the seniority mix?
- 5: ≥50% C-suite / MD / Partner / GP
- 4: 30–50% C-suite or above
- 3: 15–30% C-suite, mostly VP/Director
- 2: <15% C-suite, mostly individual contributors
- 1: Predominantly junior, students, or community

### [AUD-03] What is the buy-side ratio?
- 5: ≥40% buy-side (allocators, asset managers, family offices)
- 4: 25–40% buy-side
- 3: 15–25% buy-side
- 2: 5–15% buy-side
- 1: <5% buy-side (sell-side / vendor dominated)

### [AUD-04] How rigorous is attendee verification?
- 5: Hard credentialing (work email + LinkedIn + invitation)
- 4: Strict approval, clear reject criteria
- 3: Application required but most accepted
- 2: Open registration with badge tiers
- 1: Anyone with a credit card

---

## Category 2: Curation (Weight: 2×)

**Why it matters:** Filters tourists; defines "earned access" vs paid access.

### [CUR-01] What is the rejection / invite rate?
- 5: Invite-only or ≥70% rejection rate
- 4: 50–70% rejection
- 3: 25–50% rejection
- 2: 10–25% rejection
- 1: <10% rejection (effectively open)

### [CUR-02] What % of attendees are hosted/comped vs paid?
- 5: ≥40% hosted-buyer or invited (signals real curation budget)
- 4: 20–40% hosted
- 3: 10–20% hosted
- 2: <10% hosted
- 1: No hosted program

### [CUR-03] Is there a published Code of Conduct + enforcement?
- 5: Public CoC, enforcement record visible, complaints process
- 4: Public CoC and stated enforcement
- 3: Public CoC only
- 2: CoC referenced but not public
- 1: No CoC

---

## Category 3: Partner & Sponsor Quality (Weight: 2×)

**Why it matters:** Who pays for the badge tells you who's in the room.

### [SPO-01] Tier-1 sponsor count (BlackRock-class)
- 5: ≥5 Tier-1 institutions as headline sponsors
- 4: 3–4 Tier-1 sponsors
- 3: 1–2 Tier-1 sponsors
- 2: Mostly Tier-2 financial firms
- 1: Vendor / crypto-startup sponsorship only

### [SPO-02] Sponsor strategic vs cosmetic
- 5: Sponsors send senior speakers, not just logos
- 4: Mix of speaking sponsors and logo sponsors
- 3: Sponsors mostly logo-only with junior reps
- 2: Sponsors disengaged from program
- 1: Pay-to-play speaking slots dominate

### [SPO-03] Sponsor retention year-over-year
- 5: ≥80% sponsor retention across editions
- 4: 60–80% retention
- 3: 40–60% retention
- 2: 20–40% retention
- 1: Mostly new sponsors (churn signal)

---

## Category 4: Speaker Caliber (Weight: 2×)

**Why it matters:** Named keynotes drive attendance and media coverage.

### [SPK-01] Founder/CEO/MD ratio of speakers
- 5: ≥60% speakers are founders/CEOs/MDs
- 4: 40–60%
- 3: 25–40%
- 2: 10–25%
- 1: <10%

### [SPK-02] Tier-1 keynote presence (named industry figures)
- 5: ≥3 globally recognized industry figures
- 4: 1–2 globally recognized + several regional names
- 3: Strong regional names only
- 2: Mostly mid-tier executives
- 1: Predominantly junior speakers / vendor pitches

### [SPK-03] News-making moments
- 5: Conference is regularly cited as "where X was announced"
- 4: 1+ major announcements per edition
- 3: Occasional newsworthy moments
- 2: Rare news output
- 1: Insular / never makes news

---

## Category 5: Networking Density (Weight: 2×)

**Why it matters:** The actual ROI for institutional attendees is private 1:1 meetings.

### [NET-01] Is there a structured 1:1 meeting platform?
- 5: AI-matched + reserved 1:1 rooms + ≥10 meetings/attendee
- 4: 1:1 platform with manual matchmaking
- 3: Networking app with chat but no scheduled meetings
- 2: Just a directory of attendees
- 1: No networking infrastructure

### [NET-02] Hosted-buyer / matchmaking program quality
- 5: Premium hosted-buyer program with dedicated team
- 4: Hosted-buyer program offered
- 3: Concierge service available
- 2: VIP lounge only
- 1: No matchmaking

### [NET-03] Off-program networking quality
- 5: Curated dinners, salons, member-only sessions
- 4: Some off-record sessions
- 3: Standard networking receptions
- 2: Cocktail hour only
- 1: No structured networking

---

## Category 6: Content Depth (Weight: 1×)

**Why it matters:** Panels-circus vs substantive workshops.

### [CON-01] Workshop / deep-dive count
- 5: ≥10 hands-on workshops or deep technical sessions
- 4: 5–10 workshops
- 3: 2–4 workshops
- 2: 1 workshop
- 1: All keynote/panel format

### [CON-02] Off-the-record / Chatham House sessions
- 5: Multiple off-record tracks for senior decision-makers
- 4: Some off-record sessions
- 3: One off-record track
- 2: All on-record but high-quality
- 1: All on-record, surface-level

### [CON-03] Vertical track depth
- 5: ≥4 deep vertical tracks (e.g. RWA, Custody, Compliance)
- 4: 2–3 vertical tracks
- 3: 1 vertical track
- 2: Generalist program only
- 1: Single-track vendor pitches

---

## Category 7: Track Record (Weight: 1×)

**Why it matters:** A 12th-edition Sibos > a debut summit.

### [TRA-01] Years running
- 5: ≥10 editions
- 4: 5–9 editions
- 3: 3–4 editions
- 2: 2 editions
- 1: First edition

### [TRA-02] Attendance growth trend (3-year)
- 5: Strong sustained growth (>20% YoY)
- 4: Steady growth (5–20% YoY)
- 3: Stable
- 2: Declining
- 1: Significant decline or paused

### [TRA-03] Survived a market downturn
- 5: Has run profitably through ≥2 cycles
- 4: Survived one downturn intact
- 3: New since last downturn
- 2: Reduced scope after downturn
- 1: Cancelled / paused after downturn

---

## Category 8: Media & Influence (Weight: 1×)

**Why it matters:** Does it set narratives, or just consume them?

### [MED-01] Tier-1 press coverage
- 5: Routinely covered by FT/Bloomberg/Reuters/WSJ
- 4: Regular coverage by trade press + occasional Tier-1
- 3: Trade-press coverage only
- 2: Newsletter / Substack coverage only
- 1: No external coverage

### [MED-02] Regulator / policymaker presence
- 5: Active regulator participation (SEC/FCA/MAS/HKMA on stage)
- 4: Regulator speakers present
- 3: Regulator attendees but not on stage
- 2: Industry-only
- 1: No public-sector engagement

### [MED-03] Deal / announcement track record
- 5: Major deals / launches regularly announced from stage
- 4: 1–2 major announcements per edition
- 3: Occasional announcements
- 2: Rare news output
- 1: No deal flow

---

## Category 9: Side Programming (Weight: 1×)

**Why it matters:** For crypto especially, real value is at side events.

### [SID-01] Co-located / partner side-event count
- 5: ≥20 sanctioned side events (Token2049 model)
- 4: 10–20 side events
- 3: 5–10 side events
- 2: 1–4 side events
- 1: No side programming

### [SID-02] Side-event quality (curation by host)
- 5: Host curates / vets side events
- 4: Host publishes side-event calendar
- 3: Side events exist organically without curation
- 2: Few organic events
- 1: None

---

## Category 10: Price-to-Value (Weight: 0.5×)

**Why it matters:** Premium $$ for premium signal is fine; premium $$ for noise isn't.

### [PRC-01] Ticket price tier vs audience tier
- 5: Premium price ($3k+) matched by premium audience
- 4: Mid price ($1k–3k) for solid audience, OR free with strong invite filter
- 3: Reasonable price-value match
- 2: Premium price for mid-tier audience
- 1: Premium price for retail/junior audience

### [PRC-02] Hidden costs (travel/hospitality required)
- 5: Tickets include meals, networking, side access
- 4: Reasonable additional cost expected
- 3: Standard à la carte model
- 2: Hidden costs make true budget significantly higher
- 1: Pay-for-everything model

---

## Output Format

Each rating produces:

1. **`ratings/generated/<slug>.md`** — public-facing markdown with Executive Summary, Rating Overview table, Detailed Analysis, evidence citations
2. **`ratings/generated/<slug>.json`** — structured data for the database (scores, evidence URLs, generated_at, framework_version)

## Framework Version Discipline

- This framework is **v0.1-alpha** — expect breakage
- Each rating record stores `framework_version` field
- When framework updates, ratings are NOT auto-regenerated; flagged as "outdated framework"
- Major framework versions trigger re-rating of Tier-1 conferences only