অলীকবচনAlikbachan
Findings of EACL 2027

One Framework to Diagnose Them All A Stratified Benchmark for Bengali LLM Hallucination

অলীকবচন  ·  Alikbachan, ‘mirage of language’

Asif Shahriyar Sushmit1*, Shefayat E Shams Adib2*, Abdullah Al Jubaer Gem2*, Ahmed Shafin Ruhan2*, MD. Nazmuddoha Ansary3*, Biplab Kumar Sarkar4*, Syed Rifat Raiyan2*†, Ajwad Abrar2, Abdullah Bin Hasan5, Adib Sakhawat2, M. Sakeef Hossain2, Ahmed Alfey Sani2, Arefin Mizan6, Sourab Chakma7, Quazi Adibur Rahman Adib8, Wassie Haque5, Sanjay Kumar Sen5, Saad Tahmid5, Mohammad Mamun Or Rashid9

1IEEE 2Islamic University of Technology 3Bengali.AI 4North Dakota State University 5Bangladesh University of Engineering and Technology 6Institute of Policy Dynamics 7Mawlana Bhashani Science and Technology University 8BRAC University 9Jahangirnagar University

* Equal contribution  ·  † Corresponding author: rifatraiyan@iut-dhaka.edu

Paper (PDF) Code & data Hugging Face dataset Kaggle competition Alikbachan org BibTeX
7,516
items across two independently built phases
32
failure modes in five hallucination families
222
teams and 3,566 submissions in the open competition
24 / 25
teams in both phases score lower on held-out Phase 2

Abstract

Hallucination research in low-resource languages fragments easily: each newly named failure mode prompts its own dataset, spending scarce annotators on incomparable resources. We argue for consolidation and test it at community scale. Alikbachan is a Bengali hallucination-detection benchmark stratified along three crossed axes: a human-validated cultural-distance band, six task types, and a five-family, 32-mode hallucination taxonomy. It comprises a harvested 2,516-item test set (Phase 1) and a quota-constructed, gold-labeled 5,000-item set (Phase 2). The stratification is diagnostic. Four zero-shot LLM judges vary by over 30 macro-F1 points across strata, and the item-level predictions of 99 Phase-1 and 32 Phase-2 competition systems reproduce the profile: discourse-level omission defeats judges and most teams alike, whereas only a minority over-flag negative controls. The judges’ verdict probabilities rank items well (ROC-AUC 0.74–0.95) but are overconfident (ECE 0.04–0.29). An open competition on Alikbachan drew 222 teams and 3,566 submissions, and a single-prompt 32B judge reaches the 57th percentile. Of the 25 teams in both phases, 24 regress on Phase 2 (mean −17.6 points) while every zero-shot judge improves, and Phase-1 rank barely predicts Phase-2 rank (Spearman ρ = 0.35), so a Phase-1 leaderboard alone would have crowned a different winner.

At a glance

A fluent answer is the hardest kind to doubt

In a low-resource language, a fluent answer is both the hardest to doubt and the most expensive to check. A model that writes grammatical, register-appropriate Bengali gives no sign when it misattributes a poem or misdates a war, and few people can verify such claims against primary sources.

Asked in Bengali who wrote the poem Bidrohi, a model may name Rabindranath Tagore, the Bengali poet best known abroad, instead of its author, Kazi Nazrul Islam. The answer is grammatical and culturally legible, so nothing on its surface gives it away. Each Alikbachan item carries the metadata that locates such a failure.

Item
P2-00040  Wikipedia & Banglapediatheory-authored
Context
[NULL] — judged against world knowledge
Prompt
‘বিদ্রোহী’ কবিতাটি কে রচনা করেন?Who wrote the poem Bidrohi (‘The Rebel’)?
Response
‘বিদ্রোহী’ কবিতাটি রচনা করেন রবীন্দ্রনাথ ঠাকুর।Rabindranath Tagore wrote the poem Bidrohi.
Strata
band C1 · culturally situatedshort closed-book QAFamily Acultural-default substitution
Gold label
0 · hallucinated
The poet is Kazi Nazrul Islam; the response substitutes the more globally famous laureate.
Figure 1 of the paper: a Phase-2 item, the four judges' scores on all items versus discourse-level omission, and Phase-1 versus Phase-2 scores of teams and judges.
Figure 1. Alikbachan at a glance, as printed in the paper. (1) the item on the left; (2) the four judges’ macro-F1 on all of Phase 2 against discourse-level omission, a blind spot their aggregate scores hide; (3) from Phase 1 to Phase 2, 24 of 25 teams lose ground while every judge gains. Interactive versions of (2) and (3) follow below.

The framework

Consolidation over enumeration

The usual response to each newly characterized failure is a new benchmark. Under annotation scarcity that is a queue that never clears. We spend the same expert effort on one resource whose axes cut across failure modes, so that a new phenomenon enters as another cell rather than another dataset.

A framework built this way has to meet four desiderata:

  1. Axes that cut across failure modes. A new failure becomes a new combination of labels: cultural distance, task type and a hallucination taxonomy.
  2. Item-level metadata. One evaluation run reports where a system fails as well as how well it scores.
  3. A second, independently constructed phase. Overfitting to a public leaderboard becomes visible.
  4. An independent audit. Construction defects are separated from model errors.
Figure 2. The Alikbachan framework. Two independently sourced phases (1, 2) feed an open competition (3) and a public release (4). An independent audit (5) reviewed a sample of the released items, and the paper (6) analyzes zero-shot judges, the teams’ item-level predictions and the audit.

The task

Each item is a triple of an optional context c (a passage, or the token [NULL]), a Bengali prompt p and a candidate response r. The task is to predict y ∈ {0, 1}: 1 marks a faithful response and 0 a hallucinated one, with fabricated, unsupported or factually incorrect content. With a null context the response is judged against world knowledge; otherwise it is judged against the context, even where the context deliberately departs from reality.

Axis 1 · Cultural-distance bands

The central organizing axis is a three-level, human-validated cultural-distance band. It describes what verification an item needs, and it turns out not to be a monotonic difficulty gradient.

C0 · 750 items
Globally stable

Culture-independent facts in science, geography or mathematics, such as the boiling point of water. The control band.

C1 · 3,500 items
Culturally situated

Answers specific to Bangladesh or differing from a global default: literary authorship, Liberation War dates, monuments, regional administration. Home of fluent but locally wrong output.

C2 · 750 items
Contested or time-sensitive

Current officeholders and revised statistics, where a hallucination must be told apart from outdated knowledge.

Axes 2 & 3 · Task types and a 32-mode taxonomy

Phase 2 spans six task types: short and long open-book QA (both context-grounded), short closed-book QA, summarization, Bengali–English translation, and adversarial probes built on false premises, prompt injections, counterfactual contexts or instruction constraints. Every Phase-2 item also belongs to one of five hallucination families, which divide into 32 failure modes of 50–400 items each.

Family A
Content / parametric

Errors in dates, entities or attributions, independent of any context.

9 modes · 2,000 items
Family B
Context / intrinsic

Errors that contradict or embellish the given context.

5 modes · 1,200 items
Family C
Linguistic / cultural

Errors of Bengali script, register, lexicon or translation.

6 modes · 700 items
Family D
Adversarial / robustness

From prompt injection to miscalibration.

7 modes · 700 items
Family E
Meta / pipeline

Ambiguous gold, imperfect sources, encoding variants that a robust judge should see through.

5 modes · 400 items
The taxonomy, sized by items
Figure 3. Five families and 32 failure modes of Phase 2. Click a family to zoom in; hover for each mode’s share of faithful items.
Phase-2 composition
Figure 4. Every quota was met exactly. The public split keeps each failure mode’s share to within four items of 30%.

Two phases, one schema

Phase 1 harvests short-answer questions from four vetted Bengali sources (two examination and quiz paper collections, a newspaper corpus and an encyclopedia) and pairs them with responses written by LLMs or people. It follows a real question distribution: of its 2,516 test items, 1,361 carry a supporting context and 1,155 are closed-book.

Phase 2 is built under explicit quotas over six task types, three bands and 32 failure modes, drawing on seven Bengali corpora: Wikipedia and Banglapedia, government publications, newspapers, National Curriculum and Textbook Board texts, Bangladeshi statutes, e-Bangla Library texts and Common Crawl. Of its 5,000 items, 3,250 are theory-authored around a target failure mode and 1,750 are theory-confirmed from real source content.

Annotation and audit. Two separate teams of five undergraduate volunteers built and checked the data. An independent audit team reviewed a random 500 items; three auditors labeled a shared 100-item subset independently (Fleiss’ κ = 0.74). The audit found 310 Supported, 65 Refuted, 100 Not Entailed and 25 Malformed items and overturned 24 of the 500 labels (4.8%).

Diagnosis in practice

Four zero-shot judges

We evaluate four zero-shot LLM judges spanning about an order of magnitude in scale: Qwen2.5-32B, Gemma-2-9B, Llama-3.1-8B and TigerLLM-9B-it, the Bengali-adapted Gemma-2-9B. All four receive the same strict prompt, output one verdict digit and decode greedily. From the log-probabilities of the two verdict tokens we take s = P(1) / (P(1) + P(0)), the judge’s probability that the response is faithful.

Headline results on both releases
Figure 5. Zero-shot judges against a majority-class reference. Qwen2.5-32B leads on both releases (macro-F1 0.770 and 0.882); Llama-3.1-8B trails but stays above the reference. Switch to ECE to see that every judge is overconfident.
VerdictsProbability scores
SystemAcc.Macro-F1F1 hallu.F1 faith.PR-AUC faith.PR-AUC hallu.ROC-AUCECE ↓

Ranking is good, confidence is not

Calibration separates the judges more sharply than ranking does. Every judge is overconfident on both releases (ECE 0.042–0.285), so a judge’s stated confidence cannot be read as its probability of being right.

Bengali adaptation shows its clearest effect here. TigerLLM-9B-it improves on its base model by only 0.003–0.011 macro-F1, yet cuts ECE from 0.227 to 0.061 on Phase 1 and from 0.147 to 0.042 on Phase 2.

Figure 6. ROC-AUC against expected calibration error. Hollow markers are Phase 1, filled markers Phase 2.

Category-wise diagnosis

One run, read three ways

Aggregate macro-F1 measures how well a system performs but says nothing about where it fails. Because every Phase-2 item carries a band, a family and a task type, the same evaluation run yields a per-stratum readout at no extra annotation cost.

Macro-F1 by stratum, Phase 2
Figure 7. The diagnostic dashboard: each judge’s macro-F1 by cultural band, hallucination family and task type, below its score on all 5,000 items. Darker cells score higher.
  • Cultural distance is not a monotonic gradient. C0 and C1 are comparable for every judge while C2 is consistently harder (Qwen2.5-32B: 0.93, 0.90, 0.76), which justifies keeping C2 apart from C1.
  • Task type has the strongest, most consistent effect. Short open-book QA is easiest for every judge (up to 0.98), while closed-book QA and adversarial items are hardest; Llama-3.1-8B falls from 0.82 to 0.43.
  • Judges differ in profile, not only in level. TigerLLM-9B-it beats its base model where parametric Bengali knowledge matters (Family A, 0.84 vs 0.78) and trails it where the answer must be read from a context (Family B, 0.79 vs 0.88). Their aggregates, 0.840 and 0.829, hide that trade-off.

A blind spot that 36 systems share

Discourse-level omission, a summary that silently drops a qualifier, is the hardest mode for the judges (mean macro-F1 0.213) even though it belongs to the easiest family. The judges pass 63–92% of such summaries as faithful, and the median of 32 competition teams misses 59.5% of them. Systems that reliably catch explicit contradictions (judges 0.977) still miss quiet omissions, the error with more consequence in deployment.

Aggregate scores hide a shared blind spot
Figure 8. Each judge’s macro-F1 on all of Phase 2 (judge colour) and on discourse-level omission (pink). Every judge falls below the per-mode majority reference on omission.

Below the family level: all 32 failure modes

Family averages hide large differences between modes. Negative controls, items built to be unambiguously faithful, are a health check: the judges false-flag 1.0–13.0% of them and the median team 8.2%, but 6 of 32 teams flag more than half. Some modes separate weak judges from strong ones: Llama-3.1-8B nearly matches Qwen2.5-32B on temporal confusion (0.591 vs 0.612) but trails badly on extrapolation with fabricated detail (0.404 vs 1.000).

Per-mode results, Phase 2
Figure 9. Every failure mode, with the four judges and a per-mode majority reference (grey tick). Dot colour in the labels gives the family: ● A ● B ● C ● D ● E. On negative controls all 200 items are faithful, so macro-F1 halves at the first false flag; read the false-flag view for them.
Δ over majority
Failure modeFam.MajorityJudges (mean)Teams (mean of 32)
negative-controlA1.0007.3% flagged†26.2% flagged†
discourse-level-omissionB0.487−0.274−0.164
sociopragmatic-registerC0.394+0.400+0.343
script-attention-trapsC0.375+0.428+0.380
reasoning-language-inconsistencyC0.393+0.431+0.414
direct-contradictionB0.467+0.510+0.307

Table. Macro-F1 gain over a per-mode majority reference on the two blind-spot candidates (above the rule) and four modes with clear gains. † All negative controls are faithful, so this row gives the mean false-flag rate.

A community-scale competition

222 teams, and a leaderboard that would have crowned the wrong winner

The consolidation argument says one well-stratified framework can concentrate research effort instead of fragmenting it. We test it on the complete submission history of the open competition built on Alikbachan: a Phase-1 leaderboard on the 2,516-item test set, then a Phase-2 round in which the organizers ran invited teams’ offline notebooks once on the 5,000 held-out items.

The Phase-1 leaderboard drew 222 teams (496 participants) and 3,566 submissions over 19 days. The top score (0.983 macro-F1) appeared on day three: the benchmark proved challenging but attainable.

Where a single prompt lands among purpose-built systems
Figure 10. Best macro-F1 of each team, with the four zero-shot judges. On Phase 1, Qwen2.5-32B reaches the 57th percentile: one prompt to an off-the-shelf model roughly matches the median purpose-built system. The first bar holds every team below 0.6.

One leaderboard is not enough

Of the 222 Phase-1 teams, 25 also entered Phase 2. Twenty-four of them score lower there, by a mean of 17.6 macro-F1 points (s.d. 17.7; one-sided Wilcoxon signed-rank p = 5.7 × 10−7). The losses are uneven: 12 teams lose less than 0.10, six lose 0.14–0.25, and six collapse from a mean of 0.887 to 0.438.

The decline also reorders the field. Phase-1 rank predicts Phase-2 rank only weakly (Spearman ρ = 0.35, 95% bootstrap CI [−0.11, 0.70]), and the phases share no winner. The Phase-1 winner falls from 0.983 to 0.812, while the team ranked sixth on Phase 1 leads Phase 2 (0.954).

Phase 1 vs Phase 2, the 25 teams in both
Figure 11. Every team but one lies below the diagonal (worse on Phase 2), and every zero-shot judge lies above it. Hover a point for the team name; darker red means a larger loss.

Phase 2 is not uniformly harder. All four zero-shot judges, tuned on neither phase, score 0.10–0.12 macro-F1 higher on Phase 2. Its difficulty is specific to systems built against the Phase-1 leaderboard, which makes the decline prima facie evidence of leaderboard overfitting. Phase 2 was also scored once, without feedback, and is built differently, so other readings deserve weight.

The task-type effect replicates across 99 systems

Re-scoring the item-level predictions of 99 of the top 100 Phase-1 teams, these independently built systems also find context-grounded QA easier than closed-book QA (mean macro-F1 0.913 vs 0.812, with far less variance). Whatever their design, they verify against evidence better than they recall facts. Domains follow the judges too: history, literature and culture is strongest (0.906), Bengali language and lexicon weakest (0.740).

Zero-shot judges on Phase-1 strata
Figure 12. Macro-F1 of each judge on Phase-1 strata, with the majority reference. Phase 1 repeats the Phase-2 task effect: context-grounded items are far easier than closed-book ones. Band and domain are reconstructed proxies; C2 has only 19 items.

Curation lessons

A cautionary tale from the audit

A binary faithful/hallucinated label suits scoring but collapses four evidential states: Supported, Refuted, Not Entailed and Malformed. The audit recorded the four-way state before projecting it onto the binary label, and its lessons reach beyond Alikbachan.

  • Bands define the verification an item needs. A C0 item can still be malformed by wrong notation, units or polarity; two C2 values can both be right under different reference dates.
  • Most contextual errors break a relation. They reuse the context’s vocabulary but assign it to the wrong entity, role, date or jurisdiction, which lexical overlap cannot catch. The audit records an answer-slot signature instead.
  • Some apparent hallucinations are construction defects. A stem that refers to dropped options, or a copied answer key with an upstream error, belongs in a repair queue before evaluation.
  • Linguistic validity belongs in the taxonomy. Newly found lexical failures became new Family-C cells rather than a separate resource, as consolidation anticipates.
LayerCommon pitfallRequired curator check
PackagingAn image, option, table or answer-bearing part is missing from the released rowTest answerability on the released row itself, not on its source
RepresentationOCR, Unicode or math notation admits competing readingsKeep raw and canonical forms; adjudicate only once one reading is fixed
Linguistic validityThe idiom, register, morphology or lexical relation is ill-formedJudge grammaticality, lexical correctness and contextual support separately
Question contractThe answer has the wrong role, entity, place, time, unit or polarityRecord an answer-slot signature that binds every requested argument
Epistemic statusAn estimate is treated as exact, or an unresolved future as factPreserve approximation, modality, authority and temporal scope
ReasoningTopical overlap stands in for a comparison or compositionRequire a licensed operation and reject the nearest plausible alternative
Annotation recordResponse, rationale and label describe different judgmentsReconcile every field before release; one matching field cannot repair another

Table. The audit condensed into a seven-layer item contract, ordered by where adjudication should stop: an item that fails one layer cannot be judged on the layers below it.

Discussion

What practitioners should carry away

Consolidation buys diagnosis as well as economy. The omission blind spot, the hardness of C2 and TigerLLM-9B-it’s trade-off all surfaced from the same run. Separate single-task benchmarks could approximate this only with compatible labels and schemas, a coordination that is rare in low-resource ecosystems.

A leaderboard is a lower bound on what stratification can reveal. For languages that can afford only one or two benchmark iterations, make the second one stratified and independently built.

Habit 1
Report error counts beside macro-F1

On near-single-class strata, a single false flag can halve the score.

Habit 2
Read verdict probabilities as a ranking

Until they are calibrated. Every judge we tested is overconfident.

Habit 3
Test on items the detector never saw

Such as the held-out Phase-2 split, before trusting a leaderboard score.

A language with few annotators cannot afford a benchmark for every way a model can fail; it can afford one that shows where each model does.

Data & evaluation

The release

The data come from the অলীকবচন: Bengali LLM Hallucination Detection Challenge (Kaggle, Datathon 2.0), organised by IUTCS at IUT, powered by the Institute of Policy Dynamics and sponsored by the EBLICT project. The data are released under CC BY-NC-SA 4.0, with the judge scripts and a scorer that reports macro-F1, error rates, ROC-AUC and ECE per stratum.

Where to find it. The data, judge scripts and scorer live in Alikbachan/Alikbachan on GitHub, and the released splits are also on the Hugging Face Hub. The Alikbachan organization on GitHub also hosts the project’s other experimental repositories.

SplitFileItems% faithfulLabels
Phase 1 testdataset/phase1/test.jsonl2,51653.1public
Phase 1 sampledataset/phase1/sample.jsonl29954.5public
Phase 2 publicdataset/phase2/public.jsonl1,50046.5public
Phase 2 hiddennot distributed3,50045.3private, contamination-resistant

What the release offers each detector family

Every item carries context, prompt_bn, response_bn and label. Phase-2 items add task_type, cultural_band, family, failure_mode, provenance, source and an English rationale. At test time a detector should see only the context, prompt and response, since the other fields reveal or correlate with the label.

Detector familyWhat Alikbachan provides
Evidence-groundedcontext (or [NULL]) and response_bn for every item
Self-consistencyprompt_bn; resampling needs a proxy model, as generators are not released
Supervisedlabel on 4,315 public items; strata for splits; rationale as extra supervision
Verdict confidenceTop-20 verdict log-probabilities from the judge scripts
White-box likelihoodContext, prompt and response for teacher forcing
Error analysisBand, task, family, mode, provenance, source (Phase 2); task type (Phase 1)

A white-box signal falls short

The mean token log-likelihood a judge assigns to a response under teacher forcing separates faithful from hallucinated responses on context-grounded Phase-1 items (AUROC 0.69–0.78), but barely on closed-book items or Phase 2 (0.50–0.56), far short of the judges’ verdict scores.

Teacher-forced log-likelihood as a hallucination signal
Figure 13. AUROC with 95% confidence intervals, by model, phase and whether the item has a context.

The judge prompt

System prompt and user template

System prompt

You are a strict binary classifier for Bengali hallucination detection.
Given a Bengali (context, prompt, response) triple, you must output
EXACTLY ONE character: the digit 1 or the digit 0. No words, no JSON,
no explanation, no whitespace, no quotes — just the digit.

OUTPUT 1  if the response is FAITHFUL: it is supported by the context,
or (when the context is [NULL]) is factually correct.
OUTPUT 0  if the response is HALLUCINATED: it contains factual errors,
contradicts the context, or invents information not supported by it.

User template

Context: {context}
Prompt: {prompt_bn}
Response: {response_bn}

Label (1 or 0 only):

The verdict is the first digit 0 or 1 in the output; if there is none, the score thresholded at 0.5. ECE bins the confidence max(s, 1−s) into 15 equal-width bins. The scorer scripts/evaluate.py reports every metric overall and per stratum.

Score your own predictions
git clone https://github.com/Alikbachan/Alikbachan
cd Alikbachan
python scripts/evaluate.py --help

Or load the public splits from the Hugging Face Hub

from datasets import load_dataset
ds = load_dataset("Alikbachan/Alikbachan")

Limitations & ethics

What the evidence does and does not show

Theory-authored items risk confirming their own taxonomy

About two-thirds of Phase 2 (3,250 items) are written against target failure modes and labeled by construction, so the taxonomy partly shapes the evidence used to evaluate it. The 1,750 theory-confirmed items and the taxonomy-blind competition systems limit this circularity without removing it.

The audit checked a sample

The audit overturned 24 of 500 sampled labels (4.8%): the released labels largely hold, but some residual noise should be expected. Both teams were undergraduate volunteers, and one annotation team built both phases. The Phase-1 C2 band is small (19 of 2,516), so the finding that C2 is the hardest band rests on the Phase-2 gold labels (750 items).

Scope of the empirical evidence

One zero-shot configuration per model, with no prompt sweep, no fine-tuned detector and no frontier closed model. Item-level predictions were available for 32 of 222 teams and for 99 of the top 100, all selected on Phase-1 score. Only 1,500 of the 5,000 Phase-2 items are public, so third parties cannot yet reproduce full-set numbers. Anyone re-scoring third-party predictions should first rule out polarity errors (1 = faithful).

The generalization gap admits other readings

Phase 2 was organizer-scored on a held-out fold and differs from Phase 1 in construction, task mix and label balance (53.1% vs 45.7% faithful). With 25 teams we do not claim to have isolated overfitting as the cause.

Ethical considerations

Items are built from public Bangladeshi sources and name public figures only in their public roles; the audit removed items whose falsehoods targeted individuals or groups. The benchmark necessarily contains fabricated Bengali text, adversarial probes and prompt injections, so generators should not be trained on its hallucinated responses without filtering. Annotators and auditors were unpaid undergraduate volunteers, and competitors took part voluntarily under published terms.

The C1 band surfaces a representational harm, the overwriting of locally correct knowledge by globally dominant defaults, and should be read as an equity signal as well as a metric. A strong aggregate score alone does not license deploying a detector as a safety filter for Bengali generation.

Citation

BibTeX

@inproceedings{sushmit2027alikbachan,
  title     = {One Framework to Diagnose Them All: A Stratified
               Benchmark for {B}engali {LLM} Hallucination},
  author    = {Sushmit, Asif Shahriyar and Adib, Shefayat E Shams and
               Gem, Abdullah Al Jubaer and Ruhan, Ahmed Shafin and
               Ansary, MD. Nazmuddoha and Sarkar, Biplab Kumar and
               Raiyan, Syed Rifat and Abrar, Ajwad and Hasan, Abdullah Bin and
               Sakhawat, Adib and Hossain, M. Sakeef and Sani, Ahmed Alfey and
               Mizan, Arefin and Chakma, Sourab and Adib, Quazi Adibur Rahman and
               Haque, Wassie and Sen, Sanjay Kumar and Tahmid, Saad and
               Rashid, Mohammad Mamun Or},
  booktitle = {Findings of the Association for Computational Linguistics: EACL 2027},
  year      = {2027}
}

Acknowledgments

We thank the volunteers who annotated and audited Alikbachan for their care with every item, every team that took part in the competition, and the competition’s organizers and sponsor, without whom its submission history would not exist.