Repository navigation

All pull requests

Labels (17)Milestones (1)New pull request

Open

(96)

Closed

(1,105)

fix(qwen2_vl): map GUI click coordinates back to the original image frame
#1818davidnichols-ops opened Nov 2, 2026
fix(mmlongbench-doc): actually strip unit suffixes in get_clean_string
#1816sarankumar1325 opened Oct 31, 2026
[Model] Add E.T. Chat, the model of the E.T. Bench paper
#1815aliasgerovs opened Oct 31, 2026Contributor
fix(dataset): download ChartCap from the raw TSV URL
#1814rudycelekli opened Oct 30, 2026Contributor
fix(judge): replace the retired gpt-4-turbo and o4-mini default judges
#1813pcbeingused333 opened Oct 29, 2026
[Fix] Preserve complete end times in OMTGBench interval parsing
#1809xlb3055 opened Oct 28, 2026
fix(mcq): stop scoring judge failures with a random option
#1802FazeelUsmani opened Oct 23, 2026
fix(unisvg): normalise the prediction when matching categories
#1801rudycelekli opened Oct 23, 2026Contributor
fix(phyx): take the concluding option letter in multiple-choice answers
#1800rudycelekli opened Oct 23, 2026Contributor
fix(anls): divide by the length of the strings the distance was measured on
#1799rudycelekli opened Oct 23, 2026Contributor
fix(mmmu): write the submission JSON for every PRED_FORMAT
#1798rudycelekli opened Oct 23, 2026Contributor
fix(olympiadbench): restore sympy_sub_pi so expression comparison runs
#1797rudycelekli opened Oct 23, 2026Contributor
fix(claude): send the configured temperature in the request payload
#1796rudycelekli opened Oct 23, 2026Contributor
fix(yorn): extract markdown-emphasised yes/no verdicts
#1795rudycelekli opened Oct 23, 2026Contributor
fix(verifier): read word-form judge replies instead of mis-scoring them
#1794rudycelekli opened Oct 23, 2026Contributor
fix(mcq): restore the missing commas in the answer-prefix strip lists
#1793rudycelekli opened Oct 23, 2026Contributor
fix(chartqapro): score Fact Checking and Multi Choice by exact match
#1792rudycelekli opened Oct 23, 2026Contributor
fix(gsm8k-v): extract numbers written with thousands separators
#1791rudycelekli opened Oct 23, 2026Contributor
fix(mathverse): report overall accuracy across problem versions
#1789David-Wu1119 opened Oct 23, 2026Contributor
1
fix(mme-reasoning): restore imports dropped by the star-import migration
#1788David-Wu1119 opened Oct 23, 2026Contributor
1
fix(vqa): restore the official period stripping in answer normalization
#1787David-Wu1119 opened Oct 23, 2026Contributor
1
[Fix] Keep missing and substring-only MCQ predictions unresolved
#1773rudycelekli opened Oct 16, 2026Contributor
[Benchmark] Add E.T. Bench for event-level time-sensitive video understanding
#1772aliasgerovs opened Oct 15, 2026Contributor
3
[Benchmark] Add QVHighlights moment retrieval and highlight detection
#1770aliasgerovs opened Oct 14, 2026Contributor
1
fix(images): normalize EXIF orientation before conversion
#1764rudycelekli opened Oct 13, 2026Contributor

Pull requests