-
Notifications
You must be signed in to change notification settings - Fork 743
Pull requests: open-compass/VLMEvalKit
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[Fix] add missing case for answer regex in spatial457
#1620
opened Aug 4, 2026 by
JackLangerman
Loading…
[Model] Support VisionPsy-Nano-460M / -Flash (hub-packaged nanoVLM) with an optional in-process vLLM path
#1613
opened Jul 29, 2026 by
cdpark92
Loading…
[Fix] Strip use_vllm/use_verifier eval flags from judge kwargs (OpenAI 400)
#1611
opened Jul 28, 2026 by
cdpark92
Loading…
[Bugfix] Preserve valid HTML attributes in CCOCR table evaluation
#1609
opened Jul 28, 2026 by
Sun-Jiatuhao
Loading…
[Feature] Add support for audio modality and MMSU benchmark support
#1608
opened Jul 24, 2026 by
TianhaoLiang2000
Collaborator
Loading…
[Benchmark] Add support for MultihopSpatial benchmark
#1605
opened Jul 21, 2026 by
youngwanLEE
Loading…
3 tasks done
[Feature] Opt-in LLM-judge rescoring for string-metric VQA benchmarks (ChartQA/DocVQA/InfoVQA/TextVQA/OCRBench)
#1602
opened Jul 16, 2026 by
cdpark92
Loading…
[Fix] MM-IFEval: import rule-based verify functions into module globals
#1601
opened Jul 16, 2026 by
cdpark92
Loading…
[Dataset] Add BenchCAD (CAD code-understanding VQA)
#1583
opened Jun 25, 2026 by
HaozheZhang6
Loading…
[Benchmark] Add support for OmniDocBench v1.6 benchmark
#1572
opened Jun 10, 2026 by
Helen1p
Loading…
[Feature] Support DiffSpot (fine-grained visual change detection on web UIs)
#1568
opened Jun 4, 2026 by
banyinjushi
Loading…
3 tasks done
[Feature] Add Rebellions (RBLN) NPU evaluation backend
#1566
opened Jun 2, 2026 by
rebel-hwkim
Loading…
[Benchmark] Add support for MaRVL, xGQA and ALM-Bench
#1564
opened Jun 1, 2026 by
inakiLakunza
Contributor
Loading…
Previous Next
ProTip!
Type g p on any issue or pull request to go back to the pull request listing page.