Issues

• Proposal: standalone EvalPort adapter for tasks/results (Task/GradeResult → TestCase/ResultSet)

  pinchbench/skill#404 · Filter by author adhabnr-ux opened on Aug 29, 2026

• How to choose --timeout-multiplier for diffenrent models on the official leaderboard?

  pinchbench/skill#398 · Filter by author Maokui-He opened on Jun 17, 2026
  1

• Ask about the startup parameters for the test run of the official ranking list on the official website

  pinchbench/skill#397 · Filter by author jibuzixin opened on Jun 16, 2026
  1

• ask about project

  pinchbench/skill#395 · Filter by author TentenMarchhhh opened on Jun 13, 2026
  1

• Direct submission page fails to load for uploaded run

  pinchbench/skill#394 · Filter by author kxfan2002 opened on Jun 3, 2026
  1

• Request PINCHBENCH_OFFICIAL_KEY for Juncheng Intelligence Technology (PR #38)

  pinchbench/skill#392 · Filter by author liwiw opened on May 29, 2026

• How are the tasks categorized on the website

  pinchbench/skill#390 · Filter by author lidh15 opened on May 18, 2026
  1

• need clear and detail setup guide

  pinchbench/skill#386 · Filter by author ytwytw opened on May 13, 2026
  3

• Inconsistent results for qwen3.5-9b compared with official reported outputs

  pinchbench/skill#358 · Filter by author Starlight2004 opened on Apr 24, 2026
  4

• [BUG] OpenClaw CLI causes task instructions to be overwritten by "Continue where you left off" message

  pinchbench/skill#345 · Filter by author GruchyC opened on Apr 22, 2026
  3

• Cost of Using Claude as a Judge Model per Evaluation

  pinchbench/skill#342 · Filter by author AmberXu98 opened on Apr 21, 2026
  3

• Score variance of different runs

  pinchbench/skill#103 · Filter by author hanningzhang opened on Apr 4, 2026
  1

• reddit research skills

  pinchbench/skill#97 · Filter by author Ritik-bhaiya opened on Apr 3, 2026

• [Feature Request] 'Vibe' Benchmark

  pinchbench/skill#92 · Filter by author joshavant opened on Apr 2, 2026

• Why task_11 can test the ClawHub interaction?

  pinchbench/skill#80 · Filter by author Chaotic-chaos opened on Mar 26, 2026
  1

• LLM Judge Prompt Design

  pinchbench/skill#75 · Filter by author PlanckChang opened on Mar 25, 2026
  1

• benchmark: wait for transcript completion instead of assuming subprocess exit means task finished

  pinchbench/skill#65 · Filter by author jiaxin576 opened on Mar 18, 2026
  1

• Multi-domain benchmarking: AgentBench-Live covers 5 domains beyond coding

  pinchbench/skill#64 · Filter by author jackjin1997 opened on Mar 18, 2026
  1

• Leaderboard scoring bias: runs with fewer tasks rank higher than comprehensive runs

  pinchbench/skill#53 · Filter by author JoeProAI opened on Mar 15, 2026
  5

• Discussion: how should we handle different providers & hardware on the main results

  pinchbench/skill#47 · Filter by author olearycrew opened on Mar 11, 2026
  5

• Need clearer configuration

  pinchbench/skill#46 · Filter by author William-AIdev opened on Mar 11, 2026
  3

• [Feature Request] Add ability to see log of test when you click on a spcific model and skill.

  pinchbench/skill#43 · Filter by author ForceConstant opened on Mar 10, 2026
  1