Search results

📝 Integration Proposal: CAJAL — Scientific Paper Agent for BigCode

Status: Open.

#320 In bigcode-project/bigcode-evaluation-harness;

· Agnuxo1 opened on May 4, 2026

Wrong Hugging Face link for Spider dataset in bigcode-evaluation-harness/docs/README.md line 434

Status: Open.

#315 In bigcode-project/bigcode-evaluation-harness;

· 354246695 opened on Sep 9, 2025

Support configurability of FIM tokens on SantaCoder

Status: Open.

#313 In bigcode-project/bigcode-evaluation-harness;

· Jay-Roberts opened on Jul 10, 2025

testing Humaneval of qwen-2.5-7B-coder-instruct

Status: Open.

#308 In bigcode-project/bigcode-evaluation-harness;

· zxiangx opened on Mar 26, 2025

how to add new model?

Status: Open.

#307 In bigcode-project/bigcode-evaluation-harness;

· pengzhangzhi opened on Mar 26, 2025

When executing languages such as JS and GO in Multiple-E, the generated results suddenly end

Status: Open.

#306 In bigcode-project/bigcode-evaluation-harness;

· fxnie opened on Mar 25, 2025

Unable to execute the MultiPL-E task for C++

Status: Open.

#304 In bigcode-project/bigcode-evaluation-harness;

· JohnneyQin opened on Mar 11, 2025

Code-Llama-7B-Python 4 Bit Error on HumanEval

Status: Open.

#303 In bigcode-project/bigcode-evaluation-harness;

· wilyub opened on Feb 25, 2025

is there a benchmark page on the benchmark results evaluated using bigcode-evaluation-harness

Status: Open.

#300 In bigcode-project/bigcode-evaluation-harness;

· yxchng opened on Jan 21, 2025

Select device: GPU for model eval

Status: Open.

#297 In bigcode-project/bigcode-evaluation-harness;

· kn0wn-cyber opened on Dec 19, 2024

HumanEval-X generation appears to not time out called subproceses

Status: Open.

#290 In bigcode-project/bigcode-evaluation-harness;

· nielstron opened on Nov 24, 2024

Adding an assistant_model Argument for Speculative Decoding

Status: Open.

#288 In bigcode-project/bigcode-evaluation-harness;

· ilyasoulk opened on Nov 23, 2024