Issues

• Inconsistency between the 'file_content' field and the acutal repository file content (e.g., task 62e60f37d76274f8a4026dfd)

  CoderEval/CoderEval#19 · Filter by author Espresso-Kp opened on Aug 30, 2025

• Mismatch between CoderEval4Python.json and provided repositories (e.g., run_command function)

  CoderEval/CoderEval#18 · Filter by author YusufEmreGenc opened on Aug 1, 2025
  1

• The docker is not available now

  CoderEval/CoderEval#17 · Filter by author Wwstarry opened on Jul 15, 2025

• About dataset properties

  CoderEval/CoderEval#16 · Filter by author TomasAndersonFang opened on Apr 10, 2025
  1

• CoderEval Evaluation

  CoderEval/CoderEval#15 · Filter by author ZimaBlue307 opened on Jan 22, 2025
  1

• The link (Google Drive) of Docker is unseen now.

  CoderEval/CoderEval#14 · Filter by author nnRoy opened on Dec 25, 2024
  1

• How to use CoderEval to evaluate other LLM's? / Enabling CoderEval to Evaluate Various LLMs Beyond Default Models

  CoderEval/CoderEval#13 · Filter by author jjosorioc opened on Nov 5, 2024
  1

• Some problems about test cases and fields

  CoderEval/CoderEval#12 · Filter by author baday19 opened on Jan 29, 2024
  1

• How to get python and java related project code?

  CoderEval/CoderEval#9 · Filter by author DongchenZhou opened on Dec 6, 2023
  1

• Does LLM know about other methods in the same class?

  CoderEval/CoderEval#8 · Filter by author yeren66 opened on Nov 30, 2023
  1

• Where to find the leaderboard?

  CoderEval/CoderEval#6 · Filter by author zhimin-z opened on Nov 16, 2023
  1

• "oracle_context" and "all_context" are meaningless in terms of evaluating

  CoderEval/CoderEval#1 · Filter by author felixhao28 opened on Feb 13, 2023
  1