Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
PGCodeLLM
LiveCodeBenchFork
Repository navigation
Code
Pull requests
1
(1)
Actions
Projects
Security and quality
Insights
More
items
Commits
Branch selector
main
User selector
All users
Datepicker
All time
Commit history
Commits on Mar 19, 2026
Merge pull request #21 from PGCodeLLM/fix/logger
Show description for 9d23024
cizezsy
authored
9d23024
View commit details
Copy full SHA for 9d23024
Browse repository at this point
Update lcb_runner/evaluation/testing_util.py
Show description for e7ce463
dogeggz
and
gemini-code-assist[bot]
authored
e7ce463
View commit details
Copy full SHA for e7ce463
Browse repository at this point
fix(logger):: revert some debug logs and comment keyword
dogeggz
committed
e589f71
View commit details
Copy full SHA for e589f71
Browse repository at this point
Commits on Mar 18, 2026
fix(logger): move logger prompts & results to debug and tqdm to std err
dogeggz
committed
dc9c7ff
View commit details
Copy full SHA for dc9c7ff
Browse repository at this point
fix(logger): trunacate large strings
dogeggz
committed
b013ec1
View commit details
Copy full SHA for b013ec1
Browse repository at this point
feat(logger): replace pritns with logger
dogeggz
committed
31d729e
View commit details
Copy full SHA for 31d729e
Browse repository at this point
Commits on Dec 3, 2025
Fix failed tasks empty list of string insertion (#19)
Show description for 50047b6
radinshayanfar
authored
50047b6
View commit details
Copy full SHA for 50047b6
Browse repository at this point
Commits on Dec 1, 2025
Merge pull request #18 from PGCodeLLM/feat/result-with-reasoning
Show description for 997290d
cizezsy
authored
997290d
View commit details
Copy full SHA for 997290d
Browse repository at this point
fix: remove dir check and add lock
dogeggz
committed
05d4d1d
View commit details
Copy full SHA for 05d4d1d
Browse repository at this point
Merge pull request #17 from PGCodeLLM/fix/unmatched_test_cases
golivax
authored
1867105
View commit details
Copy full SHA for 1867105
Browse repository at this point
Fix: test cases shown in result files does not belong to the task
Shenyu Zheng
committed
9037bda
View commit details
Copy full SHA for 9037bda
Browse repository at this point
fix: better error handling
dogeggz
committed
332735b
View commit details
Copy full SHA for 332735b
Browse repository at this point
feat: add reasoning content to detailed result file
dogeggz
committed
929e6b6
View commit details
Copy full SHA for 929e6b6
Browse repository at this point
Merge pull request #16 from PGCodeLLM/better_stream_code
Show description for c3a7ca4
golivax
authored
c3a7ca4
View commit details
Copy full SHA for c3a7ca4
Browse repository at this point
Using standard code for streaming. Print reasoning content to logs (hack)
Gustavo Oliva
committed
91e366d
View commit details
Copy full SHA for 91e366d
Browse repository at this point
Merge pull request #15 from PGCodeLLM/better_progress_tracking
Show description for dc01bb6
golivax
authored
dc01bb6
View commit details
Copy full SHA for dc01bb6
Browse repository at this point
Code cleanup
Gustavo Oliva
committed
aade9bf
View commit details
Copy full SHA for aade9bf
Browse repository at this point
Update progress bar as soon as tasks are completed
Gustavo Oliva
committed
8d56be4
View commit details
Copy full SHA for 8d56be4
Browse repository at this point
Commits on Nov 25, 2025
Add the category and tag to problem mapping data
haoxianghz
committed
ef37ff4
View commit details
Copy full SHA for ef37ff4
Browse repository at this point
Commits on Nov 24, 2025
Merge pull request #12 from PGCodeLLM/feat/show-all-test-cases
Show description for 78aac3f
golivax
authored
78aac3f
View commit details
Copy full SHA for 78aac3f
Browse repository at this point
fix: make sure new metdata wont break self_repair
dogeggz
committed
cefc359
View commit details
Copy full SHA for cefc359
Browse repository at this point
feat: show -4 for all test cases if it's syntax error
dogeggz
committed
f5c042c
View commit details
Copy full SHA for f5c042c
Browse repository at this point
Commits on Nov 19, 2025
feat: show al ltest cases pass status
dogeggz
committed
8456d61
View commit details
Copy full SHA for 8456d61
Browse repository at this point
Commits on Nov 6, 2025
Merge pull request #10 from PGCodeLLM/feat/support-absolute-output-dir
Show description for 5626049
golivax
authored
5626049
View commit details
Copy full SHA for 5626049
Browse repository at this point
Merge pull request #11 from PGCodeLLM/fix/max-tokens
Show description for 84fe169
golivax
authored
84fe169
View commit details
Copy full SHA for 84fe169
Browse repository at this point
Fix: max tokens is set to null when it is not provided by user
cizezsy
committed
b3835e5
View commit details
Copy full SHA for b3835e5
Browse repository at this point
Commits on Nov 4, 2025
Feat: allow to use absolute output dir
cizezsy
committed
915af3e
View commit details
Copy full SHA for 915af3e
Browse repository at this point
Commits on Oct 14, 2025
Merge pull request #9 from PGCodeLLM/add_test_results
Show description for e5e56a0
golivax
authored
e5e56a0
View commit details
Copy full SHA for e5e56a0
Browse repository at this point
Capture test results
Gustavo Oliva
committed
0dbe677
View commit details
Copy full SHA for 0dbe677
Browse repository at this point
Commits on Oct 7, 2025
Merge pull request #7 from PGCodeLLM/feat/support-stream
Show description for 83efcd2
golivax
authored
83efcd2
View commit details
Copy full SHA for 83efcd2
Browse repository at this point
Commits on Oct 6, 2025
feat: add log to show streaming
dogeggz
committed
3a1721b
View commit details
Copy full SHA for 3a1721b
Browse repository at this point
fix: return ChatCompletion
dogeggz
committed
505cee7
View commit details
Copy full SHA for 505cee7
Browse repository at this point
feat: support stream
dogeggz
committed
993adb7
View commit details
Copy full SHA for 993adb7
Browse repository at this point
Commits on Oct 3, 2025
Merge pull request #5 from PGCodeLLM/feat/extra-body-and-header
Show description for 1269070
golivax
authored
1269070
View commit details
Copy full SHA for 1269070
Browse repository at this point
Feat: add 'extra_body' and 'extra_headers' options to support more args
cizezsy
authored and
dogeggz
committed
2a537ed
View commit details
Copy full SHA for 2a537ed
Browse repository at this point
Previous
Next
You can’t perform that action at this time.