Llama Stack uses GitHub Actions for Continuous Integration (CI). Below is a table detailing what CI the project includes and the purpose.
| Name | File | Purpose |
|---|---|---|
| Backward Compatibility Check | backward-compat.yml | Check backward compatibility for config.yaml files |
| Build Distribution Images | build-distributions.yml | Build Distribution Images |
| CI Status | ci-status.yml | Aggregate CI check status |
| CodeQL Workflow Security Scan | codeql.yml | CodeQL Workflow Security Scan |
| Commit Recordings | commit-recordings.yml | Commit Recordings |
| Documentation Build | docs-build.yml | Build and validate documentation |
| File Processors Tests | file-processors-tests.yml | Run file processors integration tests |
| Installer CI | install-script-ci.yml | Test the installation script |
| Integration Auth Tests | integration-auth-tests.yml | Run the integration test suite with Kubernetes authentication |
| Integration Responses & Conversations Auth Tests | integration-responses-conversations-auth-tests.yml | Run responses and conversations auth tests with Kubernetes authentication |
| SqlStore Integration Tests | integration-sql-store-tests.yml | Run the integration test suite with SqlStore |
| Integration Tests (Replay) | integration-tests.yml | Run the integration test suites from tests/integration in replay mode |
| Vector IO Integration Tests | integration-vector-io-tests.yml | Run the integration test suite with various VectorIO providers |
| OpenAPI Generator SDK Validation | openapi-generator-validation.yml | Validate OpenAPI Generator SDK generation |
| OpenResponses Conformance Tests | openresponses-conformance.yml | Run OpenResponses conformance tests against llama-stack Responses API |
| Post-release automation | post-release.yml | Post-release automation |
| Pre-commit | pre-commit.yml | Run pre-commit checks |
| Prepare release | prepare-release.yml | Prepare release |
| Test Llama Stack Build | providers-build.yml | Test llama stack build |
| Test llama stack list-deps | providers-list-deps.yml | Test llama stack list-deps |
| Build, test, and publish packages | pypi.yml | Build, test, and publish packages |
| Integration Tests (Record) | record-integration-tests.yml | Auto-record missing test recordings for PR |
| Release Branch Scheduled CI | release-branch-scheduled-ci.yml | Scheduled CI checks for active release branches |
| Check semantic PR titles | semantic-pr.yml | Ensure that PR titles follow the conventional commit spec |
| Stainless SDK Builds | stainless-builds.yml | Build Stainless SDK from OpenAPI spec changes |
| Close stale issues and PRs | stale_bot.yml | Run the Stale Bot action |
| Test External Providers Installed via Module | test-external-provider-module.yml | Test External Provider installation via Python module |
| Test External API and Providers | test-external.yml | Test the External API and Provider mechanisms |
| Trigger Docs Deploy | trigger-docs-deploy.yml | Trigger docs site rebuild after docs change |
| UI Tests | ui-unit-tests.yml | Run the UI test suite |
| Unit Tests | unit-tests.yml | Run the unit test suite |