Skip to content

Improve integration tests - #1019

Merged
aittalam merged 10 commits into
pledge-seccompfrom
improve_integration_tests
Jul 16, 2026
Merged

aittalam merged 10 commits into
pledge-seccompfrom
improve_integration_tests

Conversation

@aittalam

Copy link
Copy Markdown
Member

Description

This PR adds a few improvements to integration tests, and shares the list of tests we run on our new binaries before each release.

PR Type

  • 💅 Refactor

Checklist

  • I understand the code I am submitting.
  • I have run this code locally and verified the change.
  • New and existing tests pass locally, or I have explained why tests were not run.
  • Documentation was updated where necessary.
  • I have read and followed the contribution guidelines.
  • AI Usage:
    • No AI was used.
    • AI was used in an assistive capacity.

@aittalam
aittalam merged commit 32367b4 into pledge-seccomp Jul 16, 2026
1 check passed
@aittalam
aittalam deleted the improve_integration_tests branch July 16, 2026 16:14
aittalam added a commit that referenced this pull request Jul 16, 2026
* First attempt at pledge/SECCOMP
* Added _wait_ready to avoid polling a dead port
* Moved _wait_ready logic into LlamafileRunner.wait_for_server
* Harden pledge/SECCOMP sandbox: unveil confinement, thread coverage, testable policy
* Sandbox review round 2: complete/robust unveil, close CLI/chat thread gap
* sandbox: use benign world-readable canaries, not /etc/passwd
* sandbox: split pledge (default-on) from unveil (opt-in --confine-reads)
* test_help skips missing models tests if model is present
* Added bare_executable to pyproject.toml
* Improve integration tests (#1019)
* Brought run_integration_tests.sh into /tests
* Discard stdout/stderr when logfile is present
* Removed test_download_rejects_untrusted_cert
* Fixed HTTPS/SSL tests - now running once only
* Adding online SSL tests to run_integration_tests.sh
* Updated tests docs
* Addressed tool calling on Bonsai 4B
* Added --no-warmup to cpu servers to avoid 120s timeout
* Consolidated prompts, removed temp==0 test for gpt-oss
* Updated gemma-4-26B-A4B test to be GPU only
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant