Skip to content

fix: recover per-token ids and logprobs from content[] to stop RL KLD corruption #1887

fix: recover per-token ids and logprobs from content[] to stop RL KLD corruption

fix: recover per-token ids and logprobs from content[] to stop RL KLD corruption #1887

Status Failure
Total duration 3m 37s
Artifacts

ci.yml

on: pull_request
Lint & Type Check
1m 20s
Lint & Type Check
Batch Evaluation Tests
1m 7s
Batch Evaluation Tests
MCP End-to-End Tests
46s
MCP End-to-End Tests
Matrix: test-core
Fit to window
Zoom out
Zoom in

Annotations

22 errors and 17 warnings
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L36
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L32
Argument to class must be a base class (reportGeneralTypeIssues)
Lint & Type Check: eval_protocol/adapters/langfuse.py#L49
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Lint & Type Check: eval_protocol/adapters/fireworks_tracing.py#L139
Object of type "None" is not subscriptable (reportOptionalSubscript)
Lint & Type Check: eval_protocol/adapters/fireworks_tracing.py#L138
Object of type "None" is not subscriptable (reportOptionalSubscript)
Lint & Type Check: eval_protocol/adapters/fireworks_tracing.py#L126
Object of type "None" is not subscriptable (reportOptionalSubscript)
Lint & Type Check: eval_protocol/adapters/fireworks_tracing.py#L125
Object of type "None" is not subscriptable (reportOptionalSubscript)
Lint & Type Check: eval_protocol/adapters/fireworks_tracing.py#L123
Object of type "None" is not subscriptable (reportOptionalSubscript)
Lint & Type Check: eval_protocol/adapters/fireworks_tracing.py#L118
Object of type "None" is not subscriptable (reportOptionalSubscript)
Lint & Type Check: eval_protocol/adapters/fireworks_tracing.py#L117
Object of type "None" is not subscriptable (reportOptionalSubscript)
Core Tests (Python 3.11, Shard 3/4)
Process completed with exit code 1.
Core Tests (Python 3.10, Shard 1/4)
Process completed with exit code 1.
Core Tests (Python 3.11, Shard 4/4)
Process completed with exit code 1.
Core Tests (Python 3.12, Shard 3/4)
Process completed with exit code 1.
Core Tests (Python 3.10, Shard 4/4)
Process completed with exit code 1.
Core Tests (Python 3.10, Shard 3/4)
Process completed with exit code 1.
Core Tests (Python 3.11, Shard 1/4)
Process completed with exit code 1.
Core Tests (Python 3.12, Shard 4/4)
Process completed with exit code 1.
Core Tests (Python 3.12, Shard 1/4)
Process completed with exit code 1.
Core Tests (Python 3.11, Shard 2/4)
Process completed with exit code 1.
Core Tests (Python 3.10, Shard 2/4)
Process completed with exit code 1.
Core Tests (Python 3.12, Shard 2/4)
Process completed with exit code 1.
Lint & Type Check
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-python@v5, astral-sh/setup-uv@v6. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-python@v5, astral-sh/setup-uv@v6. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Batch Evaluation Tests
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-python@v5, astral-sh/setup-uv@v6. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Core Tests (Python 3.11, Shard 3/4)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-python@v5, astral-sh/setup-uv@v6. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Core Tests (Python 3.10, Shard 1/4)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-python@v5, astral-sh/setup-uv@v6. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Core Tests (Python 3.11, Shard 4/4)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-python@v5, astral-sh/setup-uv@v6. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Core Tests (Python 3.12, Shard 3/4)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-python@v5, astral-sh/setup-uv@v6. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Core Tests (Python 3.10, Shard 4/4)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-python@v5, astral-sh/setup-uv@v6. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Core Tests (Python 3.10, Shard 3/4)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-python@v5, astral-sh/setup-uv@v6. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Core Tests (Python 3.11, Shard 1/4)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-python@v5, astral-sh/setup-uv@v6. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Core Tests (Python 3.12, Shard 4/4)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-python@v5, astral-sh/setup-uv@v6. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Core Tests (Python 3.12, Shard 1/4)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-python@v5, astral-sh/setup-uv@v6. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Core Tests (Python 3.11, Shard 2/4)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-python@v5, astral-sh/setup-uv@v6. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Core Tests (Python 3.10, Shard 2/4)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-python@v5, astral-sh/setup-uv@v6. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Core Tests (Python 3.12, Shard 2/4)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-python@v5, astral-sh/setup-uv@v6. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/