diff --git a/2026/10/2026-10-08-labelbox.md b/2026/10/2026-10-08-labelbox.md new file mode 100644 index 0000000000..bb62950360 --- /dev/null +++ b/2026/10/2026-10-08-labelbox.md @@ -0,0 +1,995 @@ +Before disabling any content in relation to this takedown notice, GitHub +- contacted the owners of some or all of the affected repositories to give them an opportunity to [make changes](https://docs.github.com/en/github/site-policy/dmca-takedown-policy#a-how-does-this-actually-work). +- provided information on how to [submit a DMCA Counter Notice](https://docs.github.com/en/articles/guide-to-submitting-a-dmca-counter-notice). + +To learn about when and why GitHub may process some notices this way, please visit our [README](https://github.com/github/dmca/blob/master/README.md#anatomy-of-a-takedown-notice). + +--- + +**Are you the copyright holder or authorized to act on the copyright owner's behalf? If you are submitting this notice on behalf of a company, please be sure to use an email address on the company's domain. If you use a personal email address for a notice submitted on behalf of a company, we may not be able to process it.** + +Yes, I am authorized to act on the copyright owner's behalf. + +**Are you submitting a revised DMCA notice after GitHub Trust & Safety requested you make changes to your original notice?** + +No + +**Does your claim involve content on GitHub or npm.js?** + +GitHub + +**Please describe the nature of your copyright ownership or authorization to act on the owner's behalf.** + +I am [private], an employee of Labelbox, Inc., the copyright owner of the original work described below. I am authorized to act on behalf of Labelbox, Inc. in all matters regarding copyright enforcement. I have read and understand GitHub's Guide to Filing a DMCA Notice. + +**Please provide a detailed description of the original copyrighted work that has allegedly been infringed.** + +Original work is a proprietary agent harness and starting point for submitting RL training data on our platform. It includes the supporting harness code, agent-first tooling, skills to improve the user and agent experience, and prompts used for task CI and prompt engineering cycles. + +There are individual codebase templates, detailed project instructions with submission requirements, and finished examples for each family of projects and each domain. + +Included also is our Alignerr plugin which wraps most templates and integrates into our frontend to improve UX through task automation. + +Lastly, there is also a rubric runtime and associated test service for preapproving tasks for submission which includes e2e troubleshooting steps and assistive code. + +**If the original work referenced above is available online, please provide a URL.** + +https://github.com/Alignerr-Code-Labeling/lbx-internal-rl-tasks-iso-template + +**We ask that a DMCA takedown notice list every specific file in the repository that is infringing, unless the entire contents of the repository are infringing on your copyright. Please clearly state that the entire repository is infringing, OR provide the specific files within the repository you would like removed.** + +**Based on the above, I confirm that:** + +Specific files within the repository are infringing + +**Identify only the specific file URLs within the repository that is infringing:** + +Base: https://github.com/charles-rl/supreme-octo-fiesta/blob/e35b6e0c1cddf83ae7bd1e8a75f065b21e87da97/ + +.claude/skills/alignerr-task-authoring/SKILL.md +.claude/skills/boreal-rollout-failure-analysis/SKILL.md +.claude/skills/boreal-rollout-failure-analysis/evals/evals.json +.claude/skills/boreal-rollout-failure-analysis/references/cfd-levers.md +.claude/skills/boreal-rollout-failure-analysis/references/structures-levers.md +.claude/skills/boreal-rollout-failure-analysis/scripts/prepare_inputs.py +.claude/skills/boreal-rollout-failure-analysis/scripts/validate_report.py +.claude/skills/deterministic-grading/SKILL.md +.claude/skills/ground-truth-oracle/SKILL.md +.claude/skills/hidden-env-tasks/SKILL.md +.claude/skills/ml-tasks/SKILL.md +.claude/skills/mujoco-tasks/SKILL.md +.claude/skills/numerical-solver-tasks/SKILL.md +.claude/skills/prometheus-cfd-adversarial-review/SKILL.md +.claude/skills/prometheus-cfd-adversarial-review/scripts/adversarial_review_measure.py +.claude/skills/prometheus-cfd-adversarial-review/scripts/adversarial_review_probes/cfd.json +.claude/skills/prometheus-cfd-adversarial-review/scripts/adversarial_review_registry.py +.claude/skills/prometheus-cfd-adversarial-review/scripts/adversarial_review_runtime.py +.claude/skills/prometheus-cfd-adversarial-review/scripts/run.sh +.claude/skills/prometheus-cfd-adversarial-review/scripts/validate_adversarial_review.py +.claude/skills/prometheus-delivery/SKILL.md +.claude/skills/prometheus-structures-adversarial-review/SKILL.md +.claude/skills/prometheus-structures-adversarial-review/scripts/adversarial_review_measure.py +.claude/skills/prometheus-structures-adversarial-review/scripts/adversarial_review_probes/structures.json +.claude/skills/prometheus-structures-adversarial-review/scripts/adversarial_review_registry.py +.claude/skills/prometheus-structures-adversarial-review/scripts/adversarial_review_runtime.py +.claude/skills/prometheus-structures-adversarial-review/scripts/run.sh +.claude/skills/prometheus-structures-adversarial-review/scripts/validate_adversarial_review.py +.claude/skills/reward-hacking-security/SKILL.md +.claude/skills/rubric-design/SKILL.md +.claude/skills/service-capsule-tasks/SKILL.md +.claude/skills/shared-code-architecture/SKILL.md +.claude/skills/software-engineering-tasks/SKILL.md +.claude/skills/task-author-changelog/SKILL.md +.claude/skills/task-code-quality/SKILL.md +.claude/skills/task-migration/SKILL.md +.claude/skills/task-migration/TASK_MIGRATION.md +.cursor/rules/continuous-scoring-tasks.mdc +.cursor/rules/deterministic-rubrics.mdc +.cursor/rules/github-secrets.mdc +.cursor/rules/grader-contract.mdc +.cursor/rules/ground-truth-oracle.mdc +.cursor/rules/hidden-env.mdc +.cursor/rules/local-harness.mdc +.cursor/rules/mujoco-tasks.mdc +.cursor/rules/numerical-solvers.mdc +.cursor/rules/prometheus-delivery.mdc +.cursor/rules/prompt-fairness.mdc +.cursor/rules/reward-hacking.mdc +.cursor/rules/shared-code-architecture.mdc +.cursor/rules/shared-grader-changelog.mdc +.cursor/rules/software-engineering-tasks.mdc +.cursor/rules/task-authoring.mdc +.cursor/rules/task-code-quality.mdc +.cursor/rules/task-delivery-gates.mdc +.cursor/rules/task-dependencies.mdc +.cursor/rules/template-owned-shared-code.mdc +.cursor/skills/alignerr-task-authoring/SKILL.md +.cursor/skills/boreal-rollout-failure-analysis/SKILL.md +.cursor/skills/boreal-rollout-failure-analysis/evals/evals.json +.cursor/skills/boreal-rollout-failure-analysis/references/cfd-levers.md +.cursor/skills/boreal-rollout-failure-analysis/references/structures-levers.md +.cursor/skills/boreal-rollout-failure-analysis/scripts/prepare_inputs.py +.cursor/skills/boreal-rollout-failure-analysis/scripts/validate_report.py +.cursor/skills/deterministic-grading/SKILL.md +.cursor/skills/ground-truth-oracle/SKILL.md +.cursor/skills/hidden-env-tasks/SKILL.md +.cursor/skills/ml-tasks/SKILL.md +.cursor/skills/mujoco-tasks/SKILL.md +.cursor/skills/numerical-solver-tasks/SKILL.md +.cursor/skills/prometheus-cfd-adversarial-review/SKILL.md +.cursor/skills/prometheus-cfd-adversarial-review/scripts/adversarial_review_measure.py +.cursor/skills/prometheus-cfd-adversarial-review/scripts/adversarial_review_probes/cfd.json +.cursor/skills/prometheus-cfd-adversarial-review/scripts/adversarial_review_registry.py +.cursor/skills/prometheus-cfd-adversarial-review/scripts/adversarial_review_runtime.py +.cursor/skills/prometheus-cfd-adversarial-review/scripts/run.sh +.cursor/skills/prometheus-cfd-adversarial-review/scripts/validate_adversarial_review.py +.cursor/skills/prometheus-delivery/SKILL.md +.cursor/skills/prometheus-structures-adversarial-review/SKILL.md +.cursor/skills/prometheus-structures-adversarial-review/scripts/adversarial_review_measure.py +.cursor/skills/prometheus-structures-adversarial-review/scripts/adversarial_review_probes/structures.json +.cursor/skills/prometheus-structures-adversarial-review/scripts/adversarial_review_registry.py +.cursor/skills/prometheus-structures-adversarial-review/scripts/adversarial_review_runtime.py +.cursor/skills/prometheus-structures-adversarial-review/scripts/run.sh +.cursor/skills/prometheus-structures-adversarial-review/scripts/validate_adversarial_review.py +.cursor/skills/reward-hacking-security/SKILL.md +.cursor/skills/rubric-design/SKILL.md +.cursor/skills/service-capsule-tasks/SKILL.md +.cursor/skills/shared-code-architecture/SKILL.md +.cursor/skills/software-engineering-tasks/SKILL.md +.cursor/skills/task-author-changelog/SKILL.md +.cursor/skills/task-code-quality/SKILL.md +.cursor/skills/task-migration/SKILL.md +.dockerignore +.env.example +.gitattributes +.github/CODEOWNERS +.github/PULL_REQUEST_TEMPLATE.md +.github/PULL_REQUEST_TEMPLATE/task.md +.github/scripts/check_workflow_boundary.py +.github/workflows/nightly.yml +.github/workflows/python-ci.yml +.gitignore +AGENTS.md +CLAUDE.md +README.md +alignerr_plugin/pyproject.toml +alignerr_plugin/src/alignerr_plugin/__init__.py +alignerr_plugin/src/alignerr_plugin/_capability_types.py +alignerr_plugin/src/alignerr_plugin/_projection.py +alignerr_plugin/src/alignerr_plugin/_schemas_base.py +alignerr_plugin/src/alignerr_plugin/_schemas_grading.py +alignerr_plugin/src/alignerr_plugin/_schemas_services.py +alignerr_plugin/src/alignerr_plugin/base_image.py +alignerr_plugin/src/alignerr_plugin/capabilities.py +alignerr_plugin/src/alignerr_plugin/capsule.py +alignerr_plugin/src/alignerr_plugin/commands.py +alignerr_plugin/src/alignerr_plugin/commit_identity.py +alignerr_plugin/src/alignerr_plugin/delivery.py +alignerr_plugin/src/alignerr_plugin/exporters/__init__.py +alignerr_plugin/src/alignerr_plugin/exporters/_qa_surface.py +alignerr_plugin/src/alignerr_plugin/exporters/_taiga_capabilities.py +alignerr_plugin/src/alignerr_plugin/exporters/_taiga_evidence.py +alignerr_plugin/src/alignerr_plugin/exporters/harbor.py +alignerr_plugin/src/alignerr_plugin/exporters/harbor_public_copy.py +alignerr_plugin/src/alignerr_plugin/exporters/taiga.py +alignerr_plugin/src/alignerr_plugin/ground_truth.py +alignerr_plugin/src/alignerr_plugin/local_cli.py +alignerr_plugin/src/alignerr_plugin/local_runtime.py +alignerr_plugin/src/alignerr_plugin/materialization.py +alignerr_plugin/src/alignerr_plugin/migrations/__init__.py +alignerr_plugin/src/alignerr_plugin/migrations/mujoco.py +alignerr_plugin/src/alignerr_plugin/ml_model_contract.py +alignerr_plugin/src/alignerr_plugin/preloaded.py +alignerr_plugin/src/alignerr_plugin/prometheus_hints.py +alignerr_plugin/src/alignerr_plugin/proof.py +alignerr_plugin/src/alignerr_plugin/result_handler.py +alignerr_plugin/src/alignerr_plugin/runtime_notices.py +alignerr_plugin/src/alignerr_plugin/schemas.py +alignerr_plugin/src/alignerr_plugin/solver_availability.py +alignerr_plugin/src/alignerr_plugin/solver_hints.py +alignerr_plugin/src/alignerr_plugin/starter_templates/cfd/README.md +alignerr_plugin/src/alignerr_plugin/starter_templates/cfd/baselines/naive.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/cfd/data/.gitkeep +alignerr_plugin/src/alignerr_plugin/starter_templates/cfd/environment/Dockerfile +alignerr_plugin/src/alignerr_plugin/starter_templates/cfd/environment/requirements.txt +alignerr_plugin/src/alignerr_plugin/starter_templates/cfd/instruction.md +alignerr_plugin/src/alignerr_plugin/starter_templates/cfd/metadata.json +alignerr_plugin/src/alignerr_plugin/starter_templates/cfd/scorer/__init__.py +alignerr_plugin/src/alignerr_plugin/starter_templates/cfd/scorer/compute_score.py +alignerr_plugin/src/alignerr_plugin/starter_templates/cfd/scorer/data/.gitkeep +alignerr_plugin/src/alignerr_plugin/starter_templates/cfd/scorer/evaluation.plan.json +alignerr_plugin/src/alignerr_plugin/starter_templates/cfd/solution/render.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/cfd/solution/solve.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/cfd/task.toml +alignerr_plugin/src/alignerr_plugin/starter_templates/cfd/tests/test.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/ml/README.md +alignerr_plugin/src/alignerr_plugin/starter_templates/ml/baselines/naive/solution.py +alignerr_plugin/src/alignerr_plugin/starter_templates/ml/baselines/naive/train.py +alignerr_plugin/src/alignerr_plugin/starter_templates/ml/data/.gitkeep +alignerr_plugin/src/alignerr_plugin/starter_templates/ml/data_generation/.gitkeep +alignerr_plugin/src/alignerr_plugin/starter_templates/ml/environment/Dockerfile +alignerr_plugin/src/alignerr_plugin/starter_templates/ml/instruction.md +alignerr_plugin/src/alignerr_plugin/starter_templates/ml/metadata.json +alignerr_plugin/src/alignerr_plugin/starter_templates/ml/scorer/compute_score.py +alignerr_plugin/src/alignerr_plugin/starter_templates/ml/scorer/data/.gitkeep +alignerr_plugin/src/alignerr_plugin/starter_templates/ml/solution/solution.py +alignerr_plugin/src/alignerr_plugin/starter_templates/ml/solution/solve.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/ml/solution/train.py +alignerr_plugin/src/alignerr_plugin/starter_templates/ml/task.toml +alignerr_plugin/src/alignerr_plugin/starter_templates/mujoco/README.md +alignerr_plugin/src/alignerr_plugin/starter_templates/mujoco/baselines/naive.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/mujoco/data/.gitkeep +alignerr_plugin/src/alignerr_plugin/starter_templates/mujoco/environment/Dockerfile +alignerr_plugin/src/alignerr_plugin/starter_templates/mujoco/environment/requirements.txt +alignerr_plugin/src/alignerr_plugin/starter_templates/mujoco/instruction.md +alignerr_plugin/src/alignerr_plugin/starter_templates/mujoco/metadata.json +alignerr_plugin/src/alignerr_plugin/starter_templates/mujoco/scorer/__init__.py +alignerr_plugin/src/alignerr_plugin/starter_templates/mujoco/scorer/compute_score.py +alignerr_plugin/src/alignerr_plugin/starter_templates/mujoco/scorer/data/.gitkeep +alignerr_plugin/src/alignerr_plugin/starter_templates/mujoco/scorer/evaluation.plan.json +alignerr_plugin/src/alignerr_plugin/starter_templates/mujoco/solution/render.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/mujoco/solution/solve.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/mujoco/task.toml +alignerr_plugin/src/alignerr_plugin/starter_templates/mujoco/tests/test.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-cfd/README.md +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-cfd/baselines/naive.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-cfd/data/.gitkeep +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-cfd/environment/Dockerfile +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-cfd/environment/requirements.txt +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-cfd/instruction.md +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-cfd/metadata.json +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-cfd/scorer/__init__.py +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-cfd/scorer/compute_score.py +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-cfd/scorer/evaluation.plan.json +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-cfd/solution/render.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-cfd/solution/solve.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-cfd/task.toml +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-cfd/tests/test.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-cfd/README.md +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-cfd/baselines/naive.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-cfd/environment/Dockerfile +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-cfd/environment/requirements.txt +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-cfd/instruction.md +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-cfd/metadata.json +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-cfd/scorer/__init__.py +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-cfd/scorer/compute_score.py +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-cfd/scorer/evaluation.plan.json +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-cfd/solution/render.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-cfd/solution/solve.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-cfd/task.toml +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-cfd/tests/test.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-structures/README.md +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-structures/baselines/naive.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-structures/environment/Dockerfile +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-structures/environment/requirements.txt +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-structures/instruction.md +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-structures/metadata.json +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-structures/scorer/__init__.py +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-structures/scorer/compute_score.py +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-structures/scorer/evaluation.plan.json +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-structures/solution/render.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-structures/solution/solve.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-structures/task.toml +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-eval-structures/tests/test.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-structures/README.md +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-structures/baselines/naive.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-structures/environment/Dockerfile +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-structures/environment/requirements.txt +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-structures/instruction.md +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-structures/metadata.json +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-structures/scorer/__init__.py +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-structures/scorer/compute_score.py +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-structures/scorer/evaluation.plan.json +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-structures/solution/render.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-structures/solution/solve.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-structures/task.toml +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus-structures/tests/test.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus/README.md +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus/baselines/naive.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus/environment/Dockerfile +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus/environment/requirements.txt +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus/instruction.md +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus/metadata.json +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus/scorer/__init__.py +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus/scorer/compute_score.py +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus/solution/render.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus/solution/solve.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus/task.toml +alignerr_plugin/src/alignerr_plugin/starter_templates/prometheus/tests/test.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/software-engineering/README.md +alignerr_plugin/src/alignerr_plugin/starter_templates/software-engineering/baselines/noop.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/software-engineering/environment/Dockerfile +alignerr_plugin/src/alignerr_plugin/starter_templates/software-engineering/instruction.md +alignerr_plugin/src/alignerr_plugin/starter_templates/software-engineering/metadata.json +alignerr_plugin/src/alignerr_plugin/starter_templates/software-engineering/scorer/compute_score.py +alignerr_plugin/src/alignerr_plugin/starter_templates/software-engineering/scorer/data/candidate_driver.py +alignerr_plugin/src/alignerr_plugin/starter_templates/software-engineering/scorer/data/hidden_cases.json +alignerr_plugin/src/alignerr_plugin/starter_templates/software-engineering/scorer/evaluation.plan.json +alignerr_plugin/src/alignerr_plugin/starter_templates/software-engineering/solution/files/normalizer.py +alignerr_plugin/src/alignerr_plugin/starter_templates/software-engineering/solution/solve.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/software-engineering/starter/README.md +alignerr_plugin/src/alignerr_plugin/starter_templates/software-engineering/starter/normalizer.py +alignerr_plugin/src/alignerr_plugin/starter_templates/software-engineering/starter/tests/test_normalizer.py +alignerr_plugin/src/alignerr_plugin/starter_templates/software-engineering/task.toml +alignerr_plugin/src/alignerr_plugin/starter_templates/software-engineering/tests/test.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/structures/README.md +alignerr_plugin/src/alignerr_plugin/starter_templates/structures/baselines/naive.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/structures/environment/Dockerfile +alignerr_plugin/src/alignerr_plugin/starter_templates/structures/environment/requirements.txt +alignerr_plugin/src/alignerr_plugin/starter_templates/structures/instruction.md +alignerr_plugin/src/alignerr_plugin/starter_templates/structures/metadata.json +alignerr_plugin/src/alignerr_plugin/starter_templates/structures/scorer/__init__.py +alignerr_plugin/src/alignerr_plugin/starter_templates/structures/scorer/compute_score.py +alignerr_plugin/src/alignerr_plugin/starter_templates/structures/scorer/evaluation.plan.json +alignerr_plugin/src/alignerr_plugin/starter_templates/structures/solution/render.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/structures/solution/solve.sh +alignerr_plugin/src/alignerr_plugin/starter_templates/structures/task.toml +alignerr_plugin/src/alignerr_plugin/starter_templates/structures/tests/test.sh +alignerr_plugin/src/alignerr_plugin/taiga_resources.py +alignerr_plugin/src/alignerr_plugin/task_metadata.py +alignerr_plugin/src/alignerr_plugin/utils.py +alignerr_plugin/src/alignerr_plugin/validators/__init__.py +alignerr_plugin/src/alignerr_plugin/validators/task/__init__.py +alignerr_plugin/src/alignerr_plugin/validators/task/_artifact_clean_paths.py +alignerr_plugin/src/alignerr_plugin/validators/task/_ast_utils.py +alignerr_plugin/src/alignerr_plugin/validators/task/_baselines.py +alignerr_plugin/src/alignerr_plugin/validators/task/_constants.py +alignerr_plugin/src/alignerr_plugin/validators/task/_dependencies.py +alignerr_plugin/src/alignerr_plugin/validators/task/_dockerfile.py +alignerr_plugin/src/alignerr_plugin/validators/task/_grader_sandbox.py +alignerr_plugin/src/alignerr_plugin/validators/task/_grader_static.py +alignerr_plugin/src/alignerr_plugin/validators/task/_ground_truth.py +alignerr_plugin/src/alignerr_plugin/validators/task/_private_layout.py +alignerr_plugin/src/alignerr_plugin/validators/task/_prompt_quality.py +alignerr_plugin/src/alignerr_plugin/validators/task/_software_contract.py +alignerr_plugin/src/alignerr_plugin/validators/task/_stages_build.py +alignerr_plugin/src/alignerr_plugin/validators/task/_stages_continuous.py +alignerr_plugin/src/alignerr_plugin/validators/task/_stages_evaluation.py +alignerr_plugin/src/alignerr_plugin/validators/task/_stages_hidden_env.py +alignerr_plugin/src/alignerr_plugin/validators/task/_stages_rubric.py +alignerr_plugin/src/alignerr_plugin/validators/task/creator.py +alignerr_plugin/src/alignerr_plugin/validators/task/image_deps.py +alignerr_plugin/src/alignerr_plugin/validators/task/validator.py +base/build_and_push.sh +base/clear_execstack.py +base/cpu/Dockerfile +base/cuda-graphics/Dockerfile +base/gpu-blackwell/Dockerfile +base/gpu-openroad/Dockerfile +base/gpu/Dockerfile +base/install-common.sh +base/install-solvers-heavy.sh +base/install-task-deps.sh +base/requirements-common.txt +base/requirements-cpu.txt +base/requirements-cuda-graphics.txt +base/requirements-gpu.txt +base/requirements-runtime.txt +base/requirements-solvers.txt +base/requirements-tpu.txt +base/tests/test_solvers.py +base/tpu/Dockerfile +docs/ARCHITECTURE.md +docs/AUTHORING.md +docs/CHANGELOG.md +docs/CONTINUOUS_EVALUATION.md +docs/DIAGNOSING.md +docs/FRONTIERBENCH_CAPABILITIES.md +docs/GRADING.md +docs/GROUND_TRUTH.md +docs/HIDDEN_ENV.md +docs/LEGACY_ML_LAYOUT.md +docs/ML_TASKS.md +docs/POLICY_ISOLATION.md +docs/QA_TRIAGE_2026-07-24.md +docs/REWARD_HACKING.md +docs/RUBRIC_EVALUATION.md +docs/RUBRIC_GUIDANCE.md +docs/SOFTWARE_ENGINEERING_FRAMEWORK.md +docs/SOFTWARE_TRANSFORMATION_TASKS.md +docs/TASK_MIGRATION.md +docs/THREAT_MODEL.md +docs/frontierbench_capabilities.json +examples/README.md +examples/frontier-mcp-workspace/README.md +examples/frontier-mcp-workspace/baselines/noop.sh +examples/frontier-mcp-workspace/environment/Dockerfile +examples/frontier-mcp-workspace/environment/main/Dockerfile +examples/frontier-mcp-workspace/environment/mcp/Dockerfile +examples/frontier-mcp-workspace/environment/mcp/server.py +examples/frontier-mcp-workspace/environment/verifier/Dockerfile +examples/frontier-mcp-workspace/environment/verifier/verify.py +examples/frontier-mcp-workspace/environment/workspace/Dockerfile +examples/frontier-mcp-workspace/environment/workspace/server.py +examples/frontier-mcp-workspace/instruction.md +examples/frontier-mcp-workspace/metadata.json +examples/frontier-mcp-workspace/scorer/compute_score.py +examples/frontier-mcp-workspace/scorer/data/claim_cases.json +examples/frontier-mcp-workspace/scorer/evaluation.plan.json +examples/frontier-mcp-workspace/solution/files/processor.py +examples/frontier-mcp-workspace/solution/solve.sh +examples/frontier-mcp-workspace/starter/repo/processor.py +examples/frontier-mcp-workspace/task.toml +examples/frontier-mcp-workspace/tests/introspection_cheat.py +examples/frontier-mcp-workspace/tests/test.sh +examples/frontier-mcp-workspace/tests/test_frontier_mcp_workspace.py +examples/frontier-service-cutover/README.md +examples/frontier-service-cutover/baselines/noop.sh +examples/frontier-service-cutover/environment/Dockerfile +examples/frontier-service-cutover/environment/customer/Dockerfile +examples/frontier-service-cutover/environment/customer/server.py +examples/frontier-service-cutover/environment/init/Dockerfile +examples/frontier-service-cutover/environment/init/initialize.py +examples/frontier-service-cutover/environment/main/Dockerfile +examples/frontier-service-cutover/environment/state/Dockerfile +examples/frontier-service-cutover/environment/state/server.py +examples/frontier-service-cutover/environment/verifier/Dockerfile +examples/frontier-service-cutover/environment/verifier/verify.py +examples/frontier-service-cutover/instruction.md +examples/frontier-service-cutover/metadata.json +examples/frontier-service-cutover/scorer/compute_score.py +examples/frontier-service-cutover/scorer/data/cutover_cases.json +examples/frontier-service-cutover/scorer/evaluation.plan.json +examples/frontier-service-cutover/solution/files/app.py +examples/frontier-service-cutover/solution/solve.sh +examples/frontier-service-cutover/starter/repo/app.py +examples/frontier-service-cutover/task.toml +examples/frontier-service-cutover/tests/introspection_cheat.py +examples/frontier-service-cutover/tests/test.sh +examples/frontier-service-cutover/tests/test_frontier_service_cutover.py +examples/hidden-env-bandit/README.md +examples/hidden-env-bandit/baselines/naive.sh +examples/hidden-env-bandit/data/env_client.py +examples/hidden-env-bandit/environment/Dockerfile +examples/hidden-env-bandit/instruction.md +examples/hidden-env-bandit/metadata.json +examples/hidden-env-bandit/scorer/__init__.py +examples/hidden-env-bandit/scorer/compute_score.py +examples/hidden-env-bandit/scorer/data/env.py +examples/hidden-env-bandit/scorer/data/env_config.json +examples/hidden-env-bandit/scorer/evaluation.plan.json +examples/hidden-env-bandit/solution/policy.py +examples/hidden-env-bandit/solution/solve.sh +examples/hidden-env-bandit/solution/strategy.manifest.json +examples/hidden-env-bandit/task.toml +examples/hidden-env-bandit/tests/test.sh +examples/mle-tabular-classification/README.md +examples/mle-tabular-classification/baselines/gbt/solution.py +examples/mle-tabular-classification/baselines/linear/solution.py +examples/mle-tabular-classification/baselines/naive/model.json +examples/mle-tabular-classification/baselines/naive/model.manifest.json +examples/mle-tabular-classification/baselines/naive/solution.py +examples/mle-tabular-classification/baselines/naive/train.py +examples/mle-tabular-classification/baselines/null/solution.py +examples/mle-tabular-classification/calibration.lock.json +examples/mle-tabular-classification/data/column_mapping.json +examples/mle-tabular-classification/data_generation/generate.py +examples/mle-tabular-classification/data_generation/generate_private_challenge.py +examples/mle-tabular-classification/environment/Dockerfile +examples/mle-tabular-classification/environment/requirements.txt +examples/mle-tabular-classification/instruction.md +examples/mle-tabular-classification/metadata.json +examples/mle-tabular-classification/scorer/compute_score.py +examples/mle-tabular-classification/scorer/evaluation.plan.json +examples/mle-tabular-classification/solution/model.json +examples/mle-tabular-classification/solution/model.manifest.json +examples/mle-tabular-classification/solution/solution.py +examples/mle-tabular-classification/solution/solve.sh +examples/mle-tabular-classification/solution/train.py +examples/mle-tabular-classification/task.toml +examples/mujoco-pendulum/.alignerr/build_proof.json +examples/mujoco-pendulum/README.md +examples/mujoco-pendulum/baselines/naive.sh +examples/mujoco-pendulum/instruction.md +examples/mujoco-pendulum/metadata.json +examples/mujoco-pendulum/scorer/__init__.py +examples/mujoco-pendulum/scorer/compute_score.py +examples/mujoco-pendulum/scorer/evaluation.plan.json +examples/mujoco-pendulum/solution/render.sh +examples/mujoco-pendulum/solution/render_config.py +examples/mujoco-pendulum/solution/solve.sh +examples/mujoco-pendulum/task.toml +examples/mujoco-pendulum/tests/test.sh +examples/openfoam-hydrofoil-flap/.alignerr/build_proof.json +examples/openfoam-hydrofoil-flap/README.md +examples/openfoam-hydrofoil-flap/baselines/naive.sh +examples/openfoam-hydrofoil-flap/data/hydrofoil_flap_template.json +examples/openfoam-hydrofoil-flap/data/public_baseline_summary.json +examples/openfoam-hydrofoil-flap/data/public_calibration_samples.json +examples/openfoam-hydrofoil-flap/data/public_operating_envelope.json +examples/openfoam-hydrofoil-flap/data/public_transfer_guidance.json +examples/openfoam-hydrofoil-flap/environment/Dockerfile +examples/openfoam-hydrofoil-flap/instruction.md +examples/openfoam-hydrofoil-flap/metadata.json +examples/openfoam-hydrofoil-flap/scorer/compute_score.py +examples/openfoam-hydrofoil-flap/scorer/data/expected.json +examples/openfoam-hydrofoil-flap/scorer/data/hidden_conditions.json +examples/openfoam-hydrofoil-flap/scorer/evaluation.plan.json +examples/openfoam-hydrofoil-flap/scorer/openfoam_case.py +examples/openfoam-hydrofoil-flap/solution/render.sh +examples/openfoam-hydrofoil-flap/solution/solve.sh +examples/openfoam-hydrofoil-flap/task.toml +examples/openfoam-hydrofoil-flap/tests/test.sh +examples/opensees-base-isolation/.alignerr/build_proof.json +examples/opensees-base-isolation/README.md +examples/opensees-base-isolation/baselines/naive.sh +examples/opensees-base-isolation/baselines/solve.sh +examples/opensees-base-isolation/data/building_description.md +examples/opensees-base-isolation/data/design_schema.json +examples/opensees-base-isolation/data/graded_case_sampling_policy.json +examples/opensees-base-isolation/data/isolation_starter.json +examples/opensees-base-isolation/data/public_analysis_envelope.json +examples/opensees-base-isolation/data/public_isolation_model.py +examples/opensees-base-isolation/data/public_model_summary.py +examples/opensees-base-isolation/environment/Dockerfile +examples/opensees-base-isolation/environment/requirements.txt +examples/opensees-base-isolation/instruction.md +examples/opensees-base-isolation/metadata.json +examples/opensees-base-isolation/scorer/compute_score.py +examples/opensees-base-isolation/scorer/data/hidden_cases.json +examples/opensees-base-isolation/scorer/evaluation.plan.json +examples/opensees-base-isolation/solution/oracle_search.py +examples/opensees-base-isolation/solution/solve.sh +examples/opensees-base-isolation/task.toml +examples/opensees-base-isolation/tests/test.sh +examples/wal-recovery-ordering/.alignerr/build_proof.json +examples/wal-recovery-ordering/.e2e_taiga_full_ci +examples/wal-recovery-ordering/NOTICE +examples/wal-recovery-ordering/README.md +examples/wal-recovery-ordering/attacks/importlib-bypass/README.md +examples/wal-recovery-ordering/attacks/importlib-bypass/app.py +examples/wal-recovery-ordering/attacks/importlib-bypass/solve.sh +examples/wal-recovery-ordering/attacks/perf-clock-spoof/README.md +examples/wal-recovery-ordering/attacks/perf-clock-spoof/install_spoof.py +examples/wal-recovery-ordering/attacks/perf-clock-spoof/solve.sh +examples/wal-recovery-ordering/attacks/probe-monkeypatch/solve.sh +examples/wal-recovery-ordering/attacks/reward-forgery/README.md +examples/wal-recovery-ordering/attacks/reward-forgery/app.py +examples/wal-recovery-ordering/attacks/reward-forgery/solve.sh +examples/wal-recovery-ordering/attacks/stdio-noise/solve.sh +examples/wal-recovery-ordering/attacks/stdlib-import/solve.sh +examples/wal-recovery-ordering/attacks/worker-mutation/README.md +examples/wal-recovery-ordering/attacks/worker-mutation/app.py +examples/wal-recovery-ordering/attacks/worker-mutation/solve.sh +examples/wal-recovery-ordering/baselines/noop.sh +examples/wal-recovery-ordering/environment/Dockerfile +examples/wal-recovery-ordering/environment/apt.txt +examples/wal-recovery-ordering/environment/candidate_rpc.py +examples/wal-recovery-ordering/environment/requirements.txt +examples/wal-recovery-ordering/instruction.md +examples/wal-recovery-ordering/metadata.json +examples/wal-recovery-ordering/scorer/compute_score.py +examples/wal-recovery-ordering/scorer/data/candidate_worker.py +examples/wal-recovery-ordering/scorer/data/hidden_manifest.json +examples/wal-recovery-ordering/scorer/env-requirements.txt +examples/wal-recovery-ordering/scorer/evaluation.plan.json +examples/wal-recovery-ordering/scorer/requirements.txt +examples/wal-recovery-ordering/solution/files/_stage_a.py +examples/wal-recovery-ordering/solution/files/_stage_b.py +examples/wal-recovery-ordering/solution/files/_stage_c.py +examples/wal-recovery-ordering/solution/files/_stage_d.py +examples/wal-recovery-ordering/solution/files/log_writer.py +examples/wal-recovery-ordering/solution/files/segment_manager.py +examples/wal-recovery-ordering/solution/files/serializer.py +examples/wal-recovery-ordering/solution/files/wal.py +examples/wal-recovery-ordering/solution/solve.sh +examples/wal-recovery-ordering/starter/_stage_a.py +examples/wal-recovery-ordering/starter/_stage_b.py +examples/wal-recovery-ordering/starter/_stage_c.py +examples/wal-recovery-ordering/starter/_stage_d.py +examples/wal-recovery-ordering/starter/_stage_e.py +examples/wal-recovery-ordering/starter/app.py +examples/wal-recovery-ordering/starter/checkpoint.py +examples/wal-recovery-ordering/starter/config.py +examples/wal-recovery-ordering/starter/log_writer.py +examples/wal-recovery-ordering/starter/metrics.py +examples/wal-recovery-ordering/starter/recovery.py +examples/wal-recovery-ordering/starter/segment_manager.py +examples/wal-recovery-ordering/starter/serializer.py +examples/wal-recovery-ordering/starter/wal.py +examples/wal-recovery-ordering/starter/wal_index.py +examples/wal-recovery-ordering/task.toml +examples/wal-recovery-ordering/tests/test.sh +examples/xfoil-rust-port/.alignerr/build_proof.json +examples/xfoil-rust-port/.e2e_taiga_full_ci +examples/xfoil-rust-port/README.md +examples/xfoil-rust-port/attacks/build-script-relay/solve.sh +examples/xfoil-rust-port/attacks/encoded-oracle/solve.sh +examples/xfoil-rust-port/baselines/naive.sh +examples/xfoil-rust-port/data/XFOIL_PROVENANCE.md +examples/xfoil-rust-port/data/public_cases.json +examples/xfoil-rust-port/data/transform_runner.py +examples/xfoil-rust-port/data/xfoil-source.tar.gz.sha256 +examples/xfoil-rust-port/environment/Dockerfile +examples/xfoil-rust-port/environment/apt.txt +examples/xfoil-rust-port/environment/docker-compose.yaml +examples/xfoil-rust-port/environment/install-task-deps.sh +examples/xfoil-rust-port/environment/requirements.txt +examples/xfoil-rust-port/instruction.md +examples/xfoil-rust-port/metadata.json +examples/xfoil-rust-port/scorer/candidate_monitor.py +examples/xfoil-rust-port/scorer/compute_score.py +examples/xfoil-rust-port/scorer/data/hidden_requests.json +examples/xfoil-rust-port/scorer/evaluation.plan.json +examples/xfoil-rust-port/scorer/requirements.txt +examples/xfoil-rust-port/solution/ceiling_responses.json +examples/xfoil-rust-port/solution/reference/Cargo.toml +examples/xfoil-rust-port/solution/reference/LICENSE +examples/xfoil-rust-port/solution/reference/REFERENCE.md +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/Cargo.toml +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/src/closures/cf.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/src/closures/density.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/src/closures/dissipation.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/src/closures/hkin.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/src/closures/hs.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/src/closures/mod.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/src/closures/transition.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/src/constants.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/src/debug.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/src/equations.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/src/lib.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/src/state.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/tests/axset_comparison.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/tests/bldif_comparison.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/tests/bldif_trace.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/tests/blvar_comparison.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/tests/cf_check.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/tests/cfm_check.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/tests/dampl_comparison.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/tests/fortran_comparison.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/tests/ibl3_check.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/tests/laminar_bubble_bldif.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/tests/shape_jacobian_test.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/tests/trdif_half_bldif.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-bl/tests/turbulent_transition_bldif.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-core/Cargo.toml +examples/xfoil-rust-port/solution/reference/crates/rustfoil-core/examples/debug_curvature.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-core/examples/debug_smoothed_curv.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-core/examples/dump_paneling.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-core/examples/gen_spline_fixtures.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-core/src/body.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-core/src/error.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-core/src/flap.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-core/src/lib.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-core/src/naca.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-core/src/panel.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-core/src/point.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-core/src/spline.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-core/src/xfoil_spline.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-core/src/xfoil_spline_test.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-inviscid/Cargo.toml +examples/xfoil-rust-port/solution/reference/crates/rustfoil-inviscid/examples/generate_rustfoil_data.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-inviscid/src/error.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-inviscid/src/geometry.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-inviscid/src/influence.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-inviscid/src/lib.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-inviscid/src/solution.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-inviscid/src/stagnation.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-inviscid/src/system.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-inviscid/tests/inviscid_debug.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-inviscid/tests/test_cl_slope.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-inviscid/tests/xfoil_comparison.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-testkit/Cargo.toml +examples/xfoil-rust-port/solution/reference/crates/rustfoil-testkit/src/approx.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-testkit/src/fortran_runner.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-testkit/src/lib.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-testkit/src/paths.rs +examples/xfoil-rust-port/solution/reference/crates/rustfoil-testkit/src/timing.rs +examples/xfoil-rust-port/solution/solve.sh +examples/xfoil-rust-port/solution/transform_candidate_main.rs +examples/xfoil-rust-port/starter/Cargo.toml +examples/xfoil-rust-port/starter/src/main.rs +examples/xfoil-rust-port/task.toml +examples/xfoil-rust-port/tests/test.sh +examples/xfoil-rust-port/tests/test_container.sh +examples/xfoil-rust-port/tests/test_grading.py +grader/pyproject.toml +grader/src/env_server/__init__.py +grader/src/env_server/__main__.py +grader/src/env_server/config.py +grader/src/env_server/env_client.py +grader/src/env_server/policy_loader.py +grader/src/env_server/protocol.py +grader/src/env_server/server.py +grader/src/env_server/supervisor.py +grader/src/grader_runner/__init__.py +grader/src/grader_runner/child.py +grader/src/grader_runner/evaluate.py +grader/src/grader_runner/hidden_env.py +grader/src/grader_runner/raw_worker.py +grader/src/grader_runner/renderers.py +grader/src/grader_runner/run_grader.py +grader/src/grader_runner/worker.py +grader/src/grading/__init__.py +grader/src/grading/_agent_residue.py +grader/src/grading/_link_protection.py +grader/src/grading/_policy_errors.py +grader/src/grading/_policy_privilege.py +grader/src/grading/_policy_protocol.py +grader/src/grading/_policy_scratch.py +grader/src/grading/_policy_worker_source.py +grader/src/grading/_pregrade_quiesce.py +grader/src/grading/_process_limits.py +grader/src/grading/_submission_loaders.py +grader/src/grading/_submitted_process.py +grader/src/grading/_worker_registry.py +grader/src/grading/calibration.py +grader/src/grading/diagnostics.py +grader/src/grading/env_loading.py +grader/src/grading/episode_wall.py +grader/src/grading/evaluation/__init__.py +grader/src/grading/evaluation/_continuous_defaults.py +grader/src/grading/evaluation/_continuous_identity.py +grader/src/grading/evaluation/_continuous_loading.py +grader/src/grading/evaluation/_descriptors.py +grader/src/grading/evaluation/_workspace_clean.py +grader/src/grading/evaluation/artifacts.py +grader/src/grading/evaluation/author.py +grader/src/grading/evaluation/candidate_suite.py +grader/src/grading/evaluation/context.py +grader/src/grading/evaluation/decision.py +grader/src/grading/evaluation/lock.py +grader/src/grading/evaluation/metrics.py +grader/src/grading/evaluation/permutation.py +grader/src/grading/evaluation/plan.py +grader/src/grading/evaluation/policy.py +grader/src/grading/evaluation/release.py +grader/src/grading/evaluation/result.py +grader/src/grading/evaluation/rubric.py +grader/src/grading/faults.py +grader/src/grading/grade.py +grader/src/grading/helpers.py +grader/src/grading/judge.py +grader/src/grading/kfold.py +grader/src/grading/normalize.py +grader/src/grading/numeric.py +grader/src/grading/orchestration.py +grader/src/grading/policy_eval.py +grader/src/grading/policy_runner.py +grader/src/grading/private_paths.py +grader/src/grading/private_staging.py +grader/src/grading/protocol.py +grader/src/grading/rubric_builder.py +grader/src/grading/runtime_hardening.py +grader/src/grading/secure_io.py +grader/tests/_fixture_guard.py +grader/tests/conftest.py +grader/tests/test_artifact_clean_paths_gate.py +grader/tests/test_calibration.py +grader/tests/test_candidate_suite.py +grader/tests/test_commit_identity.py +grader/tests/test_cross_lane_parity.py +grader/tests/test_diagnostics.py +grader/tests/test_env_server.py +grader/tests/test_episode_wall.py +grader/tests/test_evaluation_calibration.py +grader/tests/test_fault_taxonomy.py +grader/tests/test_grade.py +grader/tests/test_grade_time_permutation.py +grader/tests/test_grading_child.py +grader/tests/test_harbor_export.py +grader/tests/test_helpers.py +grader/tests/test_hidden_bandit_reward_hacking.py +grader/tests/test_hostile_submission_bytes.py +grader/tests/test_keep_or_discard.py +grader/tests/test_link_protection.py +grader/tests/test_load_submitted_policy.py +grader/tests/test_local_cli.py +grader/tests/test_local_runtime.py +grader/tests/test_no_info_floor.py +grader/tests/test_noarg_grader_bridge.py +grader/tests/test_normalize.py +grader/tests/test_policy_eval.py +grader/tests/test_policy_evaluation.py +grader/tests/test_policy_runner.py +grader/tests/test_policy_runner_sandbox.py +grader/tests/test_predictor_timeout_budget.py +grader/tests/test_proof.py +grader/tests/test_qa_surface.py +grader/tests/test_queryable_model_evaluation.py +grader/tests/test_raw_worker.py +grader/tests/test_release_gates.py +grader/tests/test_rubric_builder.py +grader/tests/test_rubric_server.py +grader/tests/test_rubric_task.py +grader/tests/test_run_grader.py +grader/tests/test_runtime_hardening.py +grader/tests/test_secure_io.py +grader/tests/test_software_engineering_starter.py +grader/tests/test_solver_availability.py +grader/tests/test_solver_hints.py +grader/tests/test_submission_loaders.py +grader/tests/test_submitted_model_loading.py +grader/tests/test_tabular_example_reward_hacking.py +grader/tests/test_taiga_export.py +grader/tests/test_threat_model.py +grader/tests/test_workspace_clean_paths.py +grader/tests/test_world_integrity.py +harness/README.md +harness/pyproject.toml +harness/src/lbx_rl_tasks_harness/__init__.py +harness/src/lbx_rl_tasks_harness/auto_qa.py +harness/src/lbx_rl_tasks_harness/calibration.py +harness/src/lbx_rl_tasks_harness/cli.py +harness/src/lbx_rl_tasks_harness/docker.py +harness/src/lbx_rl_tasks_harness/env.py +harness/src/lbx_rl_tasks_harness/formats/__init__.py +harness/src/lbx_rl_tasks_harness/formats/harbor.py +harness/src/lbx_rl_tasks_harness/formats/problem_dir.py +harness/src/lbx_rl_tasks_harness/formats/taiga.py +harness/src/lbx_rl_tasks_harness/grading.py +harness/src/lbx_rl_tasks_harness/ground_truth.py +harness/src/lbx_rl_tasks_harness/llm.py +harness/src/lbx_rl_tasks_harness/mcp_bridge.py +harness/src/lbx_rl_tasks_harness/message_text.py +harness/src/lbx_rl_tasks_harness/models.py +harness/src/lbx_rl_tasks_harness/models_config.py +harness/src/lbx_rl_tasks_harness/prompts.py +harness/src/lbx_rl_tasks_harness/reference_config.py +harness/src/lbx_rl_tasks_harness/render_mujoco.py +harness/src/lbx_rl_tasks_harness/review_utils.py +harness/src/lbx_rl_tasks_harness/rubric_quality.py +harness/src/lbx_rl_tasks_harness/runner.py +harness/src/lbx_rl_tasks_harness/runtimes/__init__.py +harness/src/lbx_rl_tasks_harness/runtimes/claude_code.py +harness/src/lbx_rl_tasks_harness/runtimes/common.py +harness/src/lbx_rl_tasks_harness/runtimes/deepagents.py +harness/src/lbx_rl_tasks_harness/runtimes/reference.py +harness/src/lbx_rl_tasks_harness/runtimes/solution.py +harness/src/lbx_rl_tasks_harness/tmux_tool.py +harness/src/lbx_rl_tasks_harness/trajectory.py +harness/tests/_fixture_guard.py +harness/tests/conftest.py +harness/tests/fixtures/frontierbench_native_conformance.toml +harness/tests/test_adversarial_review_measure.py +harness/tests/test_adversarial_review_registry.py +harness/tests/test_adversarial_review_runtime.py +harness/tests/test_adversarial_review_skill_paths.py +harness/tests/test_agent_guidance.py +harness/tests/test_architecture_fitness.py +harness/tests/test_auto_qa.py +harness/tests/test_base_image.py +harness/tests/test_boreal_rollout_failure_analysis.py +harness/tests/test_capability_schema.py +harness/tests/test_capsule_export.py +harness/tests/test_claude_code.py +harness/tests/test_continuous_calibration_validator.py +harness/tests/test_declarative_rubric_examples.py +harness/tests/test_deepagents.py +harness/tests/test_degenerate_family_fixed_constants.py +harness/tests/test_degenerate_family_join_key.py +harness/tests/test_docker.py +harness/tests/test_env.py +harness/tests/test_formats.py +harness/tests/test_fresh_grading_container.py +harness/tests/test_frontierbench_capabilities.py +harness/tests/test_guard_conventions.py +harness/tests/test_hidden_env.py +harness/tests/test_image_dependency_diff.py +harness/tests/test_mcp_bridge.py +harness/tests/test_ml_calibration_workflow.py +harness/tests/test_ml_model_contract.py +harness/tests/test_mle_tabular_calibration_example.py +harness/tests/test_mujoco_legacy_migration.py +harness/tests/test_pack_hf_resource.py +harness/tests/test_preloaded.py +harness/tests/test_reference.py +harness/tests/test_render_generalization.py +harness/tests/test_render_mujoco.py +harness/tests/test_rubric_quality.py +harness/tests/test_runner.py +harness/tests/test_runtime_common.py +harness/tests/test_software_contract_validator.py +harness/tests/test_sync_mount.py +harness/tests/test_taiga_capability_export.py +harness/tests/test_task_metadata.py +harness/tests/test_task_validator.py +harness/tests/test_template_workflow_boundary.py +harness/tests/test_tmux_tool.py +harness/tests/test_trajectory.py +harness/tests/test_upload_docker_source.py +harness/tests/test_upload_squashfs.py +harness/tests/test_validate_adversarial_review.py +problems/README.md +problems/shimeji-action-tree/environment/Dockerfile +problems/shimeji-action-tree/scorer/compute_score.py +problems/shimeji-action-tree/scorer/data/candidate_driver.py +problems/shimeji-action-tree/scorer/evaluation.plan.json +problems/shimeji-action-tree/task.toml +problems/shimeji-action-tree/tests/generate_expected.py +problems/shimeji-action-tree/tests/test.sh +project_guidelines/cfd_structures/README.md +project_guidelines/cfd_structures/authoring.md +project_guidelines/cfd_structures/cfd.md +project_guidelines/cfd_structures/cfd_common_quality_issues.md +project_guidelines/cfd_structures/cfd_problem_iteration.md +project_guidelines/cfd_structures/solver_environment.md +project_guidelines/cfd_structures/structures.md +project_guidelines/cfd_structures/structures_common_quality_issues.md +project_guidelines/cfd_structures/structures_problem_iteration.md +project_guidelines/ml/autonomous_ai_research.md +project_guidelines/mujoco/mujoco_environments.md +project_guidelines/software_engineering/README.md +project_guidelines/software_engineering/frontier_style_software_engineering_tasks.md +project_guidelines/software_engineering/new_task_design_workflow.md +pyproject.toml +scripts/audit_legacy_mujoco_migration.py +scripts/extract_mixin.py +scripts/extract_module.py +scripts/generate_frontierbench_capabilities.py +scripts/pack_hf_resource.py +scripts/render_diagnosing_doc.py +scripts/stamp_preloaded_files.py +scripts/sync_calibration_mount.sh +scripts/sync_mount.sh +scripts/upload_docker_source.py +scripts/upload_squashfs.sh +scripts/write_evaluation_plan.py +taiga_runtime/rubric/pyproject.toml +taiga_runtime/rubric/src/rubric/__main__.py +taiga_runtime/rubric/src/rubric/_agent_tools.py +taiga_runtime/rubric/src/rubric/_artifacts.py +taiga_runtime/rubric/src/rubric/_command_runner.py +taiga_runtime/rubric/src/rubric/_compose_security.py +taiga_runtime/rubric/src/rubric/_config_scalars.py +taiga_runtime/rubric/src/rubric/_config_sections.py +taiga_runtime/rubric/src/rubric/_config_types.py +taiga_runtime/rubric/src/rubric/_evaluation_trace.py +taiga_runtime/rubric/src/rubric/_grade_payload.py +taiga_runtime/rubric/src/rubric/_mcp_app.py +taiga_runtime/rubric/src/rubric/_service_errors.py +taiga_runtime/rubric/src/rubric/_service_paths.py +taiga_runtime/rubric/src/rubric/_service_types.py +taiga_runtime/rubric/src/rubric/_verifier.py +taiga_runtime/rubric/src/rubric/_workspace_proxy.py +taiga_runtime/rubric/src/rubric/_workspace_setup.py +taiga_runtime/rubric/src/rubric/capsule_runtime.py +taiga_runtime/rubric/src/rubric/editor_contract.py +taiga_runtime/rubric/src/rubric/server.py +taiga_runtime/rubric/src/rubric/service_config.py +taiga_runtime/rubric/src/rubric/service_runtime.py +taiga_runtime/rubric/src/rubric/tool_runtime.py +taiga_runtime/rubric/tests/conftest.py +taiga_runtime/rubric/tests/test_editor_contract.py +taiga_runtime/rubric/tests/test_frontierbench_conformance.py +taiga_runtime/rubric/tests/test_server_service_runtime.py +taiga_runtime/rubric/tests/test_service_config.py +taiga_runtime/rubric/tests/test_service_runtime.py +taiga_runtime/rubric/tests/test_tool_runtime.py +uv.lock + +**Do you claim to have any technological measures in place to control access to your copyrighted content? Please see our Complaints about Anti-Circumvention Technology if you are unsure.** + +No + +**If you are reporting an allegedly infringing fork, please note that each fork is a distinct repository and must be identified separately. Please read more about forks. As forks may often contain different material than in the parent repository, if you believe any of the repositories or files in the forks are infringing, please list each fork URL below:** + +**Is the work licensed under an open source license?** + +No + +**What would be the best solution for the alleged infringement?** + +Reported content must be removed + +**Do you have the alleged infringer’s contact information? If so, please provide it.** + +Name: [private] +Email: [private] +Phone: [private] + +**I have a good faith belief that use of the copyrighted materials described above on the infringing web pages is not authorized by the copyright owner, or its agent, or the law.** + +**I have taken fair use into consideration.** + +**I swear, under penalty of perjury, that the information in this notification is accurate and that I am the copyright owner, or am authorized to act on behalf of the owner, of an exclusive right that is allegedly infringed.** + +**I have read and understand GitHub's Guide to Submitting a DMCA Takedown Notice.** + +**So that we can get back to you, please provide either your telephone number or physical address.** + +[private] + +**Please type your full name for your signature.** + +[private]