Skip to content

MTRL: Add end-to-end MTRL SOP-Bench example (AgentCore) - #6532

Open
SapanaChaudhary wants to merge 2 commits into
aws:masterfrom
SapanaChaudhary:documentation/mtrl-sopbench-example
Open

SapanaChaudhary wants to merge 2 commits into
aws:masterfrom
SapanaChaudhary:documentation/mtrl-sopbench-example

Conversation

@SapanaChaudhary

Copy link
Copy Markdown
Collaborator

[Add v3-examples/model-customization-examples/serverless/mtrl/, a complete, runnable multi-turn RL example: fine-tune openai-reasoning-gpt-oss-20b on the SOP-Bench aircraft_inspection task with a rollout agent on Amazon Bedrock AgentCore.

  • 01_build_and_deploy_agent.ipynb: task, tools, reward design (and the reward hack it prevents), AgentCore deploy
  • 02_train.ipynb: prompt dataset, MultiTurnRLTrainer GRPO run, reading MLflow metrics and traces
  • 03_evaluate_and_deploy.ipynb: MultiTurnRLEvaluator base vs. fine-tuned, failure diagnosis, deployment options, scoped cleanup
  • sopbench_agent/: the agent package (entrypoint, agent loop, tools, reward), Dockerfile, and scripts
  • prerequisites.yaml: IAM roles, S3 bucket, MLflow app (or an existing one), and managed policies for the notebook identity

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.
](https://github.com/aws/sagemaker-python-sdk/compare/master...SapanaChaudhary:sagemaker-python-sdk:documentation/mtrl-sopbench-example?expand=1)

Add v3-examples/model-customization-examples/serverless/mtrl/, a complete,
runnable multi-turn RL example: fine-tune openai-reasoning-gpt-oss-20b on the
SOP-Bench aircraft_inspection task with a rollout agent on Amazon Bedrock
AgentCore.

- 01_build_and_deploy_agent.ipynb: task, tools, reward design (and the reward
  hack it prevents), AgentCore deploy
- 02_train.ipynb: prompt dataset, MultiTurnRLTrainer GRPO run, reading MLflow
  metrics and traces
- 03_evaluate_and_deploy.ipynb: MultiTurnRLEvaluator base vs. fine-tuned,
  failure diagnosis, deployment options, scoped cleanup
- sopbench_agent/: the agent package (entrypoint, agent loop, tools, reward),
  Dockerfile, and scripts
- prerequisites.yaml: IAM roles, S3 bucket, MLflow app (or an existing one),
  and managed policies for the notebook identity

This branch was successfully deployed

1 active deployment
auto-approve — 8dde686d Deployed Oct 24, 2026 by mufaddal-rohawala via wait-for-approval #1840
manual-approval — 4b8be40e Deployed Oct 23, 2026 by SapanaChaudhary via wait-for-approval #1832
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants