Skip to content

Add multimodal outputs to js_repl polling#13081

Open
fjord-oai wants to merge 1 commit intofjord/js_repl_seq---4hn_deh_pjc2v_from
fjord/js_repl_seq---4hwa73o5rjfj-v
Open

Add multimodal outputs to js_repl polling#13081
fjord-oai wants to merge 1 commit intofjord/js_repl_seq---4hn_deh_pjc2v_from
fjord/js_repl_seq---4hwa73o5rjfj-v

Conversation

@fjord-oai
Copy link
Contributor

@fjord-oai fjord-oai commented Feb 28, 2026

Summary

Adds multimodal output support to js_repl polling results.

This is a follow-up to the polling-core change: completed js_repl_poll calls can now return structured content items, so nested tools like view_image work cleanly in polling mode instead of being flattened to text-only JSON.

What Changed

Poll output formatting

  • Updated js_repl_poll result formatting so completed polls can return FunctionCallOutputBody::ContentItems
  • When multimodal output is present, the poll result now emits:
    • a first input_text item containing the JSON status payload
    • followed by any nested multimodal content items (for example input_image)

Polling runtime

  • Extended polling exec state to retain nested tool-call content items until completion
  • Completed polling execs now surface those content items through JsExecPollResult
  • Replayable completed polls preserve the same multimodal output shape on subsequent polls

Docs / guidance

  • Updated tool spec text, project-doc guidance, and docs/js_repl.md to document that completed polls may include nested multimodal output after the JSON status item

git stack

git-stack-id: fjord/js_repl_seq---4hwa73o5rjfj-v
git-stack-title: Add multimodal outputs to js_repl polling
@fjord-oai fjord-oai changed the base branch from fjord/js_repl_seq---4hn_deh_pjc2v_ to main February 28, 2026 00:48
@fjord-oai fjord-oai force-pushed the fjord/js_repl_seq---4hwa73o5rjfj-v branch from 987c14d to 76c4731 Compare February 28, 2026 00:48
@fjord-oai fjord-oai changed the base branch from main to fjord/js_repl_seq---4hn_deh_pjc2v_ February 28, 2026 00:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant