Skip to content

[bot] Instrument RunwayML (56,353 weekly downloads) #2414

Description

@braintrust-bot

Summary

Runway publishes an official Node.js/TypeScript SDK, @runwayml/sdk on npm (latest v4.17.0, GitHub: runwayml/sdk-node), providing task-based execution APIs for generative video and image models (Gen-4, Gen-4 Turbo, Gemini image models hosted on Runway's platform). This repository has zero instrumentation for any Runway SDK surface — no wrapper, no diagnostics channel, no plugin, no auto-instrumentation config, no e2e scenario. This is a clear media-generation execution gap of the same kind already tracked for other providers in this repo's history (e.g. OpenAI images.generate(), Google GenAI generateImages(), HuggingFace textToImage()).

What instrumentation is missing

The @runwayml/sdk npm package exposes these execution surfaces, none of which are instrumented:

SDK Method Description
client.imageToVideo.create({ model, promptImage, promptText, ratio }) Generates video from a source image + prompt — returns an async task
client.textToImage.create({ model, promptText, ratio }) Generates an image from a text prompt — returns an async task
client.textToSpeech.create(...) / client.videoToVideo.create(...) Additional generative task types (speech synthesis, video restyling)
task.waitForTaskOutput() Convenience polling helper that awaits and returns the generation result, or throws TaskFailedError/TaskTimedOutError
client.tasks.retrieve(task_id) Retrieves status/output of a previously started generation task

Every generation call returns a task record (id) that is polled to completion — a clear, well-bounded execution unit suitable for span-level tracing (start on create, end on task completion via waitForTaskOutput/retrieve).

No coverage in any instrumentation layer:

  • No wrapper function (e.g. wrapRunwayML()) in js/src/wrappers/
  • No diagnostics channels or plugin in js/src/instrumentation/plugins/
  • No auto-instrumentation config in js/src/auto-instrumentations/configs/ (not listed in all.ts)
  • No e2e test scenario under e2e/scenarios/
  • Full repo grep for runway (case-insensitive) returns zero matches anywhere in the repository

Weekly downloads

Weekly downloads: 56,353 (as of 2026-08-31; window 2026-08-23 to 2026-08-29; https://api.npmjs.org/downloads/point/last-week/@runwayml/sdk)

Braintrust docs status

not_found. Runway / RunwayML does not appear anywhere on the Braintrust integrations index — https://www.braintrust.dev/docs/guides/tracing/integrations — which lists Tracing integrations, Agent frameworks, Eval frameworks, and Testing frameworks. There is no Runway entry in any category and no gateway/proxy workaround documented.

Upstream references

Braintrust docs sources checked

Local files inspected

  • js/src/wrappers/*.ts — full directory listing — no runway.ts/runwayml.ts wrapper
  • js/src/instrumentation/plugins/*.ts — full directory listing — no Runway channels or plugin file
  • js/src/auto-instrumentations/configs/all.ts — full config group list (openai, anthropic, bedrock, ai-sdk, claude-agent-sdk, cloudflare-*, cursor-sdk, openai-agents, google-genai, huggingface(+transformers), langchain/langgraph, langsmith, openrouter(+agent), mistral, ollama, google-adk, cohere, groq, genkit, github-copilot, pi-coding-agent, strands-agent-sdk, flue, voyageai) — no Runway entry
  • e2e/scenarios/ — no Runway test scenario
  • Full repo grep for runway (case-insensitive) — zero matches

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions