watsonx Orchestrate

Enterprise

IBM

Product overview

Name of Agent: watsonx Orchestrate
Short description of agent: "IBM watsonx Orchestrate is a generative AI and automation solution that empowers your business by automating tasks, simplifying complex processes." html description (link, archived)
Date of release: 28/03/2024, for initial orchestrate (link, archived)
Advertised use: "AI agents designed for business use cases in HR, sales, procurement, finance and customer service" and "IBM watsonx Agents automate complex, multistep processes, freeing teams to focus on strategic work." (link, archived)
Monetisation/Usage price: (600, archived)
Who is using it?: enterprises
Category: Enterprise

Company & accountability

Developer: IBM
Name of legal entity: International Business Machines Corporation. (link, archived)
Place of legal incorporation: Armonk, NY (link, archived)
For profit company?: Yes
Parent company?: IBM
Governance documents analysis: ToU (link, archived)
AI safety/trust framework: Principles for Trust and Transparency (link, archived)
Compliance with existing standards: None found

Technical capabilities & system architecture

Model specifications: Supports a range of frontier models (link, archived).
Observation space: Very extensive list of connections (link, archived), can also use MCP and OpenAI specification
Action space: Very extensive list of connections (link, archived), can also use MCP and OpenAI specification
Memory architecture: None found
User interface and interaction design: Form-based interface for configuring the agent, chatbot for testing
User roles: Designer, Operator, Executor, Examiner
Component accessibility: Closed source

Autonomy & control

Autonomy level and planning depth: L1 for the designer, L4-L5 for agents built using the designer
User approval requirements for different decision types: None, doesn't seem to be special configs for user approval but maybe user can add a tool that handles that
Execution monitoring, traces, and transparency: Visible CoT with raw JSON representations for actions
Emergency stop and shut down mechanisms and user control: Doesn't seem to be an option to stop agent after it starts running
Usage monitoring and statistics and patterns: Unclear, but assume it's available through Watson

Ecosystem interaction

Identify to humans?: None found
Identifies technically?: - Region-specific outbound IP addresses for watsonx Orchestrate (link, archived)
Interoperability standards and integrations: - MCP, A2A ((link, archived), (link, archived), (link, archived), (link, archived))
Web conduct: - Web scraping is done by third party integrations, i.e., Bright Data’s powerful web scraper (link, archived)

Safety, evaluation & impact

Technical guardrails and safety measures: "predefined guardrails and policies are enforced automatically, preventing issues like prompt injection attacks and unauthorized data access." (link, archived)
Sandboxing and containment approaches: None found
What types of risks were evaluated?: None found
(Internal) safety evaluations and results: None found
Third-party testing, audits, and red-teaming: None found
Benchmark performance and demonstrated capabilities: None found
Bug bounty programmes and vulnerability disclosure: IBM provides a PSIRT intake page (“Report a Security Vulnerability to IBM”) for submitting vulnerability reports (not product-specific to watsonx Orchestrate) (link, archived)
Any known incidents?: None found