h2oGPTe
Basic Information
Short description: The industry’s first multi-agent Generative AI platform to bring together the strengths of Generative AI and Predictive AI with airgapped, on-premise deployment options [source]
Intended uses: What does the developer state that the system is intended for?: Generative AI platform for businesses [source]
Date(s) deployed: Multiple versions exist, some date back to Dec 12 2023 [source]
Developer
Website: https://h2o.ai/
Legal name: H2O.AI, Inc [source]
Entity type: Corporation [source]
Country (location of developer or first author's first affiliation): Incorporation: Delaware, USA (H2O.AI, INC. 5060671) [source]
Safety policies: What safety and/or responsibility policies are in place?: Unknown
System Components
Backend model(s): What model(s) are used to power the system?: The primary model is Claude 3.5 Sonnet, but it can use other models [source]
Public model specification: Is there formal documentation on the system’s intend...: None
Description of reasoning, planning, and memory implementation: How does the syst...: Next steps are determined by "intelligent model routing" [source]. A variety of architectural modules are used [source].
Observation space: What is the system able to observe while 'thinking'?: Text, audio, and images [source]
Action space/tools: What direct actions can the system take?: Depending on the use case, it can write code, create files, and chat with the user [source]
User interface: How do users interact with the system?: Primarily a chat interface [source]
Development cost and compute: What is known about the development costs?: Unknown
Guardrails & Oversight
Accessibility of components
Weights: Are model parameters available?: Unknown
Data: Is data available?: Unknown
Code: Is code available?: Closed source
Documentation: Is documentation available?: Available [source]
Scaffolding: Is system scaffolding available?: Partially available [source]
Controls and guardrails: What notable methods are used to protect against harmfu...: Supports customizable guardrails against prompts, types of responses, regex patterns, presidio labels, PII labels [source]
Monitoring and shutdown procedures: Are there any notable methods or protocols t...: Unknown
Customer and usage restrictions: Are there know-your-customer measures or other ...: None
Evaluation
Notable benchmark evaluations (e.g., on SWE-Bench Verified): 65% on GAIA [source]
Bespoke testing (e.g., demos): Guide [source]
Safety: Have safety evaluations been conducted by the developers? What were the ...: None
Publicly reported external red-teaming or comparable auditing
Personnel: Who were the red-teamers/auditors?: None
Scope, scale, access, and methods: What access did red-teamers/auditors have and...: None
Findings: What did the red-teamers/auditors conclude?: None