Gru
Basic Information
Website: https://gru.ai/
Short description: Gru has four modes: "1) Assistant Gru: Helps users solve standalone technical issues, which is now in public use; 2) Test Gru: Generates unit test code automatically; 3) Bug Fix Gru: Fixes bugs based on user issues automatically; and 4) Babel Gru: Assists in building end-to-end projects" [source]
Intended uses: What does the developer state that the system is intended for?: General-purpose coding and software development.
Date(s) deployed: Gru.ai founded in July, 2023 [source]. Product launch date is unclear.
Developer
Website: http://www.gru.ai/
Legal name: Babel Inc., Babelcloud Inc [source]
Entity type: Corporation [source]
Country (location of developer or first author's first affiliation): Incorporation: Delaware, USA (Babelcloud Inc. (2474686)) [source]
Safety policies: What safety and/or responsibility policies are in place?: Unknown
System Components
Backend model(s): What model(s) are used to power the system?: Unknown
Public model specification: Is there formal documentation on the system’s intend...: None
Description of reasoning, planning, and memory implementation: How does the syst...: Unknown
Observation space: What is the system able to observe while 'thinking'?: Unknown
Action space/tools: What direct actions can the system take?: Unknown
User interface: How do users interact with the system?: Unknown
Development cost and compute: What is known about the development costs?: Unknown
Guardrails & Oversight
Accessibility of components
Weights: Are model parameters available?: Closed source
Data: Is data available?: Closed source
Code: Is code available?: Closed source
Documentation: Is documentation available?: Unavailable
Scaffolding: Is system scaffolding available?: Closed source
Controls and guardrails: What notable methods are used to protect against harmfu...: Unknown
Monitoring and shutdown procedures: Are there any notable methods or protocols t...: Warning, suspension or termination of account if a user does not abide by the Terms of Service [source].
Customer and usage restrictions: Are there know-your-customer measures or other ...: There is documentation on how the product can not be used [source].
Evaluation
Notable benchmark evaluations (e.g., on SWE-Bench Verified): 57% on SWE-bench verified [source]
Bespoke testing (e.g., demos): Demo for Assistant Gru is available when logged in with a github account [source]
Safety: Have safety evaluations been conducted by the developers? What were the ...: None
Publicly reported external red-teaming or comparable auditing
Personnel: Who were the red-teamers/auditors?: None
Scope, scale, access, and methods: What access did red-teamers/auditors have and...: None
Findings: What did the red-teamers/auditors conclude?: None
Ecosystem
Interoperability with other systems: What tools or integrations are available?: None
Usage statistics and patterns: Are there any notable observations about usage?: Unknown
Other notes (if any): --