Jules
Basic Information
Short description: AI coding / software engineering agent based on Google's Gemini 2 model.
Intended uses: What does the developer state that the system is intended for?: Completing complex coding / software engineering tasks [source]
Date(s) deployed: Not deployed, "We’re making Jules available for a select group of trusted testers today, and we'll make it available for other interested developers in early 2025." Debut Dec 11 [source]
Developer
Website: https://deepmind.google/
Legal name: Google LLC [source]
Entity type: LLC
Country (location of developer or first author's first affiliation): Incorporation: Delaware, USA (GOOGLE LLC 3582691) [source]
System Components
Backend model(s): What model(s) are used to power the system?: Gemini 2.0 [source]
Public model specification: Is there formal documentation on the system’s intend...: None
Description of reasoning, planning, and memory implementation: How does the syst...: Unknown
Observation space: What is the system able to observe while 'thinking'?: Text. Possibly other modalities also (as Gemini 2 is multimodal) [source]
Action space/tools: What direct actions can the system take?: Modifying files, and preparing pull requests [source].
User interface: How do users interact with the system?: Unclear. This [source] contains a short video showing a GUI where the user describes the task they want Jules to complete and it returns code and diffs to files.
Development cost and compute: What is known about the development costs?: Unknown
Guardrails & Oversight
Accessibility of components
Weights: Are model parameters available?: Closed source
Data: Is data available?: Closed source
Code: Is code available?: Closed source
Documentation: Is documentation available?: Unavailable
Scaffolding: Is system scaffolding available?: Closed source
Controls and guardrails: What notable methods are used to protect against harmfu...: Unknown
Monitoring and shutdown procedures: Are there any notable methods or protocols t...: Unknown
Customer and usage restrictions: Are there know-your-customer measures or other ...: Currently behind a waitlist
Evaluation
Notable benchmark evaluations (e.g., on SWE-Bench Verified): 52.2% on SWE-bench Verified [source]
Bespoke testing (e.g., demos): None
Safety: Have safety evaluations been conducted by the developers? What were the ...: None
Publicly reported external red-teaming or comparable auditing
Personnel: Who were the red-teamers/auditors?: None
Scope, scale, access, and methods: What access did red-teamers/auditors have and...: None
Findings: What did the red-teamers/auditors conclude?: None
Ecosystem
Interoperability with other systems: What tools or integrations are available?: Can prepare pull requests suggesting GitHub integration [source]
Usage statistics and patterns: Are there any notable observations about usage?: None
Other notes (if any): --