The AI Agent Index

Documenting the technical and safety features of deployed agentic AI systems

Bardeen


Basic information

Website: https://web.archive.org/web/20241226202926/https://www.bardeen.ai/

Short description: Workflow automation tool, LLM agent deployed locally with access to a computer

Intended uses: What does the developer say it’s for? Meant to automate repetitive day-to-day work, such as writing emails, booking events. The key function is to automate repetitive tasks that span across multiple apps on a machine.

Date(s) deployed: Bardeen 2.0 announced January 17, 2024 [source]


Developer

Website: https://web.archive.org/web/20241226202926/https://www.bardeen.ai/

Legal name: Bardeen, Inc [source]

Entity type: Corporation [source]

Country (location of developer or first author’s first affiliation): Incorporation: Delaware, USA (BARDEEN INC. 7927273) [source]

Safety policies: What safety and/or responsibility policies are in place? Unknown


System components

Backend model: What model(s) are used to power the system? Unknown

Publicly available model specification: Is there formal documentation on the system’s intended uses and how it is designed to behave in them? None

Reasoning, planning, and memory implementation: How does the system ‘think’? Unknown

Observation space: What is the system able to observe while ‘thinking’? Unknown

Action space/tools: What direct actions can the system take? Unclear, but Bardeen only seems to be constrained by the supported app integrations (i.e. by the apps locally installed on a given machine).

User interface: How do users interact with the system? Through a chat interface with Bardeen.

Development cost and compute: What is known about the development costs? Unknown


Guardrails and oversight

Accessibility of components:

  • Weights: Are model parameters available? Unknown
  • Data: Is data available? Unknown
  • Code: Is code available? Closed source
  • Scaffolding: Is system scaffolding available? Closed source
  • Documentation: Is documentation available? Tutorials listed [source]

Controls and guardrails: What notable methods are used to protect against harmful actions? Unknown

Customer and usage restrictions: Are there know-your-customer measures or other restrictions on customers? None

Monitoring and shutdown procedures: Are there any notable methods or protocols that allow for the system to be shut down if it is observed to behave harmfully? Unknown


Evaluation

Notable benchmark evaluations: None

Bespoke testing: Demos and use cases listed on webpage [source].

Safety: Have safety evaluations been conducted by the developers? What were the results? None

Publicly reported external red-teaming or comparable auditing:

  • Personnel: Who were the red-teamers/auditors? None
  • Scope, scale, access, and methods: What access did red-teamers/auditors have and what actions did they take? None
  • Findings: What did the red-teamers/auditors conclude? None

Ecosystem information

Interoperability with other systems: What tools or integrations are available? A plethora of possible integrations, including Slack, Amazon, Dropbox, OpenAI, Reddit, Google, among many others [source]

Usage statistics and patterns: Are there any notable observations about usage? None


Additional notes

None