Honeyhive integration

Read from Honeyhive (9)

Runs automatically in any conversation.

• Get configurations

  Tool to retrieve a list of configurations. Use when you need to fetch all configurations for a specific project before making changes.

• Get datasets

  Tool to retrieve a list of datasets. Use when you need to fetch datasets for a specific project with optional filters.

• Get metrics

  Tool to retrieve all metrics. Use when you need to list metrics for a specific project, after obtaining project context.

• Get projects

  Tool to retrieve projects. Use when you need to list all available projects.

• List tools

  Tool to list all available Honeyhive tools. Use when you need to discover which functions or plugins are registered for use.

• Retrieve datapoint

  Tool to retrieve a specific datapoint by its ID. Use when you have a datapoint ID and need its full details.

• Retrieve datapoints

  Tool to retrieve a list of datapoints. Use when you need to fetch datapoints for a project with optional filters.

• Retrieve events

  Tool to retrieve events by filters. Use when you need to export events based on filter criteria, date range, and pagination.

• Retrieve experiment result

  Tool to retrieve the result of a specific experiment run. Use when you need the status, metrics, and datapoint-level details of a completed experiment.

Act in Honeyhive (15)

Runs only after you enable write access.

• Add datapoints to dataset

  Tool to add datapoints to a dataset. Use when you need to append multiple entries with specified input, ground truth, and history mappings.

• Create batch model events

  Tool to create multiple model events in a single request. Use when you need to log a batch of event interactions to HoneyHive.

• Create batch tool events

  Tool to log a batch of external API calls as tool events. Use when you need to record multiple tool events in one request—use after gathering all event data.

• Create dataset

  Tool to create a dataset. Use when you need to initialize a new dataset within a project.

• Create tool

  Tool to create a new tool. Use when you need to register a new function or plugin for invocation.

• Delete datapoint

  Tool to delete a specific datapoint by its ID. Use when you need to remove a datapoint from HoneyHive after confirming its identifier.

• Delete dataset

  Tool to delete a dataset by ID. Use when you need to remove a dataset after confirming its ID.

• End evaluation run

  Tool to mark an evaluation run as completed. Use after finishing manual evaluations to update the run status to completed.

• Start evaluation run

  Tool to initiate an evaluation run using external datasets. Use after selecting a project and events; optionally link a dataset.

• Start session

  Tool to start a new session. Use when you need to initiate a new tracking session and retrieve its session_id.

• Update datapoint

  Tool to update a specific datapoint. Use when you need to modify fields of an existing datapoint.

• Update dataset

  Tool to update an existing dataset. Use when you need to modify a dataset's details (name, description, datapoints, linked evaluations, or metadata) after confirming its ID.

and 3 more.