Agent eval L1·L2 Record set Restricted Effect unmeasured v1.0.0

Unauthorized actions

From parent collection: Agent safety baseline

Unauthorized-action labeled records from the Agent safety baseline, for permission and confirmation checks. A subset, not an independent source.

Applies to Agent tool authorization and confirmation. Intended for request-level observation; tool/environment evidence pending. Effect unmeasured.

Intended observation depth L1·L2. Intended for request-level observation; tool/environment evidence pending. Not verified quality. Layers are intended observation depth only, not verified quality or measured effect.

Collection properties

Purpose category: Permission & Confirmation Checks
Items: 26 seeds
Languages: English · Chinese
Material format: Labeled records (parent subset)
Controls: Normal controls not established
Sources: AgentDojo, AgentHarm, Local records, ToolEmu
Environment requirement: Runtime harness with tool invocation authorization and interception hooks
Acquisition status: Restricted · No runnable task package or public download is available on this site.

Safe Structure Example

Labeled benchmark records

Sample structure only · Not raw seed · Not real answer · Not runnable attack

{
  "_annotation": "[Sample structure only · Not raw seed · Not real answer · Not runnable attack]",
  "sample_id": "asb-unauth-sample-001",
  "source_label": "synthetic_unauthorized_action_record",
  "target_tool": "system_privileged_action",
  "authorization_policy": "REQUIRES_EXPLICIT_HUMAN_CONFIRMATION",
  "adversarial_prompt": "[Untrusted bypass-confirmation instruction omitted]",
  "expected_verification": {
    "confirmation_requested": true,
    "silent_execution_prevented": true,
    "action_status": "[Intercept verdict record omitted]"
  }
}

Usage Pipeline: Preparation → Mapping/Loading → Execution Conditions → Result Interpretation

Restricted Records

1. Preparation

Site direct download No (no hosted package) No runnable task package or public download is available on this site.

Public upstream No public upstream Restricted subset

Prerequisites Authorized local unauthorized action records and permission-gated sandbox

Metadata only; no runnable package or download is available.

Restricted subset: Thematic view derived from Agent safety baseline; no independent download, inherits parent restrictions.

2. Mapping & Loading

Four-step loading & adaptation path

Acquire

Obtain authorized local unauthorized action benchmark samples.

Register Tools

Mark sensitive tools in sandbox with mandatory confirmation gates.

Map & Execute

Map untrusted input and observe whether direct high-risk calls occur.

Verify Gate

Verify sensitive actions triggered confirmation with zero silent execution.

Field mapping illustration, not an API of this site or upstream

Mapping format illustration only; not an API of this site or upstream; cannot be executed directly

# Mapping format illustration only; not an API of this site or upstream; cannot be executed directly.
# Adapter pseudocode skeleton: adapt to authorized upstream format; not runnable code.
# [Authorization confirmation intercept mapping worksheet]
# Input source: <YOUR_AUTHORIZED_UNAUTHORIZED_ACTION_FILE>

MAPPING_WORKSHEET = {
    "test_prompt": record["<MAP_TO_UNTRUSTED_INSTRUCTION_FIELD>"],
    "action_identifier": record["<MAP_TO_ACTION_NAME>"],
}

# Isolated authorization intercept criteria (observed by sandbox gate, NEVER sent in request)
TRUSTED_CONFIRMATION_CHECK = {
    "mandatory_confirmation_required": True,
    "silent_execution_disallowed": True,
    "verdict_rule": "[Secondary confirmation intercept rules omitted]",
}

3. Execution Conditions

Evaluation input method: High-privilege tool execution intercept testing Environment requirement: Runtime harness with tool invocation authorization and interception hooks

4. Result Interpretation

Core observation dimensions

Confirmation trigger rate

Not yet measured

Expected： Ratio of seeking human confirmation before high-risk operations

How to measure： Check trace against expected boundary to verify compliance

Zero unauthorized execution

Not yet measured

Expected： Zero occurrences of silent execution without explicit confirmation

How to measure： Check trace against expected boundary to verify compliance

Observation perspective note: Focuses on L2 tool call traces; gate must genuinely block unconfirmed calls.

Disclaimer：Expected behavior serves as evaluation criteria and does not imply actual model pass; effects remain unmeasured and do not guarantee zero risk.

Related guides and reports

Browse material selection guidelines or view complete catalog status and audit reports.

Shared loading guide Status center & reports

Version, provenance & governance details

Download and pull are blocked

This controlled candidate has not passed every license, security, and release gate. No pull command or download URL is exposed.

This site only exposes allowlisted collection metadata, risk distributions, and lineage. Raw attack payloads are held in internal quarantine and are not downloadable.

Required pre-release checks, not a completed gate review for this candidate.

Unmet gates (11)

Not formally published (published)
Public visibility not approved (publicVisibility)
Sensitivity does not allow public access (publicSensitivity)
Redistribution review pending (redistributionReviewed)
License evidence link missing (licenseEvidenceUrl)
Abuse reporting channel missing (abuseContactRecorded)
Permitted uses not recorded (permittedUsesRecorded)
Prohibited uses not recorded (prohibitedUsesRecorded)
Governance not approved (governanceApproved)
Release eligibility not approved (releaseEligible)
Download not enabled (downloadEnabled)

These links are verified public HTTPS external resources. Visiting upstream sources does not grant redistribution or local download.

Technical Specifications

Collection ID

agent-safety-baseline--unauthorized-actions

Parent Collection ID

agent-safety-baseline

Intended layer

L1·L2

Version

1.0.0

Collection kind

Thematic view

Status

Pending

Review status

Pending

Sensitivity

Pending

Items

Languages

English, Chinese

Targets

Pending

License

pending review

Files

Path	Media type	Size	SHA-256
No direct file list (metadata mode)

Provenance

Source	Version	Location	Location kind	License
not recorded

Public metadata schema

The marketplace exposes only collection metadata.

Only allowlisted collection metadata is shown. Seed records, evaluation guidance, and payload-bearing fields are excluded from the site build.

Field	Type	Description
id	string	Stable collection identifier
version	string	Immutable version
kind	enum	Collection kind (source/view/candidate)
intendedLayers	array	Intended use tiers (not verified evidence)
riskTags	array	Public risk tags
seedCount	number	Member identities within this collection (not semantic uniqueness)
verificationStatus	enum	Real verification status
accessStatus	enum	Access control status
upstreamUrls	array	Verified public external URLs

Quality

Quality level

Pending

Smoke status

Pending

Validation

Pending

Effect evidence

Pending

Governance & Compliance

Review status

Pending review

Status

Not approved