Reliability Evidence Pack

👤 christineopenclaw 📦 v2.0.2 ⭐ 4.3 ⬇️ 989 下载
🔒 IT运维与安全 免费

📖 技能介绍

Reliability Evidence Pack (REP)

A comprehensive runtime system for documenting and verifying agent operational reliability through structured artifact recording, validation, and compliance reporting.

What's Included

Core Scripts (/scripts)

  • rep.mjs - Main CLI for initialization, validation, and bundle management
  • rep-validate.mjs - Schema validation engine for REP artifacts
  • rep-heartbeat-cron.mjs - Records agent heartbeats on a schedule
  • rep-near-miss-cron.mjs - Tracks near-miss reliability events
  • rep-performance-baseline.mjs - Captures performance metrics
  • rep-generate-bundle.mjs - Generates REP bundles from artifacts

CLI Package (/cli)

  • Installable npm package for convenient command-line access
  • See cli/README.md for installation and usage

GitHub Action (/github-action)

  • CI/CD integration for automated validation
  • See github-action/README.md for setup

Schemas (/schemas)

  • JSON Schema definitions for all REP artifact types:
  • decision_rejection_log.json
  • handoff_acceptance_packet.json
  • memory_reconstruction_audit.json
  • near_miss_reliability_trailer.json
  • signed_divergence_violation_record.json

Examples (/examples)

  • Sample artifacts and workflows
  • Integration patterns for different use cases

Required Binaries

  • Node.js (v16 or higher - required for runtime scripts)
  • npm (for CLI package installation)

No other system binaries required.

Installation

Option 1: Direct Scripts

# Clone or copy this bundle to your project
cp -r rep-bundle-v2 /path/to/your/project/rep
cd rep

# Make scripts executable
chmod +x scripts/*.mjs

# Test
node scripts/rep.mjs --help

Option 2: CLI Package

cd cli
npm install -g
rep --help

Option 3: GitHub Action

- uses: ./github-action
  with:
    bundle-path: ./rep

Configuration

Set environment variables to configure behavior:

# Path to artifacts directory (default: ./artifacts)
REP_ARTIFACTS_PATH=./artifacts

# Path to schemas directory (default: ./schemas)  
REP_SCHEMAS_PATH=./schemas

# Log file path (optional)
REP_LOG_FILE=/var/log/rep.log

Usage

Initialize a new REP

node scripts/rep.mjs init --name "my-agent"

Validate artifacts

node scripts/rep-validate.mjs ./artifacts --strict

Run heartbeat recording (cron)

REP_ARTIFACTS_PATH=./artifacts node scripts/rep-heartbeat-cron.mjs

本技能来自小葱技能站7w4.net。

Set up cron (example for crontab)

# Add to crontab - run heartbeat every 5 minutes
*/5 * * * * cd /path/to/rep && REP_ARTIFACTS_PATH=./artifacts node scripts/rep-heartbeat-cron.mjs >> /var/log/rep-heartbeat.log 2>&1

Artifact Types

Artifact Purpose
agent_heartbeat_record Agent lifecycle events
decision_rejection_log Decisions and their outcomes
context_snapshot Memory/context state
handoff_acceptance_packet Inter-agent handoff validation
near_miss_reliability_trailer Near-miss events
memory_reconstruction_audit Memory integrity checks
signed_divergence_violation_record Policy violations

Security Considerations

  • Credentials: This skill does not require or handle credentials
  • File Access: Writes to configured artifacts directory only
  • Cron: Does not modify system crontab - operator must configure
  • Logs: Optional logging to configurable path

License

MIT

Support

  • Documentation: SPEC.md, QUICKSTART.md, INTEGRATION.md
  • Examples: examples/
  • Validation: node scripts/rep-validate.mjs --help

Security Considerations

Sensitive Data

REP captures context snapshots, decision logs, and memory-like artifacts that may contain sensitive information. - Set REP_ARTIFACTS_PATH to an isolated, access-controlled directory - Review or redact artifacts before sharing externally - Consider running in a container or unprivileged account

Signing Keys

The SPEC includes signature fields for artifact integrity, but key management is operator-defined: - Do NOT place private keys in the artifacts directory - Use external KMS or secure vault for production signing - For testing, generate keys externally and pass via environment (future feature)

CI Usage

The GitHub Action is local to your repository: - Review github-action/entrypoint.sh before use in public CI - Ensure no artifacts leak to external endpoints - Use isolated artifact paths in CI environments

Network Behavior

All scripts operate locally: - No telemetry or external API calls - No automatic updates - All file I/O is to configured artifact paths only

Best Practices

  1. Keep artifacts directory separate from source code
  2. Add artifact paths to .gitignore
  3. Rotate logs regularly
  4. Audit artifacts before external sharing

🤖 AI 评测

这个 Skill 整体质量较好,文档详细、集成方式多样、场景示例丰富,能满足可靠性证据收集需求。但存在一些小问题:部分文档描述不一致、有个别文件缺失、合规状态为部分通过(非完全)。对于需要完整可靠性的生产环境,建议先确认这些小问题得到修复。日常使用体验应该是不错的。

📊 多维度评分

适应性4
规范性4.3
有效性4.5
可靠性4.3
可信度4.4

📁 包含文件 (36 个)

📄 CHANGELOG.md 8.7 KB
📄 INTEGRATION.md 2.3 KB
📄 QUICKSTART.md 2.4 KB
📄 SKILL.md 4.7 KB
📄 SPEC.md 31.8 KB
📄 _meta.json 144 B
📄 cli/README.md 2.1 KB
📄 cli/bin/cli.js 3.3 KB
📄 cli/package-lock.json 3.1 KB
📄 cli/package.json 504 B
📄 examples/rep-examples/agent-memory-corruption-recovery/decision_rejection_log.md 2.8 KB
📄 examples/rep-examples/agent-memory-corruption-recovery/error_recovery_log.md 4.3 KB
📄 examples/rep-examples/agent-memory-corruption-recovery/manifest.json 2.4 KB
📄 examples/rep-examples/agent-memory-corruption-recovery/memory_reconstruction_audit.md 5.7 KB
📄 examples/rep-examples/capability-evolver-integration/README.md 3.3 KB
📄 examples/rep-examples/capability-evolver-integration/manifest.json 2.1 KB
📄 examples/rep-examples/tool-execution-failure-recovery/README.md 4.1 KB
📄 github-action/README.md 1.6 KB
📄 github-action/action.yaml 2.1 KB
📄 github-action/entrypoint.sh 4.3 KB
📄 github-action/rep-validate.yml 3.9 KB
📄 manifest.json 1.8 KB
📄 schemas/agent_heartbeat_record.json 1.9 KB
📄 schemas/claim_file.json 2.9 KB
📄 schemas/context_snapshot.json 2.7 KB
📄 schemas/decision_rejection_log.json 1.7 KB
📄 schemas/handoff_acceptance_packet.json 1.9 KB
📄 schemas/memory_reconstruction_audit.json 1.9 KB
📄 schemas/near_miss_reliability_trailer.json 1.6 KB
📄 schemas/signed_divergence_violation_record.json 1.8 KB
📄 scripts/rep-generate-bundle.mjs 8 KB
📄 scripts/rep-heartbeat-cron.mjs 4.2 KB
📄 scripts/rep-near-miss-cron.mjs 6.6 KB
📄 scripts/rep-performance-baseline.mjs 6.3 KB
📄 scripts/rep-validate.mjs 66.2 KB
📄 scripts/rep.mjs 50.3 KB