After reading - An Alien Mind, by: Jakub Pachocki,
I got inspired to apply some of the characteristics that came from my experience in the Web3 domain to write this VALUE - concept proposal.
Central idea of VALUE is to separate value check and action of an AI agent. AI agent can plan and pursue the task, but an external entity should judge that the agent has been ethical.
The paper looks at how that could work in practice, including multiple value systems, action-bound attestations, relying-party verification, and the problem that the evaluator itself may make bad judgements.
I’d be interested in feedback, especially from people working on agents, security, attestation or AI control.
After reading - An Alien Mind, by: Jakub Pachocki, I got inspired to apply some of the characteristics that came from my experience in the Web3 domain to write this VALUE - concept proposal.
Central idea of VALUE is to separate value check and action of an AI agent. AI agent can plan and pursue the task, but an external entity should judge that the agent has been ethical.
The paper looks at how that could work in practice, including multiple value systems, action-bound attestations, relying-party verification, and the problem that the evaluator itself may make bad judgements.
I’d be interested in feedback, especially from people working on agents, security, attestation or AI control.
Paper: https://asteris.ai/pdf/verifiable-alignment-layer-for-agenti...