New harness

Describe a harness, see its canonical hash as you type, seal it to the evaluator, and sign and send mint_harness with the key in this browser.

The harness object

Five fields, hashed as you type. Nothing leaves this page until it is sealed.

Model

The model field, and the base_model argument of mint_harness.

Prompt

The system field. It is sealed with the rest of the object.

Few shot examples

0 in the object; an example with an empty question and answer is left out.
Example 1

Temperature and answer format

Canonical JSON writes it as 0.

The answer_format field: json or text.

Price per question

What one question to this harness costs the asker.

50000 base units, what one question costs.

The canonical object

Exactly what is hashed and sealed.

{
  "model": "",
  "system": "",
  "temperature": 0,
  "few_shot": [],
  "answer_format": "json"
}

Seal, upload, mint

Three steps, in order. Each one says when it is done.

Step 1 Seal

Checks the evaluator's attestation, then seals the object to its key in this browser.

Not started

Step 2 Upload sealed box

The run loop looks the sealed box up under the harness hash, so upload it before a run is submitted.

Not started

Available once the harness is sealed.

Step 3 Sign and mint

Signed by the key in this browser, which pays the storage deposit.

Not started