Skip to main content
Goal: Decide whether Millwork fits your application by completing five checks with public information or test data. Millwork runs a task you send on a model your organization can use and returns a result (the model output) and a receipt (the record of the run without its prompt or output). You are done when: every row of the evidence checklist at the end of this page passes, or you have written down the row that stopped you and why. The evaluation answers three questions:
  1. Can my application run a task through Millwork?
  2. Can I set limits and confirm which model and provider answered?
  3. Does the private preview fit my data and operating requirements?
What it costs. Step 1 uses a test run (the API calls it Echo, mode: "echo"), which does not call a model, so it has no platform fee and no model cost. Each live run in step 3 has a platform fee when Millwork accepts it, plus model usage. Read Model access and billing before step 3.

Before you begin

  • Your Millwork organization is approved for the private preview.
  • You created an organization API key.
  • You use only public information or test data created for this evaluation.
  • Your model catalog lists a model you can use, or you can connect a provider account.
The private preview offers no SLA, certification, or data-residency commitment, and no published pricing for models Millwork provides. If your evaluation requires any of these, it cannot proceed yet; email support to ask when they are planned.
Stop the evaluation if it would need restricted data, a credential inside an API request, or a production commitment that Millwork does not publish.
1

Check your access

Complete Make your first API call.Pass when: the test run’s status is completed, its receipt’s mode is echo, and selected_arm is null.
2

Choose how you reach a model

Use a model already listed in your catalog, or use your provider key to connect a provider account your organization already pays for.Read your catalog with GET /v1/model-catalog, or open the dashboard’s model list.Pass when: your catalog lists a model you can save for runs.
3

Run one public task

Complete Run a model. This step has a platform fee and model usage.Pass when: the run’s status is completed, a result exists, and a receipt exists.
4

Check which model and provider answered

For a run on a catalog model, compare the model Millwork requested with the model the provider reported. Check the provider, who bills the model usage, and the recorded usage.Read the four facts from the result you saved in the previous step:
billed_by is customer when your provider key was used and millwork when Millwork provided the model. The receipt carries the same names under slices[0].model_provenance and model usage under totals.usd. The platform fee is its own line, totals.platform_fee_usd. To investigate individual attempts, read the run’s events at GET /v1/executions/{executionId}/events.If model_provenance is null, Millwork selected a model saved directly with a provider model ID. That run does not prove which model the provider actually ran. Record this gap if provider-reported identity is a requirement; How model routing works explains the distinction.Pass when: the result and the receipt name the same model and provider.
5

Check your request and records

Confirm that:
  • the request contained no provider key;
  • the task included data, cost, and time limits;
  • the receipt did not copy the task or the model output.
If a request failed during the evaluation, confirm that the error named a code and a next step without exposing anything private.Pass when: all three statements are true.This checks what you submitted and stored. A model-usage budget controls whether Millwork starts another provider call; a call already started can finish above that budget.

Evidence checklist

Decide what comes next

Connect an output check

Host a handler for an acceptance check you already run.

Continue building

Add safe retries, cancellation, key replacement, and receipt exports.

Compare another provider

Connect another account and compare the models it adds to your catalog.

Check what is available

See what the private preview includes today and what is planned.

Ask a question

Discuss a requirement without sending credentials or customer data.