← All workshopsRead What Should the Prototype Teach Us?

Test the Design and Plan for Failure

Separate the two prototype changes

BOTIE

Choose the small/smaller and small/original entries and subtract original from smaller.
Ready to test
0 passed · 0 failed · 2 not run

An empty floor. Start with the information your machine needs.

Received result

Your answer will arrive here.

Examples, experiments and workspace controls
Live values

Connect a tool's inputs to see what it produces. You can try a branch before connecting it to Result.

Try your own inputs

Use a copy of the example to try your own data. Keep the problem's assumptions in mind, and predict the effect of a change before checking the output. You can also add another branch to compare two ways of doing the calculation.

Start at an output arrow, then click or drag to an input. Drag empty space to pan. Delete removes a selection. Ctrl/Cmd+Z undoes a change.
Context for this challenge

Choose the small/smaller and small/original entries and subtract original from smaller.

Botie measured all combinations of batch size and parameter format. He needs to see whether the format effect depends on batch size.

Inspect the component calculation
Subtract(
  Starting value: Choose an entry(
    Table or list: Batch durations: small/original, small/smaller, large/original, large/smaller (ms)
    Index: 1
  )
  Value to remove: Choose an entry(
    Table or list: Batch durations: small/original, small/smaller, large/original, large/smaller (ms)
    Index: 0
  )
)
Examples and results
Batch durations: small/original, small/smaller, large/original, large/smaller (ms)
  1. 040
  2. 130
  3. 280
  4. 340
Required result
-10
Batch durations: small/original, small/smaller, large/original, large/smaller (ms)
  1. 020
  2. 110
  3. 250
  4. 345
Required result
-10
Try a fresh construction

This clears this draft, including its undo history. Earlier successful attempts stay recorded. Build again without opening hints to record an independent attempt.

Stuck? Inspect a worked construction

The tools below form one possible solution. You can assemble it, follow its signals, and undo that change to return to your own construction.

Assumptions and test precision

These are descriptive contrasts from invented timings. Repetition, measurement controls, and task-quality checks are still needed. Numerical tests allow a difference of 0.001. Lists and structures must also have the right shape.

Your last tested pieces can start the full construction. An existing draft there keeps its own pieces.

The prototype helps most on large inputs

This check uses the pieces from “Compare format effects while holding batch size fixed”.

BOTIE

Botie measures latency in milliseconds for four controlled combinations, ordered small input with original model, small input with smaller model, large input with original model, large input with smaller model. Compare the model-size change for large inputs with the change for small inputs.
Batch durations: small/original, small/smaller, large/original, large/smaller (ms)
  1. 018
  2. 112
  3. 270
  4. 340

Use a number, text, or an array matching the requested result. For a matrix, put each row in brackets. Saving your prediction runs your current construction on these inputs and checks the earlier examples too.

Build a construction in the workspace above first. This case will test those pieces.

What repeated measurements and task-quality checks would you add before acting on these invented timings?

Design a prototype around the uncertainty that could change the decision, keeping factors and response units explicit.

These are descriptive contrasts from invented timings. Repetition, measurement controls, and task-quality checks are still needed.

Work through the Python challenges →
Continue the courseWhat Should Happen When the Model Cannot Help? →
← Which Assumption Could Change Our Decision?