Computer Vision with Neural Networks

Find the matching picture

BOTIE

Find the closest stored image vector, then return its image ID. Keep the descriptors separate from the identifiers they point to.
Ready to test
0 passed · 0 failed · 1 not run

An empty floor. Start with the information your machine needs.

Received result

Your answer will arrive here.

Examples, experiments and workspace controls
Live values

Connect a tool's inputs to see what it produces. You can try a branch before connecting it to Result.

Try your own inputs

Use a copy of the example to try your own data. Keep the problem's assumptions in mind, and predict the effect of a change before checking the output. You can also add another branch to compare two ways of doing the calculation.

Start at an output arrow, then click or drag to an input. Drag empty space to pan. Delete removes a selection. Ctrl/Cmd+Z undoes a change.
Context for this challenge

Find the closest stored image vector, then return its image ID. Keep the descriptors separate from the identifiers they point to.

Botie's query can be compared with stored image vectors, but the user needs the identity of the retrieved picture rather than its position in the vector table.

Measure distances to stored descriptors, find the closest position, and retrieve the aligned image ID.

Examples and results
Query image vector
  1. 00.9
  2. 11.1
Stored image vectors
00
11
20
Stored image IDs
  1. 012
  2. 134
  3. 256
Required result
34
Try a fresh construction

This clears this draft, including its undo history. Earlier successful attempts stay recorded. Build again without opening hints to record an independent attempt.

Stuck? Inspect a worked construction

The tools below form one possible solution. You can assemble it, follow its signals, and undo that change to return to your own construction.

Assumptions and test precision

This is a small construction problem. The lesson explains the assumptions and the parts of the full method that this example leaves out. Numerical tests allow a difference of 0.001. Lists and structures must also have the right shape.

Two stored pictures are equally close

This check uses the pieces from “Carry the nearest vector's image ID into the result”.

BOTIE

Find the nearest stored vector by squared Euclidean distance and return its image ID. If distances tie, keep the first stored row. The image IDs are labels, not distances or row positions.
Query image vector
  1. 00
  2. 10
Stored image vectors
10
-10
03
Stored image IDs
  1. 091
  2. 117
  3. 244

Use a number, text, or an array matching the requested result. For a matrix, put each row in brackets. Saving your prediction runs your current construction on these inputs and checks the earlier examples too.

Build a construction in the workspace above first. This case will test those pieces.

Why could a mathematically nearest descriptor still retrieve the wrong subject for a user?

Retrieval quality depends on what the representation makes similar, as well as on the distance search.

This is a small construction problem. The lesson explains the assumptions and the parts of the full method that this example leaves out.

Work through the Python challenges →
Continue the courseImage Augmentation →
← Learning the Metric Itself