SIRIUS

SIRIUS

A second pair of eyes for people who are blind or have low vision.

Two small cameras sit side by side, like eyes. SIRIUS compares what each one sees to work out how far away things are, recognises what they are, and says it in a few words: chair, three metres, left.

In the picture behind this text, each camera sends out its own wave, left and right. They start from opposite sides and cross. A point lights up once both have passed it, because only then can SIRIUS measure it.

The animation shows a dark room drawn in points. Two waves sweep in from the left and right edges and cross in the middle. The room lights up where both have passed: a person about a metre ahead, a chair to the left, a table with a bottle to the right. Each object is labelled with its distance.

2 cameras
about 12 cm apart
17
kinds of everyday objects
25 fps
pictures looked at a second
~50 ms
for the voice to start
Offline
no internet needed

How it works

Five steps, many times a second, on a laptop.

  1. See

    Two small cameras sit about 12 cm apart. Each looks at the room 25 times a second, and every left picture is paired with the right one taken at the same moment.

  2. Measure

    A point close to you shifts a lot between the left and right picture. A point far away hardly moves. That shift becomes a distance for every point in view. The classic matcher takes about 17 ms a frame on the development laptop.

  3. Recognise

    A detector names what is in the picture: people, chairs, tables, bottles, cups, bags, bikes, cars, dogs and more. Seventeen kinds, chosen because they get in the way.

  4. Decide

    One thing at a time, the most urgent first. Nothing is repeated within five seconds, and a sentence that is more than a second old is dropped rather than said late.

  5. Speak

    A short sentence, spoken on the device with no internet. The voice starts about 50 ms after a sentence is chosen. Something urgent cuts off whatever was being said.

It only speaks when it matters.

People who are blind need their ears for traffic and voices, so SIRIUS keeps to three distance zones and one short sentence at a time.

Urgent, under 1 metre

Said straight away, cutting off anything else.

person, one metre, ahead

Near, 1 to 2.5 metres

Said after anything urgent, closest first.

bench, two metres, right

Aware, 2.5 to 5 metres

Said after anything closer.

chair, three metres, left

If a camera goes dark or falls behind, SIRIUS still names the object but leaves the distance out. Until its two cameras are calibrated, the prototype can speak rough single-camera estimates instead, always with the word "about".

Where it is today

SIRIUS is a working prototype built on a bench: two webcams fixed to a ruler and a laptop.

Works now

  • Both cameras captured and paired
  • Objects recognised and tracked
  • Alerts decided and spoken
  • A live dashboard with a 3D view of the room

Not yet

  • Calibration on the real rig, so its distances are not trustworthy yet
  • Accuracy and speed measured end to end
  • Tried by anyone who is blind

Next

  • The cameras move onto a small Raspberry Pi worn by the user, with an infrared distance sensor added
  • It streams over Wi-Fi to the laptop
  • Later, the phone in the user's pocket does the computing

SIRIUS is meant to go alongside a white cane, never instead of one.