Pulse: read your heart rate from your face

Demo signal: press Camera to read your own

How it works

Technical notes · Pulse rPPG monitor

Each heartbeat pushes a little more blood into the skin. Blood absorbs green light, so the skin colour changes by about 0.1 to 1 %. One pixel is too noisy to see it; the average of thousands of skin pixels is not. The method is called remote photoplethysmography (rPPG).

  1. Camera30 fps
  2. Skin3 patches
  3. Colourmean R, G, B
  4. POSpulse signal
  5. Filter42–192 bpm
  6. Spectrumlast 12 s
  7. Ratebpm

1 Face

MediaPipe Face Landmarker finds 478 points on the face in each frame. Three patches sit on the forehead and both cheeks (green boxes). Only skin-coloured pixels count. The model runs in the browser (WebAssembly and GPU).

2 Colour

For each frame: the mean red, green and blue of the patches. The values are resampled to exactly 30 per second.

3 POS

Method of Wang et al., 2017. In 1.6 s windows each colour is divided by its mean, then:

S1 = G − B S2 = G + B − 2R h = S1 + (sd S1 / sd S2) · S2

Changes in brightness and small movements cancel out; the pulse stays.

4 Filter

Butterworth band-pass, 4th order, 0.7 to 3.2 Hz (42 to 192 bpm). The result is the green PLETH wave.

5 Heart rate

Fourier spectrum of the last 12 s, from 40 to 200 bpm in 0.5 bpm steps. The highest peak is the heart rate; the screen shows the median of the last 5 values. Live spectrum:

6 Beats

Peaks of the PLETH wave, at least 0.33 s apart (a tick above the wave; a beep if it is on).

7 Signal quality

SNR in dB: power at the heart rate and at 2× the heart rate (± 6 bpm) against the rest. Below −4 dB no number is shown.

8 Breathing

Green channel, band-pass 0.1 to 0.6 Hz (6 to 36 breaths a minute): the yellow RESP wave. Rate from the spectrum of the last 30 s; needs 20 s of signal.

9 Measure 30 s

Median of 30 s of good estimates; range = 10th to 90th percentile.

For a good reading

  • Bright, even light from the front.
  • Do not move or talk.
  • Some LED lamps flicker: try another light.
  • Wait 10 s: the camera adjusts exposure and white balance.

Accuracy and privacy

In good light the error is a few bpm; with movement or poor light it can be wrong. Not a medical device. The video is processed in this browser: nothing is saved or sent.

Read more