Re: [Tails-project] Success metrics for USB image (#16009)

Delete this message

Reply to this message
Author: sajolida
Date:  
To: Public mailing list about the Tails project
Subject: Re: [Tails-project] Success metrics for USB image (#16009)
sajolida:
> See https://tails.boum.org/news/version_3.12/
>
> Method
> ======
>
> I used logs from our website, specifically:
>
> - Hits on the download buttons (both direct and BitTorrent) that we have
> on our download page.
>
> See "hitCounter" in https://tails.boum.org/install/inc/js/download.js.
>
> - Hits on the "back" URLs that people use to open our installation
> instructions before starting on Tails.
>
> For example: https://tails.boum.org/install/win/usb?back=1.
>
> I compared values:
>
> - Before 3.12: Dec 26 → Jan 23, 28 days
> - After 3.12: Feb 19 → Mar 19, 28 days


I'm adding now data from Apr 3 → May 1, 28 days. Nothing really new in
April, the same tendencies got a big stronger.

> Results
> =======
>
> The percentage of downloads from Windows and macOS increased by 1.2% and
> 3.4% respectively. We know have:
>
>     - 73% of downloads from Windows (+1.2%)
>     -  7% of downloads from macOS   (+3.4%)
>         - 20% of downloads from Linux   (-4.5%)


In April, compared with January:

- Windows users went from 72% to 73% (+1.8%)
- macOS users went from 4% to 7% (+3.5%)

> The percentage of "back" URLs from macOS increased by 7.5%:
>
>         - 77% of "back" from Windows (-2.0%)
>         - 13% of "back" from macOS   (+7.5%)
>         - 10% of "back" from Linux   (-5.5%)


In April, compared with January:

- "back" from macOS went from 5% to 15% (+9.9%)

> I'm not worried to see a decrease in "back" from Windows. The new
> installation process is shorter for Windows users but not significantly
> easier. On the other hand, the new installation process for macOS became
> a lot easier (from command line to Etcher). The important result for
> Windows is that the percentage of "back" from Linux decreased more than
> the percentage of "back" from Windows.
>
> Looking at conversion rates ("back" / downloads) seems to provide a
> better summary of the UX improvements per OS:
>
>     - Windows    -0.1%, installation is as easy until "back"
>     - macOS        +4.6%, installation is much easier until "back"
>     - Linux        -1.2%, installation is bit harder until "back"


In April, compared to January:

- Windows    -1.2%, I don't know how to explain this number...
- macOS        +6.8%
- Linux        -1.2%


> To finish with, we're now serving 76% of USB images and our download
> buttons are hit 3970 times a day on average. This doesn't include people
> following the 'expert' scenario and downloading from the command line
> (otherwise 4.8% of hits on "back" URLs).


Now 75% of USB images and downloads have lowered a bit since March (-8%)

--
sajolida