This is an internal document and is for Sestek employees only, and will not be accessible if shared with other parties.
Authentication Performance Metrics:
The EER is a commonly used metric in biometric systems that measures the point at which the false acceptance rate (FAR) and false rejection rate (FRR) are equal. A lower EER percentage indicates better authentication performance, as it means the system can accurately distinguish between legitimate users and impostors.
The table below allows for a quick comparison of different combinations of enrollment and authentication durations and their corresponding EER percentages:
| Enrollment - Authentication (sec) | EER (%) |
|---|---|
| 20 - 5 | 1.35 |
| 20 - 4 | 1.52 |
| 20 - 3 | 2.33 |
| 15 - 5 | 1.80 |
| 15 - 4 | 1.80 |
| 15 - 3 | 2.70 |
Identification Performance Metrics:
The table below shows the Equal Error Rate (EER) for different durations of enrollment and identification, based on the identification size:
| Enrollment - Identification (sec) | 10 | 20 | 40 | 80 | 100 |
|---|---|---|---|---|---|
| 20 - 5 | % 2.44 | % 4.06 | % 4.46 | % 6.47 | % 6.58 |
| 20 - 4 | % 3.15 | % 3.54 | % 4.89 | % 6.72 | % 6.48 |
| 20 - 3 | % 5.41 | % 6.78 | % 7.02 | % 7.94 | % 7.35 |
| 15 - 5 | % 4.53 | % 3.48 | % 5.31 | % 6.38 | % 8.15 |
| 15 - 4 | % 3.74 | % 3.44 | % 4.87 | % 6.67 | % 7.18 |
| 15 - 3 | % 5.56 | % 6.47 | % 7.42 | % 8.93 | % 9.62 |
Synthetic Model Performance Metrics:
The table below shows the hit rate for different false alarm rates, based on the identification size. Test set consists of around 2000 fake and real inputs prepared by using InTheWild, Fake or Real, Azure TTS, Sestek Voice Conversion etc.
False alarm rate: the ratio between the number of real inputs wrongly categorized as fake and the total number of actual real inputs
Hit rate: the ratio between the number of fake inputs truly categorized as fake and the total number of actual fake inputs
| False alarm rate (%) | 0.12 | 0.25 | 0.49 | 0.74 | 0.99 | 1.36 | 1.73 | 2.1 | 2.6 | 3.21 | 3.7 | 4.19 | 4.56 | 5.18 | 9.99 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Hit rate (%) | 43.49 | 71.61 | 74.2 | 80.67 | 90.6 | 92.75 | 93.36 | 93.79 | 94.39 | 94.82 | 95 | 95.34 | 95.51 | 95.94 | 97.76 |