Test Protocols
We have implemented test protocols to assess the impact of our script on our clients' websites. They are executed by simulating a poor connection (4 Mbps).
These protocols are repeated 250 times with and 250 times without our script.
Statistics are then generated from the measurements made.
Evaluation of site loading speed
In order to compare the loading speed of the site with and without our script, we have put in place an automated test protocol with the following steps:
- Measure the current time t0
- Open a page of the site
- Wait for the page's DOM to load
- Accept all cookies if a consent banner is present
- Wait for all sent requests to finish
- Measure the current time t1
- Calculate the display time of the popup t1 - t0
Evaluation of the speed of appearance of our popup
To compare the speed of appearance of our popup and the homemade popup of our clients, we have set up another automated test protocol:
- Open a page of the site
- Wait for the page to load
- Measure the current time t0
- Add a product to the basket
- Wait for the popup to appear in the DOM
- Measure the current time t1
- Calculate the display time of the popup t1 - t0
Results of test protocols
Alltricks x Multiply
Site loading time (in ms)
Statistic
min:
max:
average:
median:
With Potions:
6109
7662
6594
6619
Without Potions:
6017
10286
6835
6507
Result: The site loading time is slightly impacted by our script but the difference never exceeds 112ms.
Appearance time of recommendations (in ms)
Statistic
min:
max:
average:
median:
With Potions:
518
1142
601
580
Without Potions:
883
17722
1767
1103
Result: our pop-up is about twice as fast to display as Alltricks'.
L'Oréal x Propulse
Site loading time (in ms)
Statistic
min:
max:
average:
median:
With Potions:
4281
5912
4831
4746
Without Potions:
4414
6536
5150
5026
Result: The site loading time is not impacted by our solution.
Direct-Optic x Flashback
Site loading time (in ms)
Statistic
min:
max:
average:
median:
With Potions:
3495
4779
3622
3585
Without Potions:
3385
4616
3512
3490
Result: The site loading time is slightly impacted by our script but the difference never exceeds 110ms.
Wonderbox x Switch
Site loading time (in ms)
Statistic
min:
max:
average:
median:
With Potions:
3182
4509
3395
3365
Without Potions:
3236
9341
3560
3360
Result: The site loading time is not impacted by our solution.
Objetrama x Multiply
Site loading time (in ms)
Statistic
min:
max:
average:
median:
With Potions:
9258
18188
10310
9267
Without Potions:
9765
23648
11399
10397
Result: The site loading time is not impacted by our solution.
Appearance time of recommendations (in ms)
Statistic
min:
max:
average:
median:
With Potions:
220
464
300
301
Without Potions:
1091
2606
1478
1313
Result: our pop-up displays faster than that of FactFinder.