SamKnows & Ofcom

Way back in 2008 SamKnows partnered with Ofcom to carry out a comprehensive study of broadband provider performance, a follow-up from our own study completed in August of that year. In both cases SamKnows defined and funded the technical solution with the objective of creating a data set which would enable consumers to have the best possible understanding of the broadband performance delivered by the UK's leading ISPs.

We're quite frankly delighted to announce that we're embarking on another project for 2010 this time as part of a two-year study taking us through to April 2012 - a period during which we believe consumers can expect significant changes in broadband performance as faster next-generation services are launched.

We're on the lookout for UK broadband consumers to join our community, if you're interested please click here and fill out our short registration form.

Below are some FAQs in relation to the project with Ofcom.

• How did you start working with Ofcom?
• When did it start?
• What tests are performed?
• Why are you doing it?
• Can panellists see their own individual results?

How did you start working with Ofcom?

Back in 2008 when they heard of our own project, Ofcom, the UK communications regulator, invited us in for a cup of tea and a chat about our 'solution'. A team at Ofcom had been scoping a project to examine actual broadband performance, and there was a clear fit with SamKnows' own objectives. To cut a long story short, Ofcom selected SamKnows as its technical partner in the project, and SamKnows provided the methodology and funded the deployment in order to make the project happen. The results of the 2008 project can be found here.

This was never going to be a one off for us here at SamKnows and when Ofcom indicated that they wished to undertake another even more comprehensive and in-depth study we offered our services once again.

When did it start?

The latest study kicked off in late February 2010 with national press coverage and an initial appeal for participants to join the SamKnows Ofcom community.

If you're reading this midway through the study however, don't hesitate to sign up - we're fully expecting to require participants to get involved throughout the two year process, just follow this link and fill out the short form.

What tests are performed?

We are currently performing the following tests:

1. Latency (ICMP based)
2. Packet loss (ICMP based)
3. DNS query resolution time
4. DNS query failure rate
5. Web page loading time
6. Web page failure rate
7. VoIP call quality (MOS)
8. VoIP call jitter, delay, packet loss
9. SMTP relaying speed
10. Web based download speed test (HTTP)
11. Web based upload speed test (HTTP)
12. Non web-based download speed test
13. Non web-based upload speed test
14. Single-stream download speed test
15. Multi-stream download speed test
16. Single-stream upload speed test
17. Multi-stream upload speed test

Tests 1-6 above are performed against common UK-based internet destinations. The speed tests, VoIP tests and SMTP relaying tests are performed against a cluster of our own test servers which we change periodically and load balance to ensure sufficient capacity. We are always developing new tests and u can upgrade the existing units with new testing profiles remotely once they are ready for production use.

Why are you doing it?

We think our CEO, Alex Salter sums it up best:

"What started out as a project to monitor and report on the UK's broadband connectivity has turned into a national project backed by not only the UK ISPs, but also the government and media. We're delighted that so many consumers have joined us in our campaign and we're grateful for their continued support."

In essence we're looking for clarity, honesty and accountability between what the UK broadband consumer is being sold and what's being delivered.

Can panellists see their own individual results?

Yes, we provide a secure site where community members can log in and view their own reports. During the course of the study we'll also be sending out updates which will include national and ISP specific results.