Broadband

Ofcom and SamKnows have joined forces to help give consumers the most accurate picture ever of broadband performance across the UK. The research project will enable broadband users to compare the performance of the largest ISPs across a number of measures as well as highlighting overall regional variations.

Most previous measures of broadband performance have relied on software based speed tests. While these tests have a place in giving a snapshot of how a connection is performing, Sam is quick to point out that the joint research project with Ofcom will not be relying on software alone but will instead take data from dedicated hardware devices installed in homes around the country.

“Software speed tests on comparison websites or on ISP home pages which measure just throughput are okay but they’re limited, they don’t give the whole picture and you end up testing your kit as much as your broadband connection,” he says.

“Wireless laptops are commonplace in the UK now, and with headline broadband speeds approaching the theoretical speed limit of 802.11g (let alone real world speeds) we’re in danger of having the home network becoming the bottleneck for next generation connections. Of course, using a shared broadband connection whilst someone else is downloading data will also skew test results, as will using an old and slow PC.”

The hardware devices which make up the Ofcom and SamKnows performance network have been placed around the country by market research company GfK, on behalf of Ofcom, to ensure they give as comprehensive a picture of ISP performance as possible. The hardware boxes are connected to consumers’ routers and, each box will run over a thousand tests every month. Importantly, Sam insists, they will measure more than just connection speeds, because it is the overall quality of a connection that is paramount, not just its pace. Other factors such as latency, packet loss, DNS server availability, jitter and upstream speeds are also tested.

“Speed isn’t the only factor that should be considered when studying broadband performance,” Sam adds.

“Jitter, for example, is something that anyone using VoIP will need to keep an eye on because it can interfere with call quality and gamers will always concerned about latency because it can impact game performance. Packet loss is normally very low - in fractions of just one per cent - but we’re measuring it so we will know if any issues do arise.”

The SamKnows Performance Network has been received positively by ISPs who are equally eager to develop a standard methodology for benchmarking Broadband Performance (not just speed!). Virgin Media has commented that “only a hardware speed test solution which attaches to the customers modem, such as the hardware adopted by Ofcom and developed by SamKnows, is able to test the speed of a connection directly (thereby eliminating the issue of a shared connection and any limitations of a customer’s PC). And due to the range of tests that can be conducted, can give a far more accurate assessment of real world broadband performance, rather than just speed.”

Tags: GfK, OFCOM, performance, samknows