Now that a sizeable proportion of people are carrying GPS devices, it may be a good opportunity for a reasonably large-scale comparison. The obvious 'test bed' would be the coming Hundred, where there might be as many as 100 different devices whose results might be compared for both distance and ascent (and the subject of Janet's original post, namely the accuracy with which ascent is accounted for in total distance measured).
Surprisingly, this does not seem to have been done, at least not over long distances. One 2014 cycle-based test* by Jeff Barber ("GPS Distance Accuracy Test: Smartphone Apps vs. Dedicated GPS", URL below) compared results from each of ten different GPS devices over 10x2.5Km laps of a velodrome. He found that though the average error rate (for 9 of the 10 devices) was 3.7%, only 4 of the 10 were within 1%, and one - the Garmin 60CSx - was almost 10% out. Interestingly, all of the other 9 'accurate' devices over-reported the distance, a discrepancy which cannot be due to ascent (he kept to the centre lane in each trial).
According to OpenStreetMap**, GPS accuracy is determined by several factors including weather, but principally receiver quality, satellite positions, and surroundings. The latter can include buildings, tree cover and valleys:
"GPS requires a direct line of sight between the receiver and the satellite. When an object lies within the direct path, accuracy suffers due to reflections and weakening of signals. This is particularly problematic in urban environments, within valleys, and on mountain slopes. In all three situations, the objects (buildings and the Earth itself) are substantial enough to completely block the GPS signals. When weak signals are received, they may have been reflected [off buildings and] the surrounding landscape. Reflections generate multi-path signals arriving with a small time delay at the receiver. Even when the object is less substantial (tree cover, car roof, your body), reflection and weakening of signals may still occur. This can sometimes be observed when viewing your recorded GPS track logs on top of aerial imagery [...] When carrying a GPS device, generally, the higher the antenna is fixed, the better the reception. Good positions include the shoulder strap or the top pocket of a backpack ..."
It's not so surprising, then, that measurements might prove be relatively inaccurate (c.f. the claims made for them) when GPS devices are carried in jacket pockets (particularly those of short people like me!) on the varied terrain (which includes woods, forests and valleys, as well as 'slopes') typical of long walks. It appears to be still true that unless GPS tracking is switched off, continuous satellite movement will create additive readings even when the device is stationary. This might explain why distance error tends to be up (though it's not clear to me why this was true for the cyle-track test cited above).
What does seem clear is that GPS track logs will show a discrepancy when compared with aerial imagery. Since the latter (and NOT satellite readings) is the basis for digital mapping software, it is those maps which are still likely to give the most accurate measurements of distance, if not ascent (which remains as difficult to assess precisely as before).
So unless and until we have a proper comparison of a full range of carried GPS devices over several long distances (see above suggestion for this year's Hundred) you'd be better off taking your cumulative distance measurements from 'the map', whether on paper OR a screen, and reserve your handheld for 'quick and dirty' position checking on those rare occasions when you are "lost", or, more likely, off route. Three and a half miles out in a hundred seems like a lot to me !
Iain
*Devices tested:
2 wristwatches, 2 bar-mounted units, 3 smartphones, 1 GPS-equipped helmet camera, 1 handheld device, 1 tablet. Device makes: iPhone 5 (Strava), Asus Android Tablet (Strava), Garmin Forerunner 405CX, Magellan Cyclo505, iPhone 5(Garmin Fit), Garmin Edge 500, Garmin Fenix2, Nokia Lumia (GPS Logger), Garmin VIRB Elite,. Garmin 60CSx.
source: http://www.singletracks.com/blog/gps/gps-distance-accuracy-test-smartphone-apps-vs-dedicated-gps
** http://wiki.openstreetmap.org/wiki/Accuracy_of_GPS_data