In our experiment we are asking volunteers to judge the relevance of a particular text label (pre-selected automatically by our system) to a random map from a test collection (kindly provided by the US Library of Congress, and mass-tiled using our very own MagickTiler). Users can also add their own labels to the maps if they see fit.
The task is simple, quick, and it's actually fun, too! (And, by the way, also a nice way to discover some hidden gems in the LoC's map collection!) So in case you want to join - head over to our study portal right now, sign up for an account, and get started!
There's also a second stage in our experiment. It will be about map annotation, will open very soon, and I'll cover it in one of the next posts. You can already catch a first glimpse of it here, though.