Bug 2330

It will help to know what is downloaded, how many times, how much, and from where; and report this somewhere public (see bug 1308). Today we don't know.

It's not to gather and munch figures just for the sake of it, but to know and report what's happening and if there's some pattern of interest in that (per ISO product, package, package media, installs, updates, mirror location, whole download size or pattern, etc.).

What is downloaded today that interest us:
 - ISO images (through http://www.mageia.org/downloads/ , other index pages or directly from mirrors).
 - packages (for install or updates; through web indexes, direct links or directly from mirrors; manually or by system tools).

We have two main sources to know that:
 - our own www downloads page, which redirects to mirror; but this is limited to ISOs and visitors going to mageia.org;
 - download mirrors themselves, which actually distribute the files.

We need to find a way to gather sanitized/normalized logs [1] in a single place [2] for later queries reports [3].

[1] depends on download mirrors software logging formats
[2] need to merge logs in a single format?
[3] what good tool for that can we have? (related to above)

The goal of this bug is to list what's available, what are the things to take care of [4], and how we can do that.

[4] for instance:
 * privacy, by translating IP addresses into broad geo info, useful enough (city/country?);
 * some mirrors won't send us their logs, some would, some may have requirements or need packaged tools for that; and because of that, stats will stay indicative until we have enough mirrors joining in this.

This relates to the mirrors admins mailing-list and db, so we can start to know:
 - which ones would be interested in this;
 - what software they use, and if they log downloads, what the log format is and how sanitizing/retrieving this log could be done.