Opened 13 years ago

Closed 13 years ago

#53 closed task (fixed)

Write documents describing exported data

Reported by: Nick Burch Owned by: Dominic Hargreaves
Priority: minor Milestone: Main release and major publicity
Component: Website Version:
Keywords: Cc:

Description

Should export in a similar format to currentlist from freethepostcode, to be run on a nightly basis.

We'll want the following:

  • freethepostcode only
  • npe only
  • outward (average)
  • outawrd + 1st inward (average)

Change History (7)

comment:1 Changed 13 years ago by Nick Burch

Owner: changed from Nick Burch to Dominic Hargreaves

Code committed to svn to do this - source:trunk/npemap.org.uk/scripts/export/

Need to set this up to be run on a nightly basis - Dom can you do this?

Probably just want three of the four exports for now:

  • -npeonly
  • -outer
  • -outer1

Once the nightly export is happening, we can link to them from the site

comment:2 Changed 13 years ago by Dominic Hargreaves

Status: newassigned

comment:3 Changed 13 years ago by Dominic Hargreaves

Hmm, we can start running this but I would like to improve it before we publish it.

In particular I would like to do some analysis when we average postcodes so that we can detect gross inaccuracies.

Eg of each record of an OX1 postcode, throw a warning if they are more than 10k apart (is 10k enough for the outward? Dunno, needs testing) and 1k for the outward (again might not be enough).

comment:4 Changed 13 years ago by Nick Burch

I think we should probably have the sanity checking in another application. We'll probably want it to show us where the postcodes are, so we can take a look and see if they look sane or not

I guess the app would run, find the averages, then report any postcodes past the threshold with a summary. From there, you can click through to visualise them (distance not too big, but high) or delete (distance shown to be massive)

comment:5 Changed 13 years ago by Nick Burch

Right, we now have http://www.npemap.org.uk/cgi/get-distant-postcodes.fcgi to report which postcodes look a bit out, based on the averages

comment:6 Changed 13 years ago by Dominic Hargreaves

Component: Support scriptsWebsite
Summary: Support basic export, similar to freethepostcode currentlistWrite documents describing exported data

http://www.npemap.org.uk/data/currentlist is being written daily, linked to from home page.

comment:7 Changed 13 years ago by Dominic Hargreaves

Resolution: fixed
Status: assignedclosed
Note: See TracTickets for help on using tickets.