Missing Data

  • 167 Views
  • Last Post 09 January 2018
Hank posted this 20 September 2017

I've been looking at the MIDAS datasets on this website but they don't tally with the data available through https://www.midas-data.org.uk/ in particular, the midas website seems to have more counters and more historic data.

Is there a reason why these counters aren't being displayed? And when will the map be updated to include them?

Order By: Standard | Newest | Votes
Shaun Ryan-Izzard posted this 29 September 2017

Please can you supply sites that appear on the Midas Dataset website that do not appear on the WebTRIS system. This can then be investigated to see why this might be an issue

Hank posted this 05 October 2017

I know that I can interrogate the site IDs through the api, could you let me know the best way to access a list of your sites held on the midas website?

Additionally, could you perform this reconciliation for the TAME and TMU sites?

Hank posted this 12 December 2017

Any chance of a response @Shaun Ryan-Izzard? 2 months for a simple query? Would it just be easier to raise this as a FOI?

Paul Watkins posted this 21 December 2017

Hi Hank,

Apologies for this. Could you contact myself at Paul.Watkins@highwaysengland.co.uk and I'll look to go through this with you. Suspect the work around this would take longer than we're allowed to put through an FOI so would be rejected, but we can look at this separately along with other reconciliation work we're performing on webtris.

Without looking at anything specific though. We don't take every single site into webtris. Not all sites are count enabled and not all sites pass validation checks (though we're waiting on extra data surrounding this from our supplier) so don't make it into webtris.

Paul

Hank posted this 02 January 2018

I very much doubt that it would cost £600 to query a database which you already hold...

Anyway... there is now a new category "legacy trads sites", are these the missing dataset which I first raised many months ago? 

 

Paul Watkins posted this 08 January 2018

Hank,

We have specifically limited time we can spend on FOIs and most reconciliation work does take longer than that once you get into the nitty gritty of having to fix it. That said I understand your frustration, we have the same feelings here. I have asked the MIDAS gold team to provide me with some data around their sites, and then I'll go through the RCC/NTIS layers in this data transfer. It's not as easy as just querying a database I'm afraid.

TRADS is historic data which wasn't covered under the new WebTRIS feed and resides on sites which may not be mapped across to the current set of sites. It's not the same as the original question in this forum, but I'll explain on the other thread you've raised for this.

Paul

Hank posted this 09 January 2018

The FOI would not cover a fix, it is just a request for data. 

The original question is why does the MIDAS data website have more data than this one. It appears because in the migration from TRADS to webtris a number of sites got dropped for reasons that are not entirely clear to me. 

I just want a complete 10 year data set. I want sites which had data under the old trads to appear so I can use them in my models and simulations. 

Close