I have been looking through the ONS geographic data on their Geo Portal and there are acronyms and variables everywhere so I thought it best to understand what they all mean. Whenever I refer to the output areas and super output areas I’m referring to the ones as at the 2011 census in England and Wales.
One of the most frequent tasks I do is summarising data using either proc sql or proc means with code like this:
proc means data=inputdata nway missing noprint; class var1 var2; var var3 var4; output out=outputdata (drop = _type_ _freq_) sum=; run;
Given that I use it in SAS a lot I’m going to assume that I’ll use it in R a lot so it seems like the next sensible thing to learn.
It’s time to start some analysis, albeit very basis analysis. I want to look at the interaction between the ONS Rural score and the average Broadband speed. This will be done using the postcode file created in my previous post. I’m assuming that the more rural a place is the slower its broadband will be. Is this actually the case?
The aim of this exercise is to learn so R skills not do some rigorous analysis. This means that some rather broad and potentially foolish assumptions will be made with the data to make some things easier to code given my novice R skills.
I thought I’d take a look at the RSS (Royal Statistical Society ) “Statistical Analytics Challenge” after being sent it at work today. It involves analysing eye movement on 60 pictures.
Whilst I’m not going to enter the competition I am going to have a go and see how far I get. My plan goes something like this:
- Read the image into R
- Split it into a grid
- Initially a large grid and then progressively smaller ones
- Calculate some properties of each of the grid cells
- Check how each of these properties correlate with where the eye movement points are
- Check the properties of the surrounding grid cells relative the current cell
- See how these new properties interact with the eye movements.
- Do each of the above for a number of pictures to come up with a model and then test this on one of the other pictures.
Following on from my previous post on creating a postcode file with the 2015 general election results I wanted to create a larger file with more variables. Some from the ONS lookups, others from different public datasets. The one I have added so far is the Office of Communications Broadband Coverage dataset from 2013.
The final dataset will contain for each postcode in the UK:
- The 2015 general election result
- The Westminster Election Constituency
- The Easting and Northing coordinates
- Census lookup areas
- Rural Indicator
- Broadband coverage data
- Which (if any) national park the postcode is in
Over the past year I've been having a play mapping things in Excel, not the best tool for doing this I know but it does the trick. Mapping the data directly from Excel has the advantage that I've my data is already in Excel. I would like to do the same exercise in R but that's for another day once I get to know R better.
My output looks like this:
Which looks pretty good to me.