I dont know where Ivybridge is but the difference between 16 meg and 4 in terms of line length is only around 2 km. Remember this is the length of the line, which could take a roundabout route from exchange to house, and not the actual distance you are from the exchange.
Post up your router stats which will help to diagnose any problems you may have.