Right choice is (a) 11.870
To explain I would say: The resolution of a DVM is,
R = ^1⁄10^n
Here, n is 4. Substituting n=4 in the equation for resolution we get,
R = ^1⁄10^4 = 10^-4 = 0.0001
Since there are 5 digit places in the resolution, 11.87 which already has four digits is represented as 11.870.