A rate distortion function is a
(a) Concave function
(b) Convex function
(c) Increasing function
(d) None of the mentioned
This question was posed to me during an online interview.
Question is taken from Codes and Coding Technique in portion Error Detection & Channel Coding of Digital Communications