Right answer is (c) 2α = 2nπ ± π/4 + π/4
The explanation is: The given system have non-trivial solution if \(\begin{vmatrix}\beta & sin \alpha & cos \alpha \\1 & cos \alpha & sin \alpha \\ -1 & sin \alpha & -cos \alpha \end {vmatrix}\) = 0
On opening the determinant we get β = sin 2α + cos 2 α
Therefore, -√2 ≤ β ≤ √2
Now, for β = 1,
sin 2α + cos 2 α = 1
=> (1/√2)sin 2α + (1/√2) cos 2α = (1/√2)
Or, cos(2α – π/4) = 1/√2 = cos(2nπ ± π/4)
=> 2α = 2nπ ± π/4 + π/4