The unit group of $\mathbf F_p$ is simple exactly when $p-1$ is prime

Let p be a prime number and $\mathbf F_p$ be a finite field with p elements. Then the unit group $\mathbf F_p^\times=\mathbf F_p\setminus\{0\}$ of $\mathbf F_p$ is simple if and only if: