PSU Turns On Then Off

CPU and cooler connected to motherboard. Ram installed, and an SSD. I plugged the motherboard power cable into the PSU (EVGA 1300 g2). I then plugged in the power switch to the motherboard and clicked the button. I heard a click from the PSU and the fan started to spin, the CPU cooler fan also started to spin. Then seconds later the PSU clicked again, CPU and PSU turned off. I have unplugged the GPUs and they're not the problem. Any suggestions?

EDIT - either the motherboard or the CPU is the issue. I tried a different power supply and it had the same effect.

Motherboard - H81 Pro BTC R2.0
CPU - Intel celeron G1840