Depends on your circumstances. I went self employed in 2023 and in hindsight was daft to wait that long. That said, I had a young family and the security of an employment contract was beneficial. As you mention you’ll get perks like sick pay, pension contributions and redundancy if things go awry. Also getting finance when self employed is a bit more restrictive.
The benefits of self employment are simple in that it’s significantly more lucrative. I more then doubled my pay for essentially doing the same job and have since grown it into my own business employing others that has changed my families life. They said, £2 per hour doesn’t seen much to offset the loss in pension contributions and the cost to admin your own affairs. I’d always encourage people to go out alone but it has its risks. Good luck with whatever you go for!