If you're a sole trader, then you're not going through an agency (intermediary) so cannot be affected by IR35 (intermediary's legislation). See Qdos explanation here. What you have to be concerned about is whether you are not self-employed, but actually an employee - but it's the employer who has the liability.