4 yr relationship causing me mental stress....?

You are single,not married and you are free to do what you like unless property etc.is involved.I don't know why you are still with him.Does it matter who he goes out with after you have split up.I would say,good riddance and go out there and enjoy yourself until you meet Mr.Right.