Chat connecting lags client

[Fomortiis]

Hello.
I have an issue with the client, when I start it it automatically connects and disconnects from chat (the dot in the bottom right switches from red to green).
This causes the client to lag to an unusable state (10-15 seconds between me clicking the vault tab and the tab coming up for example).
This only happens some times at random intervals, my internet connection might have to do something with this, I can play with friends fine tho.

Is there a fix for this issue, or if nothing else is there a way to stop the client from trying to reconnect automatically?
Thanks.