If you’re in good full-time employment, it will always be difficult to give up that stability for what initially is a risky undertaking.
Being self-employed my situation is a little easier. If and when the affiliate business consistenly replaces my ‘day job’ income, I’ll start to switch attention towards it, one day at a time.
I’ll never completely give up my real job (I like it too much!) so if things go drastically wrong in the gambling world I can always expand it again. But a balance of 80% (affiliate) to 20% would suit me just fine!