I also have a more-than full time job, and my website does suffer because of that. Like you, any time I have to work on the site has been pure content and design changes – little is done to fiddle with fickle search engine rankings (besides proper page design and coding).
Google does however give me the best results, however this is only because of the sheer volume of Google users – not that Google has a better algo and SERPs.