I used to hear that quite often as well.
I’ve never had a problem doing both. Back when I offered SEO as a service, I used to work on my sites and my clients’ websites. Often times, there’s only so much you can do in terms of SEO at once, so spending that free time working with clients can bring in some extra revenue.