Nope. It will be fine doing that. In fact, I've done this before.
You can wash, clay, compound, polish, seal one panel at a time if you'd like.
If you're doing this process one panel a week, maybe it's best to wash the entire car each time. That way your car is always clean lol! Or you...