We have traveled fulltime with 3 children (now ages 5-11) for 3 years now.
We have loved it and with the exception of San Francisco I have not found most RV parks to be crowded.
I am sitting here in my summer campground in PA with a big yard and lots of open spaces.
Your biggest issue will be to decide what kind of RV you want to travel in.
We chose a Class A so that the kids had access to their beds and to the bathroom while we were driving.
I could also feed them lunch or dinner if hubby was driving.
Now that we have slowed our travels down, we have decided to sell our RV and buy a custom fifth wheel so that we won't have an engine sitting for months not being used. However, when we move from place to place the kids will be stuck in a pickup. So you will have to decide how long will you be traveling versus how long will you be set up in one location to see what is best for your family.
You might also find that your needs change, like ours did.
Good luck on discovering your sense of adventure!