That's what we did with our kids. Meanwhile their friends used training wheels and took far longer to be able to ride independently. Removing the unnecessary training aid speeds up their skill development by a huge margin.