The new app should already be live for most users. Unfortunately, the along with the new features come advertisements for the first time on the Apple TV.
Notably, Apple also pushed new UFC, The Scene, Fusion, and DailyMotion channels to the Apple TV today as well. You can check those out here.
More details on the improvements to the YouTube channel can be seen in the video and photos below.