Do I need to sign up directly with UDP stores?

Yes. You enter a direct relationship with each of the UDP stores you distribute your games to. That said, UDP will link your store account with your Unity ID so that once you’re signed up to a store you can submit your game directly to it from UDP.