Do games have to be added to an Arcade in order for players to battle each other?

Yes, to do this you will add the game to your Arcade in the Activities section. If you click on the Select Activities field near the top, you will see all the games you created in your Arcade. Simply select the game you’d like to use and click the +Add button to place it into your Arcade. Then hit the Save button when you are finished.