Amazon: Add only one seasson at a time?

I somehow managed to do this once and can't seem to do it again...

I would like to add just a single season of a multiple season show to a show's folder in my Now Playing list. After watching the episode, I was able to delete it from the folder. This way, with the episode names displayed, I wouldn't have to remember which episode was up next.