Task colors that show in the Calendar View depend on their parent lists' colors. We'd recommend you to pick a color for each new list when creating.
If you want to set/change a color for an existing list, go to the edit page of this list and make your selection.