Can I toggle the visibility of my translation team?

Yes, but only if you are the team leader. Translation teams can be public or visible to team members only. You can change your team's visibility from the "Edit team description" section of your team.