They don't have to give up using them. They can use them while they have them then cut bait to get the next one. It's already happening so it wouldn't do much to balance the game, not as much as removing them altogether would do. People that spend $$ will still spend it to get that advantage, but everyone else would be on equal footing.
If they have only one worker and use it!
During this time, other teams can also hire a worker.
That way there will be workers for everyone
(Now there is a problem because you can have more than one worker at a time.
If the team can only have one! That changes everything!)