These are not "weaknesses." They are "disadvantages."
This isn't something I would change; I'm glad we don't play those teams. But it is absolutely a disadvantage if you are trying to win a championship. Not only does it essentially shorten your season by a game, but it gives valuable experience to your backups.
In my lists I specifically tried to list things that we could not or should not change.