Use ImmutableSet in ShardManager