The one thing that was definitely improved are the Clara scenes
Iruma kun thread
Nolan Price
Nolan Bailey
I wouldn't worry about it. Most harems are self-inserting trash. This is written by a woman, so I'd be more worried about it going full fujo than it becoming a harem.