Ironically, not recruiting any 4* or 5*, and picking only 3* or lower to save hope for 6* is considered a pretty valid strategy and is most often used as advice for getting far in most of them.
Of course, if you still aren't having fun then you shouldn't force yourself to do it.