Nope! With a lot of gacha games the 5* you get from the gacha itself is just as powerful as if you were to get 3* and raise it to 5*. It just saves you a lot of resources.
Actually many gacha games do set their best units to only drop at 4* or 5*, and they're much better than the units that you can get at 3* that cap off at 4* or 5* by a significant margin.