Your optics choice may be the limiting factor. A reasonable quality, reasonable magnification variable power scope will bring out good groups, an Aimpoint or EO Tech type, even with a magnifier, can't do nearly as well, at least for me, but they are quick at close range.
To shoot the smallest possible groups takes more scope than I like to hunt with, and it takes a finer reticle than I want to hunt with too. For my AR it would take a new trigger too though the OEM trigger is fine for hunting.
FWIW, though relatively new to the 223/5.56, I find more variability in 223 factory ammo than factory ammo for any other cartridge. For example, I was shooting some Federal 55gr FMJ the other day out of two rifles and accuracy was so poor I went over each rifle looking for what was loose. Nothing was loose! Switched to some Fiocchi 50gr V-Max and groups shrunk dramatically for both rifles.
I didn't think I wanted to reload for the 223 since ammunition is plentiful now, and there is a wide selection of very reasonably priced ammo, but now I am thinking about it.
JPK