Both are great, I don't know what is best for you with the limited info provided. For Deer & the occasional Elk, both are fine & we all know about the Swedes & Moose. The differerence is range, I don't mean how far you can hit an Elk as a good rifleman could hit one way out there, but I mean the range that each round has good terminal damage & energy. When both are loaded well the 6.5-06 will give you good Elk killing performance out further, so from just that alone the 6.5-06 wins. But there are other things to consider.
Swede pluses
1. Factory ammo
2. Barrel life
3. Recoil is less, but diff. is small
4. Factory chamberings, at least a few
5. Cheaper to set-up with dies, etc.
6. Better resale in most areas
6.5-06 pluses
1. Flatter trajectory
2. More energy, both have enough, but more at extended yardages.
3. Alot of brass sources with '06 based rounds
4. "Cool factor"
My Wife has used a M96 Sporter for more than 20 years & has taken at least 20
Whitails, a couple of Antelope. I have used it a few times & took a 300# S. AR. Hog
& a nice WT Buck with it as well. I like the 130Accubond alot, right mow I load
the 125 Partition for her with the local AR. hunts.
As a side note, I recently bought a Lipsey Number 1 in 264WM. I plan on using it next
fallin WY for Antelope & Mule Deer. My 25-06 AI Sendero is jealous, but just had to
have a new toy.