Hey man, you commented in mine thread, and now it's my turn to comment in yours! Roxanne looks awesome, and you're having fun with her, so I say don't get rid of it.
I also have a 2004 Colorado z71 that I normally use as my daily driver. Originally, I was going to buy a commuter car and mod the Colorado to use for my off roading/camping/overlanding needs. I did the math though, and decided it was actually going to be cheaper in the long run to buy the Xterra, spend 2k or so modding it and getting it set up, than it would be to build the Colorado, buy another daily, and and keep fixing things as they break on the Colorado (which they do, because it just wasn't designed to be used as an overland truck).
Keep the xterra, buy truck, have fun, profit. That's my $.02.