For remote travel, it's definatelly Australia. For rock crawling and tough trails I would say the US has the upper hand. In terms of people and support I think both countries are great.
Depending on the type of adventures you enjoy one country may be slightly better than the other