I don't buy it. Are there any modern or recent essentially nomadic hunter/gatherer societies that have built large religious structures? Sure - the San bushmen have a religion and they painted rock shelter walls. Ditto the native Australians with their sand and bark paintings. So that is as far as the religious/spiritual imperative needs to be stretched and the parallel is with palaeolithic cave art.

With regard to substantial built structures of stone, it's a question of scale, ergonomics and economics. How can you assemble, feed and house a large workforce if you do not have food growing nearby and stored nearby? Hence grain pits. The only alternative is to fish or keep it on the hoof - ie pastoralism. Then you require drovers and drove routes and even corrals. The herds would need sufficient grazing and would need to breed sufficient young to replace those slaughtered and eaten. That is why I believe that agriculture is a pre-requisite of temple building and not a result of temple building.