1> The universe is observed to move in the direction of increasing entropy - I don't think we really know why (i.e. what is the force that impels the universe in that direction - except the momentum of the Big Bang which is still driving the bits of stuff that the universe is composed of apart at a fair rate of knots, downhill and with a following wind). But the point is entropy is what we see not why or how it happens.
Enformy or negentropy or whatever other term you want to use for the antithesis of entropy should, by analogy, be an observed phenomenon (the what, not the why or how) - and indeed it is - it is the observed phenomenon of (capacity for) system-building - a measure (perhaps) of the potential or capacity to produce useful systemic effects - of the (potential) components of the (potential) system.
2> Unfortunately, there does not seem to be any reliable way of actually measuring this potential in advance
3> So, really, I don't think enformy or negentropy or syntropy (Buckminster Fuller's preferred term) tell us anything more profound than Gibb's concept of "free energy" - i.e. that bodies have within them an inherent capacity to "do useful (system-building) work" despite the fact that the overall system(s) they are part of seem to be advancing inexorably in the direction of increasing entropy.
4> Unfortunately, despite the hopeful adoption and adaptation of these and other scientific ideas by New Agers etc., and as interesting, awe-inspiring and intriguing as it all is, none of it really gets us any closer to answering how or why?
perhaps we can only ever answer that for ourselves?
1__Entropy is not so mysterious. It's simply what happens when you blow something up---as in a Big Bang, or a piston engine. As condensed matter spreads-out over space, interactions between particles become fewer, and the whole thing becomes cooler until it simply fades away into . . . ??? By contrast, Enformy is a mystery, because new things self-assemble in an emergent process without any sign of external influence or divine intervention. A good illustration is a time-lapse video of a flower emerging from a stem---as-if it was filling-out a pre-formed formwork of a flower, but incrementally, and from the inside [see below]. Somehow a non-algorithmic code for Autopoesis is programmed into the mechanical system of matter & energy. How does blueprint DNA build living things from inert chemicals? Modern Science doesn't "see why" these things happen as they do, because the cause is holistic, and not amenable to reductive analysis.
2__The unpredictability of Enformy is what Kaufmann is referring to, in Reinventing The Sacred, when he calls Evolution "creative". Although he doesn't use that term, he goes to great lengths to show that the future path of any evolutionary process is non-algorithmic, hence non-calculable, and un-predetermined. Like Shannon's definition of Information, Enformy is a measure of order within statistical randomness .
3__Although evocative, the term Enformy alone tells us nothing useful for scientific purposes. But Enformy and Negentropy and Syntropy are based on insights that could form the kernel of a scientific theory of Emergence. As noted in some of the links above, the new science of Cybernetics is using these ideas in their research. Enformy is the science of the future, of where we're going, so it's path is inherently unpredictable.
Emergence : In philosophy, systems theory, science, and art, emergence is the way complex systems and patterns arise out of a multiplicity of relatively simple interactions. Emergence is central to the theories of integrative levels and of complex systems.
Cybernetics : Greek - the Steersman on a boat. The scientific study of communication and control processes in biological, mechanical, and electronic systems. The question remains, who is communicating, commanding, and controlling these mechanical processes? Who is the Cosmic Captain steering the vessel of Evolution?
4__Of course the Spritualist/New Agers are hoping that a positive uplifting holistic spiritual Science will replace the distasteful desecrating vivisectionist sciences of Modernism. But I think they will be surprised at how accommodating the scientific method is to holistic attitudes, as long as they lead to practical results. That remains to be seen. But for me, the notion of Enformy does seem to me to bring us a step closer to answering the "why?" questions you mentioned. And I'm referring to scientifically objective pragmatic answers, not just "god works in mysterious ways" subjective solutions to conundrums. As for the Final Answer, you'll just have to ask G*D next time you see H/er.
Emerging Flower video :
A life cycle from Enformy to Entropy