We derive the stochastic equations and consider the non-Markovian dynamics of a system of multiple two-level atoms in a common quantum field. We make only the dipole approximation for the atoms and assume weak atom-field interactions. From these assumptions, we use a combination of non-secular open- and closed-system perturbation theory, and we abstain from any additional approximation schemes. These more accurate solutions are necessary to explore several regimes: in particular, near-resonance dynamics and low-temperature behavior. In detuned atomic systems, small variations in the system energy levels engender timescales which, in general, cannot be safely ignored, as would be the case in the rotating-wave approximation (RWA). More problematic are the second-order solutions, which, as has been recently pointed out (Fleming and Cummings 2011 Phys. Rev. E 83 031117), cannot be accurately calculated using any second-order perturbative master equation, such as RWA, Born-Markov, Redfield, etc. The latter problem, which applies to all perturbative open-system master equations, has a profound effect upon calculation of entanglement at low temperatures. We find that even at zero temperature all initial states will undergo finite-time disentanglement (sometimes termed sudden death ), in contrast to the previous work. We also use our solution, without invoking the RWA, to characterize the necessary conditions for Dicke subradiance at finite temperature. We find that the sub-radiant states fall into two categories at finite temperature: one that is temperature independent and one that acquires temperature dependence. With the RWA, there is no temperature dependence in any case.