We study stochastic dynamic games with a large number of players, where players are coupled via their cost functions. A standard solution concept for stochastic games is Markov perfect equilibrium (MPE). In MPE, each player's strategy is a function of its own state as well as the state of the other players. This makes MPE computationally prohibitive as the number of players becomes large. An approximate solution concept called oblivious equilibrium (OE) was introduced in , where each player's decision depends only on its own state and the "long-run average" state of other players. This makes OE computationally more tractable than MPE. It was shown in  that, under a set of assumptions, as the number of players become large, OE closely approximates MPE. In this paper we relax those assumptions and generalize that result to cases where the cost functions are unbounded. Furthermore, we show that under these relaxed set of assumptions, the OE approximation result can be applied to large population linear quadratic Gaussian (LQG) games .