During my offline time I've still been thinking about modelling populations and similar effects. I've decided on a slightly different simulation approach than I used previously, and it's thrown up a question which might already have been studied. If anyone is already aware of work in this area I'd be very interested.

Suppose that we've got a stochastic dynamical system which is essentially only dependent on a finite "memory" of parameters (hence only influenced by "absolute time" in that certain system input variables might be dependent on absolute time, eg, that a catastrophic forest fire reducing food supplies happens in year 20 after the simulation starts). Then this for any set of data comprising a state (which may include historical datums or generalised velocities, etc) we can approximate the probability distribution of next states by running the simulation. If we do this for lots of states that we think are "likely states" then we've built up a lot of piecemeal information about the system, but is there any existing algorithms for calculating long-term probabilites of die-off, natural periods, etc? (For a discrete Markov chain you can look at things like power series in the transition matrix, but that assumes that you've got a finite set of states and have computed transition probs for all of them: is there a way more adapted to "sparsely sampled" transitions (since it's going to be computationally prohibitive to just approximate each transition by this method.)

Many thanks for any thoughts,