Hm, so I have my viewport moving around but only by preloading the map with cells. (how I do it on my old project).
Problem is, I need to swap out the cells depending on the Z-axis. So maybe the way I'm doing that (maintaining a list of surfaces I swap between) is "wrong". Ah well, closer at least.