Hi, Danny, and welcome to the forum! We're glad you could join us.
I haven't done spidering myself via cron, but what you've outlined will work very well with phpDig. Sounds like you may already know how to do this, but there is some discussion about indexing like you're talking about
here in the documentation. I hope you'll find it useful.