When I start my truck up, after its sat for a few hours, and I shift into reverse, it will either drift backwards or sit there (depending on resistance on the ground) but ignore my throttle for about a second. Its a bit odd to be drifting backwards but revving the gas somewhat.. then after about that second has passed it acknoledges it and goes.

Dirty filter or normal?

My bet is a dirty filter!