My instinct is that as you fly toward Earth at near the speed of light, earth-bound stopwatches will appear to be going nearly double their normal speed. As you fly away from Earth, the stopwatches will slow to a crawl approaching standstill.
This illustrates a fundamental misunderstanding of time dilation. Direction has no impact, and this example that is often used is terrible for illustrating what is being proposed re. time dilation, because it just has to do with the perception of time as it relates to light reflecting off of a clock within certain frames of reference.
I was saying the opposite. The claim of time dilation has nothing to do with the visual perception of clocks, which is a common (flawed) example that is used. The visual perception of clocks differing by heading towards or away from a clock is just a phenomenon akin to the Doppler effect.
If you correct for this effect caused by changing distance between the parties, you will still observe a difference in passage of time in the two different inertial frames of reference (each observing the other). In both cases the party taking the measurement will observe that time is passing more slowly in the frame of reference that the measurer sees as moving with respect to the measurer's frame, regardless of whether that motion is toward or away from the measurer.
There is no difference between you moving with velocity X and the other party moving with velocity -X; or you moving with velocity 2X and the other party being stationary; or you being stationary and the other party moving with velocity -2X. There is no experiment you can perform that will tell the difference.