The pole would basically be a space elevator. I suspect gravity and inertia would effectively keep you from moving the stick. Even if you could move it, you’d only be able to move it at a speed that would seem like it’s stationary. As such, the light would still be faster.