If you hit it near the wall the arrow is pointing at softly, it will say you went out of bounds even if you stay on course.
This has been fixed for the next update