If you take the geodesic form of the Lagrange equations, then you can take the starting positions and generalized velocities and keep parallel transporting the velocities along themselves. That will produce a solution that AFAICT is always physical and the process does not require solving an optimization problem.