Spacecraft Formation Keeping and Reconfiguration Using Optimal Visual Servoing

Abstract This paper proposes a direct visual servoing system for spacecraft guidance in formation flying scenarios. The proposed image-based visual servoing system uses image information for planning and executing formation acquisition, reconfiguration, and maintenance maneuvers. The system assumes that LEDs are located at specific points on the satellites, enabling the visual servoing controller to rely on continuous tracking of these features in the camera’s image plane. Analytical developments demonstrate that the proposed optimal visual control system is stable and optimal, and it acts on both the orbital and attitude dynamics of the spacecraft, considering circular and elliptical reference orbits. The distributed image-based controller defines a cost function that minimizes control efforts, and the paper proses an optimal framework for developing controllers that address the issue. A ROS-based simulation tool was used to test the proposed visual servoing controller in a realistic small-sat formation flying scenario. Results indicate that the proposed distributed control strategy is viable and robust against environmental perturbations and disturbances in sensing and actuation.