Use a Constellation Key to reset the Star Chart. This will return any used Celestial Spheres and remove any abilities gained from the Star Chart.

Star Chart