The Galilean satellites are visible as small points of light through a binocular but it must be mounted or held very steadily.
Hundreds of deep-sky objects are within the range of binoculars. As a matter of fact, a few of them such as the North America Nebula (NGC 7000) and the Pipe Nebula (LDN 1773) are best seen that way. However, dark skies are even more important for binocular observing than telescopic observing, however.
Binocular Astronomy
Having said that, if a person is primarily interested in solar system objects, starting out with a telescope is the way to go.
Dave Mitsky