Thousands watched it in real life, and millions, including me, watched it on TV. Amateur astronomers and ham radio operators also tracked its progress and the TLI burn was probably observed by hundreds of people.
What is it that causes you to conclude we "might not have gone to the moon"?
Welcome to the BABB where lots of experts will help you understand why we could not have done anything other than go to the moon based on the evidence available.