Introduction Asymptomatic optic nerve lesions are frequent in multiple sclerosis (MS) and their impact on cognition and/or brain volume has never been taken into account. Patients and methods We used the data from the cross-sectional Visual Ways in MS (VWIMS) study including relapsing remitting MS. All patients underwent brain and optic nerve Magnetic Resonance Imaging (MRI) including Double Inversion Recuperation (DIR) sequence, retinal OCT, and cognitive evaluation with the Brief International Cognitive Assessment in MS (BICAMS). We measured the association between OCT findings (thickness/volume of retinal layers) and extra-visual parameters (cerebral volumes and BICAMS scores) in optic nerves with and/or without the presence of DIR asymptomatic optic nerve hypersignal. Results Between March and December 2017, we included 98 patients. Two patients were excluded. Over the 192 eyes, 73 had at least one clinical history of optic neuritis (ON-eyes) whereas 119 were asymptomatic (NON-eyes). Among the 119 NON-eyes, 58 had 3D-DIR optic nerve hypersignal (48.7%). We confirmed significant associations between some retinal OCT measures and some extra-visual parameters (cerebral volumes, cognitive scores) in NON-eyes. Unexpectedly, these associations were found when an asymptomatic optic nerve DIR-hypersignal was present on MRI, but not when it was absent. Conclusion Our study showed a relation between OCT measures and extra-visual parameters in NON-eyes MS patients. As a confusion factor, asymptomatic optic nerve lesions may be the explanation of the relation between OCT measures and extra-visual parameters. Retinal OCT seems to be far more a “window over the optic nerve” than a “window over the brain”.