Sure, that's why I didn't suggest that sitting in a dark room would be enough to dispel the theory. ("If this were true, then one could see during the night just as well as during the day, so Empedocles postulated an interaction between rays from the eyes and rays from a source such as the sun.")
I guess they could have argued that the rays of light returning from each object were perfect specular reflections that traveled directly back to the eyes that emitted them... but wow, that's still pretty hard to fathom, even for people who never heard of Occam's Razor.