Lucky skywatchers who spotted a rare daylight meteor streaking across the Victorian sky might never see one again in their lifetime, said one astronomer.