Intrinsically photosensitive retinal ganglion cells (ipRGCs), which express the photopigment melanopsin, are photosensitive neurons in the retina and are essential for non-image forming functions, circadian photoentrainment, and pupillary light reflexes. Five subtypes of ipRGCs (M1-M5) have been identified in mice. Although ipRGCs are spared in several forms of inherited blindness, they are affected in Alzheimer's disease and aging, which are associated with impaired circadian rhythms. Huntington's disease (HD) is an autosomal neurodegenerative disease caused by the expansion of a CAG repeat in the huntingtin gene. In addition to motor function impairment, HD mice also show impaired circadian rhythms and loss of ipRGC. Here, we found that in HD mouse models (R6/2 and N171-82Q male mice), the expression of melanopsin was reduced prior to the onset of motor deficits. The expression of retinal T-box brain 2, a transcription factor essential for ipRGCs, was associated with the survival of ipRGCs. The number of M1 ipRGCs in R6/2 male mice was reduced due to apoptosis, while non-M1 ipRGCs were relatively resilient to HD progression. Most importantly, the reduced innervations of M1 ipRGCs, which was assessed by x-gal staining in R6/2-OPN4^Lacz/+ male mice, contributed to the diminished light-induced c-fos and vasoactive intestinal peptide in the suprachiasmatic nuclei (SCN), which may explain the impaired circadian photoentrainment in HD mice. Collectively, our results show that M1 ipRGCs were susceptible to the toxicity caused by mutant Huntingtin. The resultant impairment of M1 ipRGCs contributed to the early degeneration of the ipRGC-SCN pathway and disrupted circadian regulation during HD progression.