COVID-19 represents the most serious public health event in the past few decades of the 21^st century. The development of vaccines, neutralizing antibodies, and small molecule chemical agents have effectively prevented the rapid spread of COVID-19. However, the continued emergence of SARS-CoV-2 variants have weakened the efficiency of these vaccines and antibodies, which brought new challenges for searching novel anti-SARS-CoV-2 drugs and methods. In the process of SARS-CoV-2 infection, the virus firstly attaches to heparan sulphate on the cell surface of respiratory tract, then specifically binds to hACE2. The S protein of SARS-CoV-2 is a highly glycosylated protein, and glycosylation is also important for the binding of hACE2 to S protein. Furthermore, the S protein is recognized by a series of lectin receptors in host cells. These finding implies that glycosylation plays important roles in the invasion and infection of SARS-CoV-2. Based on the glycosylation pattern and glycan recognition mechanisms of SARS-CoV-2, it is possible to develop glycan inhibitors against COVID-19. Recent studies have shown that sulfated polysaccharides originated from marine sources, heparin and some other glycans display anti-SARS-CoV-2 activity. This review summarized the function of glycosylation of SARS-CoV-2, discoveries of glycan inhibitors and the underpinning molecular mechanisms, which will provide guidelines to develop glycan-based new drugs against SARS-CoV-2.