[Background] The unique environment of the ocean creates a diversity of marine life, and bacteria in marine sediments play a vital role in the marine environment. [Objective] To study the similarities and differences of bacterial communities between terrestrial soil and marine sediments, so as to better understand the diversity of marine bacteria and the potential role of sediment bacteria in the marine environment. [Methods] Marine sediment samples and terrestrial soil samples were collected from the Yellow Sea waters of China and the Dahei Mountain in Dalian by 16S rRNA gene high-throughput sequencing technology. The bacterial community structure of marine sediments was analyzed by using terrestrial soil as a control. [Results] The abundance of Bacilli, Sphingomonas and Bacillus in marine sediment samples was higher than that in terrestrial soil samples. The abundance of uncultured bacterium f. Nitrosomonadaceae, and uncultured bacterium f. Anaerolineaceae in marine sediments is lower than that in terrestrial soil, but the abundance values are also higher than 1%. Sample taxonomic statistics show that the sequence abundance ratio of Acidobacteria in marine sediments and terrestrial soil samples is large, and the sequence abundance of Sphingomonas in marine sediment samples is greater than that of terrestrial soil samples. [Conclusion] Marine sediment bacteria diversity can be used as an important index of marine environment recovery, the study provides theoretical basis for rational development and utilization of marine resources.