Identifying and understanding patterns of biological diversity is crucial at a time when even the most remote and pristine marine ecosystems are threatened by resource exploitation such as deep-seabed mining. Metabarcoding provides the means through which one can perform comprehensive investigations of diversity by examining entire assemblages simultaneously. Nematodes commonly represent the most abundant infaunal metazoan group in marine soft sediments. In this meta-analysis, we compiled all publicly available metabarcoding datasets targeting the 18S rRNA v1-v2 region from sediment samples to conduct a global-scale examination of nematode amplicon sequence variant (ASV) alpha diversity patterns and phylogenetic community structure at different depths and habitats. We found that nematode ASV richness followed a parabolic trend, increasing from the intertidal to the shelf, reaching a maximum in the bathyal and decreasing in the abyssal zone. No depth- or habitat-specific assemblages were identified as a large fraction of genera were shared. Contrastingly, the vast majority of ASVs were unique to each habitat and/or depth zone; genetic diversity was thus highly localized. Overwhelmingly, nematode ASVs in all habitats exhibited phylogenetic clustering, pointing to environmental filtering as the primary force defining community assembly rather than competitive interactions. This finding stresses the importance of habitat preservation for the maintenance of marine nematode diversity.