Selective mobility into and out of neighborhoods is one of the driving forces of segregation. Empirical research has revealed who wants to leave certain types of neighborhoods or who leaves certain neighborhoods. A factor that has received little attention so far is that some residents will have the desire to leave their neighborhood, but are unable to do so. The residential mobility literature shows that the discrepancy between moving desires and actual mobility is larger for ethnic minorities than for natives. This paper uses a unique combination of register data and survey data. We combine data from a large housing survey in the Netherlands (WoON) with longitudinal register data from the Netherlands (SSB), which contains individual-level information on residential mobility histories. This allows us to study which households with a wish to leave their neighborhood are actually successful, and to which neighborhoods they move. A more thorough insight into who wants to leave which neighborhoods but is unable to do so will contribute to a better understanding of the drivers of segregation, especially in the context of the debate on voluntary segregation versus segregation due to a lack of choice. We find that ethnic minority groups are less likely to realize a desire to leave their neighborhood and that if they succeed in moving from an ethnic minority concentration or poverty neighborhood, they are more likely to end up in another minority concentration or poverty neighborhood than native residents.