Wrong side of the tracks
This is an American expression from the 1920s for the poorer or lower class part of town. The allusion is to the railroads that eventually ran into every American town and city. Steam engines in those days were dirty, smoke belching machines and prevailing winds generally carried the pollution to one side of the tracks. This affected the relative value of real estate on both sides of the tracks and caused divisions in society based on wealth and class.