Bethlehem is a town in Albany County, New York, United States. The town's population was 35,034 at the 2020 census. Bethlehem is located immediately to the south of the city of Albany and includes the following hamlets: Delmar, Elsmere, Glenmont, North Bethlehem, Selkirk, Slingerlands, and South Bethlehem. U.S. Route 9W passes through t…Bethlehem is a town in Albany County, New York, United States. The town's population was 35,034 at the 2020 census. Bethlehem is located immediately to the south of the city of Albany and includes the following hamlets: Delmar, Elsmere, Glenmont, North Bethlehem, Selkirk, Slingerlands, and South Bethlehem. U.S. Route 9W passes through the town. The town is named after the biblical Bethlehem.