Concentrated animal-feeding operations (CAFOs) emit pollution into surrounding areas, and previous research has found associations with poor health outcomes. The objective of this study was to investigate if home proximity to poultry CAFOs during pregnancy is associated with adverse birth outcomes, including preterm birth (PTB) and low birth weight (LBW). This study includes births occurring on the Eastern Shore, Virginia, from 2002 to 2015 (N = 5768). A buffer model considering CAFOs within 1 km, 2 km, and 5 km of the maternal residence and an inverse distance weighted (IDW) approach were used to estimate proximity to CAFOs. Associations between proximity to poultry CAFOs and adverse birth outcomes were determined by using regression models, adjusting for available covariates. We found a −52.8 g (−95.8, −9.8) change in birthweight and a −1.51 (−2.78, −0.25) change in gestational days for the highest tertile of inverse distance to CAFOs. Infants born with a maternal residence with at least one CAFO within a 5 km buffer weighed −47 g (−94.1, −1.7) less than infants with no CAFOs within a 5 km buffer of the maternal address. More specific measures of exposure pathways via air and water should be used in future studies to refine mediators of the association found in the present study.