Conversational interaction is becoming ubiquitous, offering new opportunities to make digital content more accessible and inclusive. While numerous guidelines exist in the literature to inform the design of conversational interfaces, these typically focus on "standalone"voice agents or chatbots. In this survey, we explore guidelines for conversational web browsing, a paradigm in which the conversational interface acts as a middleman between users and web pages. We survey the literature on conversational interaction and web accessibility to map design guidelines for accessible and inclusive voice interaction with web content.