With significant progress being made toward improving endoscope technology such as capsule endoscopy and robotic endoscopy, the development of advanced strategies for manipulating, controlling, and more generally, easing the accessibility of these devices for physicians is an important next step. This article presents an autonomous navigation strategy for use in endoscopy, utilizing a state-dependent region estimation approach to allow for multimodal control design. This region estimator is evaluated for its accuracy in predicting yaw angle of the camera relative to the lumen center, and for estimating the location of the camera based on overall haustra morphology within the colon. To assess the utility of this region estimator, multimodal control is used to allow for autonomous navigation of the Endoculus, a robotic capsule endoscope, within a benchtop, to-scale, simulated colon. The estimation approach is presented and tested, demonstrating successful tracking of fixed velocity rotations at speeds up to 40^circ/s and allowing for curve anticipation approximately 10 cm before entering a curved section of the simulator. Finally, the multimodal control strategy utilizing this estimator is tested within the simulator over a variety of anatomic configurations. This strategy proves successful for navigation in both straight sections of this simulator and in tightly curved sections as small as 8 cm radius of curvature, with average velocities reaching 2.61 cm/s in straight sections and 0.99 cm/s in curved sections.

Objective: Robotic endoscopes have the potential to dramatically improve endoscopy procedures, however current attempts remain limited due to mobility and sensing challenges and have yet to offer the full capabilities of traditional tools. Endoscopic intervention (e.g., biopsy) for robotic systems remains an understudied problem and must be addressed prior to clinical adoption. This paper presents an autonomous intervention technique onboard a Robotic Endoscope Platform (REP) using endoscopy forceps, an auto-feeding mechanism, and positional feedback. Methods: A workspace model is established for estimating tool position while a Structure from Motion (SfM) approach is used for target-polyp position estimation with the onboard camera and positional sensor. Utilizing this data, a visual system for controlling the REP position and forceps extension is developed and tested within multiple anatomical environments. Results: The workspace model demonstrates accuracy of 5.5% while the target-polyp estimates are within 5 mm of absolute error. This successful experiment requires only 15 seconds once the polyp has been located, with a success rate of 43% using a 1 cm polyp, 67% for a 2 cm polyp, and 81% for a 3 cm polyp. Conclusion: Workspace modeling and visual sensing techniques allow for autonomous endoscopic intervention and demonstrate the potential for similar strategies to be used onboard mobile robotic endoscopic devices. Significance: To the authors' knowledge this is the first attempt at automating the task of colonoscopy intervention onboard a mobile robot. While the REP is not sized for actual procedures, these techniques are translatable to devices suitable for in vivo application.