Learning by observation for surgical subtasks: Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms

Adithyavairavan Murali, Siddarth Sen, Ben Kehoe, Animesh Garg, Seth McFarland, Sachin Patil, Walter D Boyd, Susan Lim, Pieter Abbeel, Ken Goldberg

Research output: Chapter in Book/Report/Conference proceedingConference contribution

51 Citations (Scopus)

Abstract

Automating repetitive surgical subtasks such as suturing, cutting and debridement can reduce surgeon fatigue and procedure times and facilitate supervised tele-surgery. Programming is difficult because human tissue is deformable and highly specular. Using the da Vinci Research Kit (DVRK) robotic surgical assistant, we explore a 'Learning By Observation' (LBO) approach where we identify, segment, and parameterize motion sequences and sensor conditions to build a finite state machine (FSM) for each subtask. The robot then executes the FSM repeatedly to tune parameters and if necessary update the FSM structure. We evaluate the approach on two surgical subtasks: debridement of 3D Viscoelastic Tissue Phantoms (3d-DVTP), in which small target fragments are removed from a 3D viscoelastic tissue phantom; and Pattern Cutting of 2D Orthotropic Tissue Phantoms (2d-PCOTP), a step in the standard Fundamentals of Laparoscopic Surgery training suite, in which a specified circular area must be cut from a sheet of orthotropic tissue phantom. We describe the approach and physical experiments with repeatability of 96% for 50 trials of the 3d-DVTP subtask and 70% for 20 trials of the 2d-PCOTP subtask. A video is available at: http://j.mp/Robot-Surgery-Video-Oct-2014.

Original languageEnglish (US)
Title of host publicationProceedings - IEEE International Conference on Robotics and Automation
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1202-1209
Number of pages8
Volume2015-June
EditionJune
DOIs
StatePublished - Jun 29 2015
Event2015 IEEE International Conference on Robotics and Automation, ICRA 2015 - Seattle, United States
Duration: May 26 2015May 30 2015

Other

Other2015 IEEE International Conference on Robotics and Automation, ICRA 2015
CountryUnited States
CitySeattle
Period5/26/155/30/15

Fingerprint

Tissue
Finite automata
Surgery
Robotics
Fatigue of materials
Robots
Sensors
Experiments

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence
  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Cite this

Murali, A., Sen, S., Kehoe, B., Garg, A., McFarland, S., Patil, S., ... Goldberg, K. (2015). Learning by observation for surgical subtasks: Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms. In Proceedings - IEEE International Conference on Robotics and Automation (June ed., Vol. 2015-June, pp. 1202-1209). [7139344] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICRA.2015.7139344

Learning by observation for surgical subtasks : Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms. / Murali, Adithyavairavan; Sen, Siddarth; Kehoe, Ben; Garg, Animesh; McFarland, Seth; Patil, Sachin; Boyd, Walter D; Lim, Susan; Abbeel, Pieter; Goldberg, Ken.

Proceedings - IEEE International Conference on Robotics and Automation. Vol. 2015-June June. ed. Institute of Electrical and Electronics Engineers Inc., 2015. p. 1202-1209 7139344.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Murali, A, Sen, S, Kehoe, B, Garg, A, McFarland, S, Patil, S, Boyd, WD, Lim, S, Abbeel, P & Goldberg, K 2015, Learning by observation for surgical subtasks: Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms. in Proceedings - IEEE International Conference on Robotics and Automation. June edn, vol. 2015-June, 7139344, Institute of Electrical and Electronics Engineers Inc., pp. 1202-1209, 2015 IEEE International Conference on Robotics and Automation, ICRA 2015, Seattle, United States, 5/26/15. https://doi.org/10.1109/ICRA.2015.7139344
Murali A, Sen S, Kehoe B, Garg A, McFarland S, Patil S et al. Learning by observation for surgical subtasks: Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms. In Proceedings - IEEE International Conference on Robotics and Automation. June ed. Vol. 2015-June. Institute of Electrical and Electronics Engineers Inc. 2015. p. 1202-1209. 7139344 https://doi.org/10.1109/ICRA.2015.7139344
Murali, Adithyavairavan ; Sen, Siddarth ; Kehoe, Ben ; Garg, Animesh ; McFarland, Seth ; Patil, Sachin ; Boyd, Walter D ; Lim, Susan ; Abbeel, Pieter ; Goldberg, Ken. / Learning by observation for surgical subtasks : Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms. Proceedings - IEEE International Conference on Robotics and Automation. Vol. 2015-June June. ed. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 1202-1209
@inproceedings{fbc50405c24c46c194df3502c160b007,
title = "Learning by observation for surgical subtasks: Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms",
abstract = "Automating repetitive surgical subtasks such as suturing, cutting and debridement can reduce surgeon fatigue and procedure times and facilitate supervised tele-surgery. Programming is difficult because human tissue is deformable and highly specular. Using the da Vinci Research Kit (DVRK) robotic surgical assistant, we explore a 'Learning By Observation' (LBO) approach where we identify, segment, and parameterize motion sequences and sensor conditions to build a finite state machine (FSM) for each subtask. The robot then executes the FSM repeatedly to tune parameters and if necessary update the FSM structure. We evaluate the approach on two surgical subtasks: debridement of 3D Viscoelastic Tissue Phantoms (3d-DVTP), in which small target fragments are removed from a 3D viscoelastic tissue phantom; and Pattern Cutting of 2D Orthotropic Tissue Phantoms (2d-PCOTP), a step in the standard Fundamentals of Laparoscopic Surgery training suite, in which a specified circular area must be cut from a sheet of orthotropic tissue phantom. We describe the approach and physical experiments with repeatability of 96{\%} for 50 trials of the 3d-DVTP subtask and 70{\%} for 20 trials of the 2d-PCOTP subtask. A video is available at: http://j.mp/Robot-Surgery-Video-Oct-2014.",
author = "Adithyavairavan Murali and Siddarth Sen and Ben Kehoe and Animesh Garg and Seth McFarland and Sachin Patil and Boyd, {Walter D} and Susan Lim and Pieter Abbeel and Ken Goldberg",
year = "2015",
month = "6",
day = "29",
doi = "10.1109/ICRA.2015.7139344",
language = "English (US)",
volume = "2015-June",
pages = "1202--1209",
booktitle = "Proceedings - IEEE International Conference on Robotics and Automation",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
edition = "June",

}

TY - GEN

T1 - Learning by observation for surgical subtasks

T2 - Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms

AU - Murali, Adithyavairavan

AU - Sen, Siddarth

AU - Kehoe, Ben

AU - Garg, Animesh

AU - McFarland, Seth

AU - Patil, Sachin

AU - Boyd, Walter D

AU - Lim, Susan

AU - Abbeel, Pieter

AU - Goldberg, Ken

PY - 2015/6/29

Y1 - 2015/6/29

N2 - Automating repetitive surgical subtasks such as suturing, cutting and debridement can reduce surgeon fatigue and procedure times and facilitate supervised tele-surgery. Programming is difficult because human tissue is deformable and highly specular. Using the da Vinci Research Kit (DVRK) robotic surgical assistant, we explore a 'Learning By Observation' (LBO) approach where we identify, segment, and parameterize motion sequences and sensor conditions to build a finite state machine (FSM) for each subtask. The robot then executes the FSM repeatedly to tune parameters and if necessary update the FSM structure. We evaluate the approach on two surgical subtasks: debridement of 3D Viscoelastic Tissue Phantoms (3d-DVTP), in which small target fragments are removed from a 3D viscoelastic tissue phantom; and Pattern Cutting of 2D Orthotropic Tissue Phantoms (2d-PCOTP), a step in the standard Fundamentals of Laparoscopic Surgery training suite, in which a specified circular area must be cut from a sheet of orthotropic tissue phantom. We describe the approach and physical experiments with repeatability of 96% for 50 trials of the 3d-DVTP subtask and 70% for 20 trials of the 2d-PCOTP subtask. A video is available at: http://j.mp/Robot-Surgery-Video-Oct-2014.

AB - Automating repetitive surgical subtasks such as suturing, cutting and debridement can reduce surgeon fatigue and procedure times and facilitate supervised tele-surgery. Programming is difficult because human tissue is deformable and highly specular. Using the da Vinci Research Kit (DVRK) robotic surgical assistant, we explore a 'Learning By Observation' (LBO) approach where we identify, segment, and parameterize motion sequences and sensor conditions to build a finite state machine (FSM) for each subtask. The robot then executes the FSM repeatedly to tune parameters and if necessary update the FSM structure. We evaluate the approach on two surgical subtasks: debridement of 3D Viscoelastic Tissue Phantoms (3d-DVTP), in which small target fragments are removed from a 3D viscoelastic tissue phantom; and Pattern Cutting of 2D Orthotropic Tissue Phantoms (2d-PCOTP), a step in the standard Fundamentals of Laparoscopic Surgery training suite, in which a specified circular area must be cut from a sheet of orthotropic tissue phantom. We describe the approach and physical experiments with repeatability of 96% for 50 trials of the 3d-DVTP subtask and 70% for 20 trials of the 2d-PCOTP subtask. A video is available at: http://j.mp/Robot-Surgery-Video-Oct-2014.

UR - http://www.scopus.com/inward/record.url?scp=84938235806&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84938235806&partnerID=8YFLogxK

U2 - 10.1109/ICRA.2015.7139344

DO - 10.1109/ICRA.2015.7139344

M3 - Conference contribution

AN - SCOPUS:84938235806

VL - 2015-June

SP - 1202

EP - 1209

BT - Proceedings - IEEE International Conference on Robotics and Automation

PB - Institute of Electrical and Electronics Engineers Inc.

ER -