Keisuke Shirai

About Me

Hi, I am Keisuke Shirai, a postdoctoral researcher at National Institute of Advanced Industrial Science and Technology (AIST). I received my PhD from Kyoto University, where I was supervised by Shinsuke Mori. My research interests include natural language processing, multimedia, and robotics.

Publications

Conferences, Workshops, and Preprints

• Masaki Murooka, Tomohiro Motoda, Ryoichi Nakajo, Hanbit Oh, Koshi Makihara, Keisuke Shirai, Yukiyasu Domae.
  RoboManipBaselines: A Unified Framework for Imitation Learning in Robotic Manipulation across Real and Simulated Environments.
  ArXiv. September 2025.
  [Paper] [Project website]

• Tomohiro Motoda, Koshi Makihara, Ryoichi Nakajo, Hanbit Oh, Keisuke Shirai, Ryo Hanai, Masaki Murooka, Yuma Suzuki, Hiroki Nishihara, Mitsuru Takeda, Takumi Takada, Takayuki Hori, Yukiyasu Domae.
  Recipe for Vision-Language-Action Models in Robotic Manipulation: A Survey.
  TechRxiv. August 2025.
  [Paper]

• Jeremy Siburian*, Keisuke Shirai*, Cristian C. Beltran-Hernandez*, Masashi Hamaya, Michael Görner, Atsushi Hashimoto.
  Grounded Vision-Language Interpreter for Integrated Task and Motion Planning.
  ArXiv. June 2025.
  [Paper] [Project Website]

• Tomohiro Nishimoto, Taichi Nishimura, Koki Yamamoto, Keisuke Shirai, Hirotaka Kameko, Yuto Haneji, Tomoya Yoshida, Keiya Kajimura, Taiyu Cui, Chihiro Nishiwaki, Eriko Daikoku, Natsuko Okuda, Fumihito Ono, Shinsuke Mori.
  BioVL-QR: Egocentric Biochemical Vision-and-Language Dataset Using Micro QR Codes.
  International Conference on Image Processing (ICIP). September 2025.
  [Paper] [Dataset] [Project Website]

• Edgar Anarossi, Yuhwan Kwon, Hirotaka Tahara, Shohei Tanaka, Keisuke Shirai, Masashi Hamaya, Cristian C. Beltran-Hernandez, Atsushi Hashimoto, Takamitsu Matsubara.
  KeyMPs: One-Shot Vision-Language Guided Motion Generation by Sequencing DMPs for Occlusion-Rich Tasks.
  IEEE Access. July 2025.
  [Paper]

• Yuto Haneji, Taichi Nishimura, Hirotaka Kameko, Keisuke Shirai, Tomoya Yoshida, Keiya Kajimura, Koki Yamamoto, Taiyu Cui, Tomohiro Nishimoto, Shinsuke Mori.
  EgoOops: A Dataset for Mistake Action Detection from Egocentric Videos with Procedural Texts.
  International Workshop on Skilled Activity Understanding, Assessment and Feedback Generation (SAUAFG). October 2025.
  [Paper] [Dataset] [Project Website]

• Keyaki Ohno, Hirotaka Kameko, Keisuke Shirai, Taichi Nishimura, Shinsuke Mori.
  Automatic Construction of a Large-Scale Corpus for Geoparsing Using Wikipedia Hyperlinks.
  Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING). May 2024.
  [Paper] [Code]

• Keisuke Shirai, Cristian C. Beltran-Hernandez, Masashi Hamaya, Atsushi Hashimoto, Shohei Tanaka, Kento Kawaharazuka, Kazutoshi Tanaka, Yoshitaka Ushiku, Shinsuke Mori.
  Vision-Language Interpreter for Robot Task Planning.
  International Conference on Robotics and Automation (ICRA). May 2024.
  [Paper] [Code] [Project Website]

• Keisuke Shirai, Hirotaka Kameko, Shinsuke Mori.
  Towards Flow Graph Prediction of Open-Domain Procedural Texts.
  Workshop on Representation Learning for NLP (RepL4NLP). July 2023.
  [Paper] [Dataset]

• Keisuke Shirai, Atsushi Hashimoto, Taichi Nishimura, Hirotaka Kameko, Shuhei Kurita, Yoshitaka Ushiku, Shinsuke Mori.
  Visual Recipe Flow: A Dataset for Learning Visual State Changes of Objects with Recipe Flows.
  International Conference on Computational Linguistics (COLING). October 2022.
  [Paper] [Dataset] [Tool]

• Kento Tanaka, Taichi Nishimura, Hiroaki Nanjo, Keisuke Shirai, Hirotaka Kameko, Masatake Dantsuji.
  Image Description Dataset for Language Learners.
  Language Resources and Evaluation Conference (LREC). June 2022.
  [Paper]

• Keisuke Shirai, Kazuma Hashimoto, Akiko Eriguchi, Takashi Ninomiya, Shinsuke Mori.
  Neural Text Generation with Artificial Negative Examples.
  ArXiv. December 2020.
  [Paper]

Journals

• Keisuke Shirai, Hirotaka Kameko, Shinsuke Mori.
  Flow Graph Prediction of Open-Domain Procedural Texts (in Japanese).
  Journal of Natural Language Processing. June 2024.
  [Paper]

• Keisuke Shirai, Atsushi Hashimoto, Taichi Nishimura, Hirotaka Kameko, Shuhei Kurita, Shinsuke Mori.
  Visual Recipe Flow: A Dataset for Learning Visual State Changes of Objects with Recipe Flows (in Japanese).
  Journal of Natural Language Processing. September 2023.
  [Paper]

• Keisuke Shirai, Masato Matsuzaki, Shinsuke Mori, Makoto Goto.
  Knowledge Extraction from a Biographical Dictionary (in Japanese).
  IPSJ Journal. February 2022.
  [Paper]

• Keisuke Shirai, Kazuma Hashimoto, Akiko Eriguchi, Takashi Ninomiya, Shinsuke Mori.
  Neural Text Generation with Artificial Negative Examples to Address Repeating and Dropping Errors.
  Journal of Natural Language Processing. September 2021.
  [Paper]

• Shoichiro Hara, Taizo Yamada, Masatoshi Ishikawa, Keisuke Shirai, Akihiro Kameda, Shinsuke Mori.
  Prototyping Information System to Extract Area Study Information from Web Big Data.
  International Journal of Geoinformatics. June 2019.
  

Work Experience

Contact

• shirai.keisuke.l82 [at] kyoto-u.jp