Tosho Hirasawa
平澤 寅庄
Research Engineer in the R&D Group at LayerX. I work on large language models — building agent systems on top of them, and studying how they can be applied and evaluated. Before that I was a researcher at OMRON SINIC X, and my Ph.D. was on multimodal machine translation.
- Emailtosho.hirasawa--at--gmail.com
- LinksGoogle Scholar·GitHub·X
Interests
- LLM-based Agent Systems (LLM を用いたエージェントシステム)
- LLM Application and Evaluation (大規模言語モデルの応用と評価)
- Natural Language Processing (自然言語処理)
- Multimodal Learning (マルチモーダル学習)
Career
- 2026–present Research Engineer, R&D Group, LayerX Inc.
- 2024–2026 Project Researcher, OMRON SINIC X
- 2023–2024 Research Intern, OMRON SINIC XConcurrent with graduate study
- 2018–2021 Collaborating Researcher, National Institute of Information and Communications Technology (NICT)Concurrent with graduate study
- 2011–2018 Software Engineer, Outlook Consulting Co., Ltd. (Tokyo / Singapore)
Education
- 2021–2024 Ph.D. in Information Science, Tokyo Metropolitan UniversityAdvised by Mamoru Komachi
- 2019–2021 M.S. in Computer Science, Tokyo Metropolitan University
- 2018–2019 Research Student, Tokyo Metropolitan University
- 2009–2011 Completed the first two years of the M.S. program in Science, Kyoto University
- 2004–2009 B.S. in Science, Kyoto University
Awards
- 2026 Outstanding Research Award (優秀研究賞). 情報処理学会 自然言語処理研究会 第268回研究発表会 — 予測分布の偏りに着目した CLIP のモダリティギャップ分析. 発表会
- 2026 Outstanding Research Award (優秀研究賞). 情報処理学会 自然言語処理研究会 第267回研究発表会 — LLM のユーモア評価能力に関する多次元分析. 一覧
- 2020 1st place, Video-guided Machine Translation (VMT) Challenge. The First Workshop on Advances in Language and Vision Research. certificate
Publications
All venues are listed together by year. Author lists follow the published order.
2026
- conference Assessing the Capabilities of LLMs in Humor: A Multi-dimensional Analysis of Oogiri Generation and Evaluation. Proceedings of the 40th AAAI Conference on Artificial Intelligence (AAAI-26). paperarXiv
- conference Evaluating the Capability of Video Question Generation for Expert Knowledge Elicitation. IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2026). paperarXiv
- conference CLIP のモダリティギャップは本当に埋めるべきか? 言語処理学会第32回年次大会 (NLP2026), 宇都宮. 論文
- conference 主張と根拠の繋がりを評価する科学論文レビュー評価指標. 言語処理学会第32回年次大会 (NLP2026), 宇都宮. 論文
- workshop 予測分布の偏りに着目した CLIP のモダリティギャップ分析. 情報処理学会 自然言語処理研究会 第268回研究発表会 (NL268), 一橋大学 — 優秀研究賞. 発表会
- workshop LLM のユーモア評価能力に関する多次元分析:大喜利評価における人間との乖離とバイアス. 情報処理学会 自然言語処理研究会 第267回研究発表会 (NL267) — 優秀研究賞.
- preprint HalDec-Bench: Benchmarking Hallucination Detector in Image Captioning. arXiv:2603.15253. arXiv
- preprint Am I More Pointwise or Pairwise? Revealing Position Bias in Rubric-Based LLM-as-a-Judge. arXiv:2602.02219. arXiv
- preprint WarrantScore: Modeling Warrants between Claims and Evidence for Substantiation Evaluation in Peer Reviews. arXiv:2601.17377. arXiv
2025
- conference 大規模言語モデルに対するチューニング手法の調査:内部のアクセス性に基づく分類と比較. 言語処理学会第31回年次大会 (NLP2025), 長崎. 論文
- conference Paper2Poster: LLM を用いた学術ポスターの生成. 言語処理学会第31回年次大会 (NLP2025), 長崎. 論文
- conference 根拠に基づいたレビュー生成のための LLM を用いた自動アノテーションの検討. 言語処理学会第31回年次大会 (NLP2025), 長崎. 論文
- workshop MK2 at PBIG Competition: A Prompt Generation Solution. Proceedings of the 2nd Workshop on Agent AI for Scenario Planning (AgentScen 2025), pp. 58–66. paperarXiv
- workshop SBS Figures: Pre-training Figure QA from Stage-by-Stage Synthesized Images. The AAAI-25 Workshop on Document Understanding and Intelligence. projectarXiv
- preprint SciPostGen: Bridging the Gap between Scientific Papers and Poster Layouts. arXiv:2511.22490. arXiv
2024
- thesis Multimodal Machine Translation as a Resource Scarcity Problem. Ph.D. thesis, Tokyo Metropolitan University.
- conference Pruning Multilingual Large Language Models for Multilingual Inference. Findings of the Association for Computational Linguistics: EMNLP 2024. paperarXiv
- conference COM Kitchens: An Unedited Overhead-view Video Dataset as a Vision-Language Benchmark. European Conference on Computer Vision (ECCV 2024), pp. 123–140. paperarXivcode
- conference DejaVu: Disambiguation evaluation dataset for English-JApanese machine translation on VisUal information. Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation (PACLIC 38). paper
- conference A Survey for LLM Tuning Methods: Classifying Approaches Based on Model Internal Accessibility. Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation (PACLIC 38). paper
- conference Large Language Models as Manga Translators: A Case Study. 言語処理学会第30回年次大会 (NLP2024), 神戸. paper
- conference 語義曖昧性解消に着目した英日マルチモーダル機械翻訳の評価セット構築と分析. 言語処理学会第30回年次大会 (NLP2024), 神戸. 論文
- workshop Toward Structured Related Work Generation with Novelty Statements. Proceedings of the Fourth Workshop on Scholarly Document Processing (SDP 2024). paper
- workshop OSX at Context24: How Well Can GPT Tackle Contexualizing Scientific Figures and Tables. Proceedings of the Fourth Workshop on Scholarly Document Processing (SDP 2024). paper
- workshop TMU-HIT at MLSP 2024: How Well Can GPT-4 Tackle Multilingual Lexical Simplification? Proceedings of the 19th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2024). paper
2023
- journal North Korean Neural Machine Translation through South Korean Resources. ACM Transactions on Asian and Low-Resource Language Information Processing, Volume 22, Issue 9. paper
- conference Visual Prediction Improves Zero-Shot Cross-Modal Machine Translation. Proceedings of the Eighth Conference on Machine Translation (WMT 2023), Singapore. paper
- conference Simultaneous Domain Adaptation of Tokenization and Machine Translation. Proceedings of the 37th Pacific Asia Conference on Language, Information and Computation (PACLIC 37), Hong Kong. paper
- conference Does Masked Language Model Pre-training with Artificial Data Improve Low-resource Neural Machine Translation? Findings of the Association for Computational Linguistics: EACL 2023, Dubrovnik. paper
- conference 視覚翻訳言語モデルを用いた英日マルチモーダル機械翻訳. 言語処理学会第29回年次大会 (NLP2023), 宜野湾. 論文コード
- conference マルチモーダル機械翻訳における画像・入力文間類似度と翻訳品質の相関の分析. 言語処理学会第29回年次大会 (NLP2023), 宜野湾. 論文
- conference ニューラル機械翻訳における単語分割器のドメイン適応. 言語処理学会第29回年次大会 (NLP2023), 宜野湾. 論文
- conference Decoder のみを用いた機械翻訳モデルの分析. 言語処理学会第29回年次大会 (NLP2023), 宜野湾. 論文
- workshop 語彙内トークンを媒介とした大規模言語モデルへのソフトプロンプトの転移. 情報処理学会 自然言語処理研究会 第257回研究発表会 (NL257), 東京. 発表会
2022
- journal Pre-Trained Word Embedding and Language Model Improve Multimodal Machine Translation: A Case Study in Multi30K. IEEE Access, Volume 10, pp. 67653–67668. paper
- journal Why Videos do not Guide Translations in Video-guided Machine Translation? An Empirical Evaluation of Video-guided Machine Translation Dataset. 情報処理学会論文誌 データベース (TOD), 15巻 2号. paper
- journal 事前学習モデルを用いた近代文語文のニューラル機械翻訳. 情報処理学会論文誌, 63巻 2号, pp. 269–282. 論文
- conference Construction of a Quality Estimation Dataset for Automatic Evaluation of Japanese Grammatical Error Correction. Proceedings of the Thirteenth Language Resources and Evaluation Conference (LREC 2022), Marseille. paperarXiv
- conference 人工データでの事前学習によるニューラル機械翻訳の性能向上. 言語処理学会第28回年次大会 (NLP2022), オンライン. 論文
2021
- workshop Machine Translation with Pre-specified Target-side Words Using a Semi-autoregressive Model. Proceedings of the 8th Workshop on Asian Translation (WAT 2021), pp. 68–73. paper
- workshop Sentence Concatenation Approach to Data Augmentation for Neural Machine Translation. Proceedings of the 2021 Conference of the NAACL: Student Research Workshop (NAACL SRW 2021). paper
- workshop Do Videos Guide Translations? Evaluation of a Video-Guided Machine Translation dataset. Proceedings of the Workshop on Visually Grounded Interaction and Language (ViGIL 2021). paper
- conference 日本語 BERT による否定表現認識についての分析. 言語処理学会第27回年次大会 (NLP2021), オンライン. 論文
- conference 事前学習モデルを用いた近代文語文の現代語機械翻訳. 言語処理学会第27回年次大会 (NLP2021), オンライン. 論文
- conference 2 文の連結を用いた機械翻訳におけるデータ拡張. 言語処理学会第27回年次大会 (NLP2021), オンライン. 論文
2020
- conference Neural Machine Translation from Historical Japanese to Contemporary Japanese Using Diachronically Domain-Adapted Word Embeddings. Proceedings of the 34th Pacific Asia Conference on Language, Information and Computation (PACLIC 34), Hanoi. paper
- conference Towards Multimodal Simultaneous Neural Machine Translation. Proceedings of the Fifth Conference on Machine Translation (WMT 2020). paperarXiv
- workshop Zero-shot North Korean to English Neural Machine Translation by Character Tokenization and Phoneme Decomposition. Proceedings of the 58th Annual Meeting of the ACL: Student Research Workshop (ACL SRW 2020), pp. 72–78. paper
- workshop Translation of New Named Entities from English to Chinese. Proceedings of the 7th Workshop on Asian Translation (WAT 2020), pp. 58–63. paper
- workshop TMU Japanese-English Multimodal Machine Translation System for WAT 2020. Proceedings of the 7th Workshop on Asian Translation (WAT 2020), pp. 80–91. paper
- workshop Korean-to-Japanese Neural Machine Translation System using Hanja Information. Proceedings of the 7th Workshop on Asian Translation (WAT 2020), pp. 127–134. paper
- workshop English-to-Japanese Diverse Translation by Combining Forward and Backward Outputs. Proceedings of the Fourth Workshop on Neural Generation and Translation (WNGT 2020), pp. 134–138. paper
- workshop Keyframe Segmentation and Positional Encoding for Video-guided Machine Translation Challenge 2020. The First Workshop on Advances in Language and Vision Research (ALVR 2020). arXivaward
- conference 韓国語対訳データを利用した文字分割と音素分解による朝鮮語ニューラル機械翻訳. 言語処理学会第26回年次大会 (NLP2020), オンライン. 論文
- conference 通時的な領域適応を行った単語分散表現を利用した古文から現代文へのニューラル機械翻訳. 言語処理学会第26回年次大会 (NLP2020), オンライン. 論文
2019
- conference Debiasing Word Embeddings Improves Multimodal Machine Translation. Proceedings of the 17th Machine Translation Summit (MT Summit 2019), Dublin. paperarXivposterboaster
- workshop Multimodal Machine Translation with Embedding Prediction. Proceedings of the 2019 Conference of the NAACL: Student Research Workshop (NAACL SRW 2019), Minneapolis. paperarXivcodeslides
- conference 事前学習した単語分散表現を利用したマルチモーダル機械翻訳. 言語処理学会第25回年次大会 (NLP2019), 名古屋. 論文ポスター