Jiwan Kim

prof_pic.jpg

Ph.D. student in Industrial & Systems Engineering at KAIST.

I am Jiwan Kim, a Ph.D. student in the Department of Industrial & Systems Engineering at KAIST, where I am advised by Prof. Chanyoung Park at the Data Science and Artificial Intelligence Lab (DSAIL). I received my M.S. degree from KAIST under the same advisor, and my B.S. degree in Statistics (major) and Computer Science (double major) from Seoul National University.


🔬 Core Research Focus

Efficient Multimodal Large Language Models (MLLMs)

My primary research focuses on building high-performance yet efficient multimodal LLMs (image and video) at both training and inference time, and leveraging them to solve real-world deployment challenges.

Keywords: Multimodal LLM, Knowledge Distillation, Visual Token Pruning, On-Device AI

Key Focus:

  • On-Device MLLM: efficiency for both training and inference
    • Knowledge Distillation: effective training to strengthen small MLLMs
    • Visual Token Pruning & Compression: taming large visual-token cost at inference
  • MLLM Applications
    • Agentic & Tool-Integrated MLLM: agent / tool-use ability for small MLLMs
    • Autonomous Driving, Vision-Language-Action (VLA)

Previous Research: Recommendation Systems

Multimodal and LLM-based recommender systems — generating missing modalities, building token-efficient item representations, and understanding user behavior with LLMs.

News

  • May 2026 đź“„

    Two papers were accepted at ECCV 2026, including a first-author paper (DSTP).

  • Mar 2026 đź“„

    I started my Ph.D. in Industrial & Systems Engineering at KAIST (DSAIL).

  • Jan 2026 đź“„

    Two papers were accepted at ICLR 2026, including a first-author paper (CompoDistill).

  • May 2025 đź“„

    A paper (Lost in Sequence) was accepted at KDD 2025.

  • Apr 2025 đź“„

    A first-author paper (DGMRec) was accepted at SIGIR 2025.

selected publications

  1. ECCV
    Why and When Visual Token Pruning Fails? A Study on Relevant Visual Information Shift in MLLMs Decoding
    Jiwan Kim, Kibum Kim, Wonjoong Kim, Byung-Kwan Lee, and Chanyoung Park
    European Conference on Computer Vision (ECCV), 2026
  2. ICLR
    CompoDistill: Attention Distillation for Compositional Reasoning in Multimodal LLMs
    Jiwan Kim, Kibum Kim, Sangwoo Seo, and Chanyoung Park
    International Conference on Learning Representations (ICLR), 2026
  3. SIGIR
    Disentangling and Generating Modalities for Recommendation in Missing Modality Scenarios
    Jiwan Kim, Hongseok Kang, Sein Kim, Kibum Kim, and Chanyoung Park
    ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2025