😃 About me

I graduated from the Daegu Gyeongbuk Institute of Science & Technology (DGIST) with a B.S. in Computer Engineering in 2019 and from Korea Advanced Institute of Science& Technology (KAIST) with a M.S. in Electric Engineering in 2021. I decided to continue my education and pursue a Ph.D. in the field of Artificial Intelligence/Deep Learning. I am currently working under the guidance of Professor Chang D. Yoo, whose expertise and leadership have been invaluable to my research.

My research focuses on the reliability of Artificial Intelligence/Deep Learning technologies for various modalities, including images, videos, and natural language. I am passionate about exploring the potential of these technologies and finding ways to improve their performance and reliability in real-world applications. Here is CV for more information about me.

📌 Research Interests

  • Computer Vision
  • Natural Language Processing
  • Multi-modal Reasoning
  • Causality and Debiasing
  • Generative AI

🔥 News

  • 2024.10:  🎉 Winner of Datathon Award, 2nd Seoul National University Bundang Hospital (SNUBH) Datathon, 1st Prize ($2,000)
  • 2024.09:  🎉 One paper accepted to Neurips 2024
  • 2024.07:  🎉 Two papers accepted to ECCV 2024
  • 2024.05:  🎉 One paper accepted to ICML 2024

🏫 Education

  • Mar.2021 - Current: Ph.D candidate Electrical Engineering (KAIST)

   Advisor: Prof. Chang D. Yoo

  • Sep.2019 - Feb.2021: M.S. Electrical Engineering (KAIST)

   Thesis: “Video-Language Alignment Network for Weakly-Supervised Video Moment Retrieval”

   Advisor: Prof. Chang D. Yoo

  • Mar.2015 - Feb.2019: B.S. Computer Engineering (DGIST)

📎 Selected Publications

[9] Sunjae Yoon , Gwanhyeong Koo, Younghwan Lee, and Chang D. Yoo, “TPC: Test-time Procrustes Calibration for Diffusion-based Human Image Animation”, Neural Information Processing Systems (NeurIPS) 2024

[8] Sunjae Yoon , Gwanhyeong Koo, Ji Woo Hong, and Chang D. Yoo, “Dilutional Noise Initialization for Diffusion Video Editing”, European Conference on Computer Vision (ECCV) 2024

[7] Sunjae Yoon , Gwanhyeong Koo, Geonwoo Kim, and Chang D. Yoo, “FRAG: Frequency Adaptive Group for Diffusion Video Editing”, International Conference on Machine Learning (ICML) 2024

[6] Sunjae Yoon , Dahyun Kim, Eunseop Yoon, Hee Suk Yoon, Junyeong Kim, and Chang D. Yoo, “HEAR: Hearing Enhanced Audio Response for Viode-grounded Dialogue”, Empirical Methods in Natural Language Processing (EMNLP) 2023 (long paper, findings)

[5] Sunjae Yoon , Gwanhyeong Koo, Dahyun Kim, and Chang D. Yoo “SCANet: Scene Complexity Aware Network for Weakly-supervised Video Moment Retrieval”, International Conference on Computer Vision (ICCV) 2023

[4] Sunjae Yoon , Ji Woo Hong, SooHwan Eom, Hee Suk Yoon, Eunseop Yoon, Daehyeok Kim, Junyeong Kim, Chanwoo Kim, and Chang D. Yoo, “Counterfactual Two-stage Debiasing Network for Video Corpus Moment Retrieval”, The International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023, Oral

[3] Sunjae Yoon , Eunseop Yoon, Hee Suk Yoon, Junyeong Kim, and Chang D. Yoo “Information-Theoretic Text Hallucination Reduction for Video-grounded Dialogue”, Empirical Methods in Natural Language Processing (EMNLP), 2022. (long paper)

[2] Sunjae Yoon , Ji Woo Hong, Eunseop Yoon, Dahyun Kim , Junyeong Kim, Hee Suk Yoon, and Chang D. Yoo, “Selective Query-guided Debiasing for Video Corpus Moment Retrieval”, European Conference on Computer Vision (ECCV) 2022

[1] Minuk Ma *, Sunjae Yoon *, Junyeong Kim, Youngjuoon Lee, Sunghun Kang, and Chang D. Yoo, “VLANet: Video-Language Alignment Network for Weakly-Supervised Video Moment Retrieval”, European Conference on Computer Vision (ECCV) 2020 (equal contribution)

📝 Publications

[*] equal contribution

2024

Neurips 2024
sym

[C18] TPC: Test-time Procrustes Calibration for Diffusion-based Human Image Animation

Sunjae Yoon , Gwanhyeong Koo, Younghwan Lee, and Chang D. Yoo

Neural Information Processing Systems (NeurIPS) 2024

ECCV 2024
sym

[C17] Dilutional Noise Initialization for Dilution Video Editing

Sunjae Yoon , Gwanhyeong Koo, Ji Woo Hong, and Chang D. Yoo

European Conference on Computer Vision (ECCV) 2024

ECCV 2024
sym

[C16] FlexiEdit: Frequency-Aware Latent Refinement for Enhanced Non-Rigid Editing

Gwanhyeong Koo, Sunjae Yoon , Ji Woo Hong, and Chang D. Yoo

European Conference on Computer Vision (ECCV) 2024

ICML 2024
sym

[C15] FRAG: Frequency Adapting Group for Diffusion Video Editing

Sunjae Yoon , Gwanhyeong Koo, Geonwoo Kim, and Chang D. Yoo

International Conference on Machine Learning (ICML), 2024

[code] [page]

ICPRAI 2024
sym

[C14] Character Identifying Video Language Alignment Network for Weakly-Supervised Video-Subtitle Moment Retrieval

Donghoon Lee ∗, Jun Yeop Shim ∗, Sunjae Yoon , and Chang D Yoo

International Conference on Pattern Recognition and Artificial Intelligence (ICPRAI), 2024, Oral

IEEE Access 2024
sym

[J4] Causal Localization Network for Radar Human Localization with micro-Doppler signature

Sunjae Yoon , Gwanhyeong Koo, Jun Yeop Shim, Soohwan Eom, Ji Woo Hong, Chang D. Yoo

[code]

IEEE Access, 2024

ICASSP 2024
sym

[C13] WAVELET-GUIDED ACCELERATION OF TEXT INVERSION IN DIFFUSION-BASED IMAGE EDITING

Gwanhyeong Koo, Sunjae Yoon , Chang D. Yoo

The International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024

AAAI 2024
sym

[C12] SimPSI: A Simple Strategy to Preserve Spectral Information in Time Series Data Augmentation

Hyun Ryu, Sunjae Yoon , Hee Suk Yoon, Eunseop Yoon, and Chang D. Yoo

AAAI Association for the Advancement of Artificial Intelligence (AAAI) 2024

[code]

2023

EMNLP 2023
sym

[C11] HEAR: Hearing Enhanced Audio Response for Viode-grounded Dialogue

Sunjae Yoon , Dahyun Kim, Eunseop Yoon, Hee Suk Yoon, Junyeong Kim, and Chang D. Yoo

Empirical Methods in Natural Language Processing (EMNLP) 2023 (long paper, findings)

[code]

ICCV 2023
sym

[C10] SCANet: Scene Complexity Aware Network for Weakly-supervised Video Moment Retrieval

Sunjae Yoon , Gwanhyeong Koo, Dahyun Kim, and Chang D. Yoo

International Conference on Computer Vision (ICCV) 2023

ICASSP 2023
sym

[C9] Counterfactual Two-stage Debiasing Network for Video Corpus Moment Retrieval

Sunjae Yoon , Ji Woo Hong, SooHwan Eom, Hee Suk Yoon, Eunseop Yoon, Daehyeok Kim, Junyeong Kim, Chanwoo Kim, and Chang D. Yoo

The International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023, Oral

Access 2023
sym

[J3] Joint Path Alignment Framework for 3D Human Pose and Shape Estimation from Video

Ji Woo Hong, Sunjae Yoon , Junyeong Kim, and Chang D. Yoo

IEEE Access, 2023

ICLR 2023
sym

[C8] ESD: EXPECTED SQUARED DIFFERENCE AS A TUNING-FREE TRAINABLE CALIBRATION MEASURE

Hee Suk Yoon, Joshua Tian Jin Tee , Eunseop Yoon, Sunjae Yoon , Gwangsu Kim, Yingzhen Li, and Chang D. Yoo

International Conference on Learning Representation (ICLR), 2023

2022

EMNLP 2022
sym

[C7] Information-Theoretic Text Hallucination Reduction for Video-grounded Dialogue

Sunjae Yoon , Eunseop Yoon, Hee Suk Yoon, Junyeong Kim, and Chang D. Yoo

Empirical Methods in Natural Language Processing (EMNLP), 2022. (long paper)

EMNLP 2022
sym

[C6] SMSMix: Sense-Maintained Sentence Mixup for Word Sense Disambiguation

Hee Suk Yoon , Eunseop Yoon , John Harvill, Sunjae Yoon , Mark Hasegawa-Johnson, and Chang D. Yoo

Empirical Methods in Natural Language Processing (EMNLP), 2022. (short paper, findings)

ECCV 2022
sym

[C5] Selective Query-guided Debiasing for Video Corpus Moment Retrieval

[code]

Sunjae Yoon , Ji Woo Hong, Eunseop Yoon, Dahyun Kim , Junyeong Kim, Hee Suk Yoon, and Chang D. Yoo

European Conference on Computer Vision (ECCV) 2022

Access 2022
sym

[J2] Cascaded MPN: Cascaded Moment Proposal Network for Video Corpus Moment Retrieval

Sunjae Yoon , Dahyun Kim, Junyeong Kim, and Chang D. Yoo

IEEE Access 2022

ICASSP 2022
sym

[C4] SEMANTIC ASSOCIATION NETWORK FOR VIDEO CORPUS MOMENT RETRIEVAL

Dahyun Kim *, Sunjae Yoon *, Ji Woo Hong, and Chang D. Yoo

The International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022. Oral

Sensors 2022
sym

[J1] Dual-Scale Doppler Attention for Human Identification

[code]

Sunjae Yoon , Dahyun Kim, Ji Woo Hong, and Chang D. Yoo

MDPI Sensors, 2022

2021

AAAI 2021
sym

[C3] Structured Co-reference Graph Attention for Video-grounded Dialogue

Junyeong Kim, Sunjae Yoon , Dahyun Kim, and Chang D. Yoo

AAAI Association for the Advancement of Artificial Intelligence (AAAI), 2021

ICIP 2021
sym

[C2] WEAKLY-SUPERVISED MOMENT RETRIEVAL NETWORK FOR VIDEO CORPUS MOMENT RETRIEVAL

[code]

Sunjae Yoon *, Dahyun Kim *, Ji Woo Hong, Junyeong Kim, Kookhoi Kim and Chang D. Yoo

International Conference on Image Processing (ICIP), 2021

2020

ECCV 2020
sym

[C1] VLANet: Video-Language Alignment Network for Weakly-Supervised Video Moment Retrieval

Minuk Ma *, Sunjae Yoon *, Junyeong Kim, Youngjuoon Lee, Sunghun Kang, and Chang D. Yoo

European Conference on Computer Vision (ECCV) 2020

Academic Activities

💬 Invited Talks

  • 2023.05, CAU-AI 핵심 기술세미나, Empirical Methods and Recent Topics for Video Moment Retrieval, (2023-05-19)

🏆 Awards

  • Winner of Datathon Award, 2nd Seoul National University Bundang Hospital (SNUBH) Datathon Award, 1st Prize ($2,000) (2024.10)

  • 30th Samsung HumanTech Paper Award, encouragement prize ($1,500) (2024.02)

  • Winner of Best Paper Award, Winter Conference of Korean Artificial Intelligence Association (KAIA), ($1,500), (2023.11)

  • ‘Governor citation’ from the governor of DAEGU CITY DALSEONG GUN (2019.02)

  • Award Bronze Prize for International University Creative Car Competition (Autonomous driving) by Korea Transportation Safety Authority, (2018.05)

  • Award Excellence Prize in Autonomous Vehicle Creation Technology by Korea Auto Vehicle Safety Association, (2018.05)

📑 Reviewer

Confernce

  • Neural Information Processing Systems (Neurips): 2023 ~

  • IEEE Conference on Computer Vision and Pattern Recognition (CVPR) : 2022 ~

  • European Conference on Computer Vision (ECCV): 2022 ~

  • IEEE International Conference on Computer Vision (ICCV) : 2023 ~

  • The Association for the Advancement of Artificial Intelligence (AAAI) : 2025 ~

  • Association for Computational Linguistics (ACL): 2023 ~

  • Empirical Methods on Natural Language Processing (EMNLP): 2022 ~

  • International Conference on Learning Representations (ICLR): 2024 ~

  • International Conference on Machine Learning (ICML): 2024 ~

  • International Conference on Acoustics, Speech, and Signal Processing (ICASSP): 2023 ~

  • IEEE/CVF Winter Conference on Applications of Computer Vision (WACV): 2023 ~

  • International Conference on Artificial Intelligence and Statistics (AISTATS): 2025 ~

Journal

  • IEEE Transactions on Big Data

  • IEEE Transactions on Circuits and Systems for Video Technology

🎏 Patent

  • Selective Query-guided Debiasing for Video Corpus Moment Retrieval No. KR 10-2022-0154621 (2022-11-17)

  • WEAKLY-SUPERVISED MOMENT RETRIEVAL NETWORK FOR VIDEO CORPUS MOMENT RETRIEVAL No. KR 10-2021-0172582 (2021-12-06)

  • Artificial Intelligence-based Radar Target Detection System No. KR 10-2021-0013581 (2021-01-29)