😃 About me
I graduated from the Daegu Gyeongbuk Institute of Science & Technology (DGIST) with a B.S. in Computer Engineering in 2019 and from Korea Advanced Institute of Science& Technology (KAIST) with a M.S. in Electric Engineering in 2021. I decided to continue my education and pursue a Ph.D. in the field of Artificial Intelligence/Deep Learning. I am currently working under the guidance of Professor Chang D. Yoo, whose expertise and leadership have been invaluable to my research.
My research focuses on the reliability of Artificial Intelligence/Deep Learning technologies for various modalities, including images, videos, and natural language. I am passionate about exploring the potential of these technologies and finding ways to improve their performance and reliability in real-world applications. Here is CV for more information about me.
📌 Research Interests
- Computer Vision
- Natural Language Processing
- Multi-modal Reasoning
- Causality and Debiasing
- Generative AI
🔥 News
- 2024.10: 🎉 Winner of Datathon Award, 2nd Seoul National University Bundang Hospital (SNUBH) Datathon, 1st Prize ($2,000)
- 2024.09: 🎉 One paper accepted to Neurips 2024
- 2024.07: 🎉 Two papers accepted to ECCV 2024
- 2024.05: 🎉 One paper accepted to ICML 2024
🏫 Education
- Mar.2021 - Current: Ph.D candidate Electrical Engineering (KAIST)
Advisor: Prof. Chang D. Yoo
- Sep.2019 - Feb.2021: M.S. Electrical Engineering (KAIST)
Thesis: “Video-Language Alignment Network for Weakly-Supervised Video Moment Retrieval”
Advisor: Prof. Chang D. Yoo
- Mar.2015 - Feb.2019: B.S. Computer Engineering (DGIST)
📎 Selected Publications
[9] Sunjae Yoon , Gwanhyeong Koo, Younghwan Lee, and Chang D. Yoo, “TPC: Test-time Procrustes Calibration for Diffusion-based Human Image Animation”, Neural Information Processing Systems (NeurIPS) 2024
[8] Sunjae Yoon , Gwanhyeong Koo, Ji Woo Hong, and Chang D. Yoo, “Dilutional Noise Initialization for Diffusion Video Editing”, European Conference on Computer Vision (ECCV) 2024
[7] Sunjae Yoon , Gwanhyeong Koo, Geonwoo Kim, and Chang D. Yoo, “FRAG: Frequency Adaptive Group for Diffusion Video Editing”, International Conference on Machine Learning (ICML) 2024
[6] Sunjae Yoon , Dahyun Kim, Eunseop Yoon, Hee Suk Yoon, Junyeong Kim, and Chang D. Yoo, “HEAR: Hearing Enhanced Audio Response for Viode-grounded Dialogue”, Empirical Methods in Natural Language Processing (EMNLP) 2023 (long paper, findings)
[5] Sunjae Yoon , Gwanhyeong Koo, Dahyun Kim, and Chang D. Yoo “SCANet: Scene Complexity Aware Network for Weakly-supervised Video Moment Retrieval”, International Conference on Computer Vision (ICCV) 2023
[4] Sunjae Yoon , Ji Woo Hong, SooHwan Eom, Hee Suk Yoon, Eunseop Yoon, Daehyeok Kim, Junyeong Kim, Chanwoo Kim, and Chang D. Yoo, “Counterfactual Two-stage Debiasing Network for Video Corpus Moment Retrieval”, The International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023, Oral
[3] Sunjae Yoon , Eunseop Yoon, Hee Suk Yoon, Junyeong Kim, and Chang D. Yoo “Information-Theoretic Text Hallucination Reduction for Video-grounded Dialogue”, Empirical Methods in Natural Language Processing (EMNLP), 2022. (long paper)
[2] Sunjae Yoon , Ji Woo Hong, Eunseop Yoon, Dahyun Kim , Junyeong Kim, Hee Suk Yoon, and Chang D. Yoo, “Selective Query-guided Debiasing for Video Corpus Moment Retrieval”, European Conference on Computer Vision (ECCV) 2022
[1] Minuk Ma *, Sunjae Yoon *, Junyeong Kim, Youngjuoon Lee, Sunghun Kang, and Chang D. Yoo, “VLANet: Video-Language Alignment Network for Weakly-Supervised Video Moment Retrieval”, European Conference on Computer Vision (ECCV) 2020 (equal contribution)
📝 Publications
[*] equal contribution
2024
[C18] TPC: Test-time Procrustes Calibration for Diffusion-based Human Image Animation
Sunjae Yoon , Gwanhyeong Koo, Younghwan Lee, and Chang D. Yoo
Neural Information Processing Systems (NeurIPS) 2024
[C17] Dilutional Noise Initialization for Dilution Video Editing
Sunjae Yoon , Gwanhyeong Koo, Ji Woo Hong, and Chang D. Yoo
European Conference on Computer Vision (ECCV) 2024
[C16] FlexiEdit: Frequency-Aware Latent Refinement for Enhanced Non-Rigid Editing
Gwanhyeong Koo, Sunjae Yoon , Ji Woo Hong, and Chang D. Yoo
European Conference on Computer Vision (ECCV) 2024
[C15] FRAG: Frequency Adapting Group for Diffusion Video Editing
Sunjae Yoon , Gwanhyeong Koo, Geonwoo Kim, and Chang D. Yoo
International Conference on Machine Learning (ICML), 2024
[C14] Character Identifying Video Language Alignment Network for Weakly-Supervised Video-Subtitle Moment Retrieval
Donghoon Lee ∗, Jun Yeop Shim ∗, Sunjae Yoon , and Chang D Yoo
International Conference on Pattern Recognition and Artificial Intelligence (ICPRAI), 2024, Oral
[J4] Causal Localization Network for Radar Human Localization with micro-Doppler signature
Sunjae Yoon , Gwanhyeong Koo, Jun Yeop Shim, Soohwan Eom, Ji Woo Hong, Chang D. Yoo
IEEE Access, 2024
[C13] WAVELET-GUIDED ACCELERATION OF TEXT INVERSION IN DIFFUSION-BASED IMAGE EDITING
Gwanhyeong Koo, Sunjae Yoon , Chang D. Yoo
The International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024
[C12] SimPSI: A Simple Strategy to Preserve Spectral Information in Time Series Data Augmentation
Hyun Ryu, Sunjae Yoon , Hee Suk Yoon, Eunseop Yoon, and Chang D. Yoo
AAAI Association for the Advancement of Artificial Intelligence (AAAI) 2024
2023
[C11] HEAR: Hearing Enhanced Audio Response for Viode-grounded Dialogue
Sunjae Yoon , Dahyun Kim, Eunseop Yoon, Hee Suk Yoon, Junyeong Kim, and Chang D. Yoo
Empirical Methods in Natural Language Processing (EMNLP) 2023 (long paper, findings)
[C10] SCANet: Scene Complexity Aware Network for Weakly-supervised Video Moment Retrieval
Sunjae Yoon , Gwanhyeong Koo, Dahyun Kim, and Chang D. Yoo
International Conference on Computer Vision (ICCV) 2023
[C9] Counterfactual Two-stage Debiasing Network for Video Corpus Moment Retrieval
Sunjae Yoon , Ji Woo Hong, SooHwan Eom, Hee Suk Yoon, Eunseop Yoon, Daehyeok Kim, Junyeong Kim, Chanwoo Kim, and Chang D. Yoo
The International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023, Oral
[J3] Joint Path Alignment Framework for 3D Human Pose and Shape Estimation from Video
Ji Woo Hong, Sunjae Yoon , Junyeong Kim, and Chang D. Yoo
IEEE Access, 2023
[C8] ESD: EXPECTED SQUARED DIFFERENCE AS A TUNING-FREE TRAINABLE CALIBRATION MEASURE
Hee Suk Yoon, Joshua Tian Jin Tee , Eunseop Yoon, Sunjae Yoon , Gwangsu Kim, Yingzhen Li, and Chang D. Yoo
International Conference on Learning Representation (ICLR), 2023
2022
[C7] Information-Theoretic Text Hallucination Reduction for Video-grounded Dialogue
Sunjae Yoon , Eunseop Yoon, Hee Suk Yoon, Junyeong Kim, and Chang D. Yoo
Empirical Methods in Natural Language Processing (EMNLP), 2022. (long paper)
[C6] SMSMix: Sense-Maintained Sentence Mixup for Word Sense Disambiguation
Hee Suk Yoon , Eunseop Yoon , John Harvill, Sunjae Yoon , Mark Hasegawa-Johnson, and Chang D. Yoo
Empirical Methods in Natural Language Processing (EMNLP), 2022. (short paper, findings)
[C5] Selective Query-guided Debiasing for Video Corpus Moment Retrieval
Sunjae Yoon , Ji Woo Hong, Eunseop Yoon, Dahyun Kim , Junyeong Kim, Hee Suk Yoon, and Chang D. Yoo
European Conference on Computer Vision (ECCV) 2022
[J2] Cascaded MPN: Cascaded Moment Proposal Network for Video Corpus Moment Retrieval
Sunjae Yoon , Dahyun Kim, Junyeong Kim, and Chang D. Yoo
IEEE Access 2022
[C4] SEMANTIC ASSOCIATION NETWORK FOR VIDEO CORPUS MOMENT RETRIEVAL
Dahyun Kim *, Sunjae Yoon *, Ji Woo Hong, and Chang D. Yoo
The International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022. Oral
[J1] Dual-Scale Doppler Attention for Human Identification
Sunjae Yoon , Dahyun Kim, Ji Woo Hong, and Chang D. Yoo
MDPI Sensors, 2022
2021
[C3] Structured Co-reference Graph Attention for Video-grounded Dialogue
Junyeong Kim, Sunjae Yoon , Dahyun Kim, and Chang D. Yoo
AAAI Association for the Advancement of Artificial Intelligence (AAAI), 2021
[C2] WEAKLY-SUPERVISED MOMENT RETRIEVAL NETWORK FOR VIDEO CORPUS MOMENT RETRIEVAL
Sunjae Yoon *, Dahyun Kim *, Ji Woo Hong, Junyeong Kim, Kookhoi Kim and Chang D. Yoo
International Conference on Image Processing (ICIP), 2021
2020
[C1] VLANet: Video-Language Alignment Network for Weakly-Supervised Video Moment Retrieval
Minuk Ma *, Sunjae Yoon *, Junyeong Kim, Youngjuoon Lee, Sunghun Kang, and Chang D. Yoo
European Conference on Computer Vision (ECCV) 2020
Academic Activities
💬 Invited Talks
- 2023.05, CAU-AI 핵심 기술세미나, Empirical Methods and Recent Topics for Video Moment Retrieval, (2023-05-19)
🏆 Awards
-
Winner of Datathon Award, 2nd Seoul National University Bundang Hospital (SNUBH) Datathon Award, 1st Prize ($2,000) (2024.10)
-
30th Samsung HumanTech Paper Award, encouragement prize ($1,500) (2024.02)
-
Winner of Best Paper Award, Winter Conference of Korean Artificial Intelligence Association (KAIA), ($1,500), (2023.11)
-
‘Governor citation’ from the governor of DAEGU CITY DALSEONG GUN (2019.02)
-
Award Bronze Prize for International University Creative Car Competition (Autonomous driving) by Korea Transportation Safety Authority, (2018.05)
-
Award Excellence Prize in Autonomous Vehicle Creation Technology by Korea Auto Vehicle Safety Association, (2018.05)
📑 Reviewer
Confernce
-
Neural Information Processing Systems (Neurips): 2023 ~
-
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) : 2022 ~
-
European Conference on Computer Vision (ECCV): 2022 ~
-
IEEE International Conference on Computer Vision (ICCV) : 2023 ~
-
The Association for the Advancement of Artificial Intelligence (AAAI) : 2025 ~
-
Association for Computational Linguistics (ACL): 2023 ~
-
Empirical Methods on Natural Language Processing (EMNLP): 2022 ~
-
International Conference on Learning Representations (ICLR): 2024 ~
-
International Conference on Machine Learning (ICML): 2024 ~
-
International Conference on Acoustics, Speech, and Signal Processing (ICASSP): 2023 ~
-
IEEE/CVF Winter Conference on Applications of Computer Vision (WACV): 2023 ~
-
International Conference on Artificial Intelligence and Statistics (AISTATS): 2025 ~
Journal
-
IEEE Transactions on Big Data
-
IEEE Transactions on Circuits and Systems for Video Technology
🎏 Patent
-
Selective Query-guided Debiasing for Video Corpus Moment Retrieval No. KR 10-2022-0154621 (2022-11-17)
-
WEAKLY-SUPERVISED MOMENT RETRIEVAL NETWORK FOR VIDEO CORPUS MOMENT RETRIEVAL No. KR 10-2021-0172582 (2021-12-06)
-
Artificial Intelligence-based Radar Target Detection System No. KR 10-2021-0013581 (2021-01-29)