Lei Sun (孙磊)

I am a doctoral student at Zhejiang University under the supervision of Prof. Kaiwei Wang .
I was a visiting doctoral student at Robotics and Perception Group, University of Zurich, under the supervision of Prof. Davide Scaramuzza.
I was also a visiting doctoral student at Computer Vision Lab, ETH Zurich under the supervision of Prof. Luc Van Gool.
Before that, I received my bachelor's degree from Beijing Institute of Technology.

I am looking for post-doc positions or job opportunities related to event camera, low-level image process, and environment perception algorithms.

Email  /  CV  /  Google Scholar  /  Linkedin  /  Github

profile photo
Research

I'm interested in computational imaging, semantic segmentation, and event cameras. First-author papers are highlighted.

Temporal-Mapping Photography for Event Cameras
Yuhan Bao*, Lei Sun*, Yuqin Ma, Diyang Gu, Kaiwei Wang
* denotes equal contribution.
arXiv

EvTemMap, pioneering work of event-to-image conversion, produces high-quality, high-grascale-resolution, high-dynamic-range image from events only.


event_af SGE: Structured Light System Based on Gray Code with an Event Camera
Xingyu Lu, Lei Sun, Diyang Gu, Zhijiie Xu, Kaiwei Wang
arXiv

Event-based depth estimation for dynamic scenes, over 41 times faster in data acquisition than previous SOTA.

event_af Improving Fast Auto-Focus with Event Polarity
Yuhan Bao, Lei Sun, Yuqin Ma, Diyang Gu, Kaiwei Wang
Optical Express, 2023   (Editors' Pick)
codes coming soon

Event-assisted fast auto-focus algorithm. Precise focus with less than one depth of focus is achieved within 0.004 seconds.


refid Event-Based Frame Interpolation with Ad-hoc Deblurring
Lei Sun, Christos Sakaridis, Jingyun Liang, Peng Sun, Jiezhang Cao,
Kai Zhang, Qi Jiang, Kaiwei Wang, Luc Van Gool
CVPR, 2023
codes / arXiv / Video

SOTA unified Event-based frame interpolation for both sharp frames and blurry frames.


evdeblur Event-Based Fusion for Motion Deblurring with Cross-modal Attention
Lei Sun, Christos Sakaridis, Jingyun Liang, Qi Jiang, Kailun Yang, Peng Sun,
Yaozu Ye, Kaiwei Wang, Luc Van Gool
ECCV, 2022   (Oral Presentation, rate:2.7%)
project page / codes / arXiv

We present a novel event-based deblurring method that improves the previous state-of-the-art by 2.47 dB.


aci Annular computational imaging: Capture clear panoramic images through simple lens
Qi Jiang, Hao Shi, Lei Sun, Shaohua Gao, Kailun Yang, Kaiwei Wang
IEEE Transactions on Computational Imaging, 2022
codes

Annular Computational Imaging (ACI) framework to break the optical limit of light-weight Panoramic Annular Lens design.


event_hpe Efficient Human Pose Estimation via 3D Event Point Cloud
Jiaan Chen*, Hao Shi*, Yaozu Ye, Kailun Yang, Lei Sun, Kaiwei Wang
3DV, 2022
codes

A lightweight event-based human pose estimation model by processing events as point cloud.


PALrestore Compact and lightweight panoramic annular lens for computer vision tasks
Shaohua Gao, Lei Sun, Qi Jiang, Hao Shi, Jia Wang, Kaiwei Wang, Jian Bai
Optical Express, 2022   (Editors' Pick)

Designing a lightweight panoramic annular lens with physical-based image enhancement model.


Wangjia_seg High-performance panoramic annular lens design for real-time semantic segmentation on aerial imagery
Jia Wang, Kailun Yang, Shaohua Gao, Lei Sun, Chenxi Zhu, Kaiwei Wang, Jian Bai
Optical Engineering 61 (3), 035101, 2022

Designing a panoramic annular lens (PAL) system with 4K high resolution for aerial image segmentation.


Aerial_pass Aerial-PASS: panoramic annular scene segmentation in drone videos
Lei Sun, Jia Wang, Kailun Yang, Kaikai Wu, Xiangdong Zhou, Kaiwei Wang, Jian Bai
European Conference on Mobile Robots (ECMR) 2021

Designing a specific semantic segmentation for aerial panoramic images.


RFNet Real-time fusion network for RGB-D semantic segmentation incorporating unexpected obstacle detection for road-driving images
Lei Sun, Kailun Yang, Xinxin Hu, Weijian Hu, Kaiwei Wang
IEEE Robotics and Automation Letters and IROS, 2020
codes

A real-time RGB-D fusion semantic segmentation framework with small obstacle detection.


weijian_vip A comparative study in real-time scene sonification for visually impaired people
Weijian Hu, Kaiwei Wang, Kailun Yang, Ruiqi Cheng, Yaozu Ye, Lei Sun, Zhijie Xu
Sensors 20 (11), 3222, 2020

Propose three different auditory-based interaction methods which convey raw depth images, obstacle information and path information respectively to visually impaired people.


yichen_loal A panoramic localizer based on coarse-to-fine descriptors for navigation assistance
Yicheng Fang, Kailun Yang, Ruiqi Cheng, Lei Sun, Kaiwei Wang
Sensors 20 (15), 4177, 2020

Propose a panoramic localizer, which is based on coarse-to-fine descriptors, leveraging panoramas for omnidirectional perception and sufficient FoV up to 360◦.


yyz_journal A wearable vision-to-audio sensory substitution device for blind assistance and the correlated neural substrates
Yaozu Ye, Kaiwei Wang, Weijian Hu, Huabing Li, Kailun Yang, Lei Sun, Zuobing Chen
Journal of Physics: Conference Series 1229 (1), 012026, 2019

Develop a wearable system to transform the spatial information captured by camera into a voice description and fed it back to blind users.


day2night See Clearer at Night: Towards Robust Nighttime Semantic Segmentation through Day-Night Image Conversion
Lei Sun, Kailun Yang, Kaiwei Wang, Kaite Xiang
Artificial Intelligence and Machine Learning in Defense Applications, SPIE 1229 (1), 012026, 2019

Propose a framework to alleviate the accuracy decline when semantic segmentation is taken to adverse conditions by using Generative Adversarial Networks (GANs).


Services

Reviewer for CVPR, ICCV, ECCV, AAAI, RA-L, WACV, IJCV.

Talks

[ Video ] Invited talk on event-based image deblurring in Mobile Intelligent Photography and Imaging (MIPI) .

Invited talk in IV 2022 BSL Workshop.

Education
rpg Visiting doctoral student
Robotics and Perception Group, University of Zurich and ETH Zurich, Zurich, Switzerland
Jan. 2023 ~ Sep. 2023
Supervisor: Prof. Davide Scaramuzza
eth Visiting doctoral student
Computer Vision Lab, ETH Zurich, Zurich, Switzerland
Sep. 2021 ~ Jan. 2023
Supervisor: Prof. Luc Van Gool
zju Doctoral student
College of Optical Science and Enginnering, Zhejiang University, Hangzhou, China
Sep. 2018 ~ Jun.2024 (expected)
Supervisor: Prof. Kaiwei Wang
bit Bachelor's degree
College of Optical Science and Enginnering, Beijing Institute of Technology, Beijing, China
Sep. 2014 ~ Jun. 2018

Website template from Jon Barron