Jyh-Jing Hwang
I am currently a Research Scientist at Waymo Research since 2020. I am also a lecturer of ESE 5420, Statistics for Data Science, at UPenn MCIT Online.
In 2020, I earned my Ph.D. degree in Computer and Information Science from University of Pennsylvania, advised by Prof. Jianbo Shi and Prof. Stella Yu at UC Berkeley / ICSI. During my study, I was fortunate to have the opportunities to intern at Facebook AI Research and Google Research.
Before coming to the U.S., I received the B.S. and M.S. degrees in EE, advised by Prof. Liang-Gee Chen, from National Taiwan University and worked with Dr. Tyng-Luh Liu as a research assistant at Academia Sinica.
My research interests are broadly in computer vision, deep learning, and machine learning. Particularly, I am interested in understanding general image/video structures and sensor fusion.
Publications
Unsupervised Hierarchical Semantic Segmentation with Multiview Cosegmentation and Clustering Transformers
Universal Weakly Supervised Segmentation by Pixel-to-Segment Contrastive Learning
SegSort: Segmentation by Discriminative Sorting of Segments
Adversarial Structure Matching for Structured Prediction Tasks
DeeperLab: Single-Shot Image Parser
[ Paper ]
Adaptive Affinity Fields for Semantic Segmentation
Learning Beyond Human Expertise with Generative Models for Dental Restorations
[ Paper ]
Force from Motion: Decoding Physical Sensation in a First Person Video
Egocentric Future Localization
Pixel-wise Deep Learning for Contour Detection
[ Paper ]
Contour Detection Using Cost-Sensitive Convolutional Neural Networks
[ Paper ]
Experiences
Intern at Facebook AI Research
2019.05-2019.08
Intern at Google AI
- Researched "SegSort: Segment Sorting for Semantic Segmentation".
- Participated in the development of DeeperLab.
2018.06-2018.09
Graduate Student Researcher at UC Berkeley / ICSI
- Researched "Adversarial Structure Matching for Structured Prediction Tasks".
- Researched "Adaptive Affinity Fields for Semantic Segmentation".
- Researched "Learning Beyond Human Expertise with Generative Models for Dental Restorations" and collaborated with Prof. Alexei A. Efros and Dr. Sergei Azernikov at Glidewell Dental Labs.
- Researched several projects, e.g., vehicle detection in aerial imagery, timely attention for autonomous driving, etc..
2017.06-Now
Graduate Teaching Assistant at University of Pennsylvania
- (Head TA) Assisted with teaching and created all 4 projects in the new course CIS 680: Vision & Learning.
- Assisted with teaching and projects in CIS 520: Machine Learning and CIS 581: Computer Vision & Computational Photography.
