About Me

I joined the Distributed Systems Group in March 2017 as a Ph.D. student. Before that, I received my B.Eng. degree in Measuring and Control Technology and Instruments from Tianjin University in July 2014. In January 2017, I received my M.Sc. degree in Electrical Engineering and Information Technology from D-ITET, ETH Zurich.

During my bachelor's and master's studies, I had some great time in exchange program and internships. In the academic year 2012-2013, I was an exchange student at The University of Hong Kong. From September 2015 to February 2016, I worked as a software engineer intern at Schindler Elevator Ltd. in Ebikon, Switzerland. From November 2016 to January 2017, I worked as a research intern in the Social Computing Group at Idiap Research Institute in Martigny, Switzerland, under the supervision of Prof. Daniel Gatica-Perez.

From June to September 2019, I was a visiting researcher at Empathic Computing Lab, Auckland Bioengineering Institute in Auckland, New Zealand, under the supervision of Prof. Mark Billinghurst.

I always try to make a good work-life balance, although fail in most of the time unfortunately :) Outside computer science, I enjoy reading books, watching movies, writing, drawing, and staying in the kitchen. Besides, I keep the habit of practicing the flute and caligraphy.

On June.30, 2021, I successfully defended my Ph.D. thesis, Audio-Facilitated Human Interaction with the Environment: Advancements in Audio Augmented Reality and Auditory Notification Delivery. In addition to my Ph.D. supervisor, Prof. Friedemann Mattern, I was fortunate to also have Prof. Mark Billinghurst, Prof. Otmar Hilliges, and Prof. Albrecht Schmidt to be my doctoral examination committee members.

Research

In the past, I had research experience in computer vision, machine learning, geographic information system, location based services, and social network mining.

My current research interests lie in the field of audio augmented reality (AAR). For example, we can augment real objects as well as people's natural and seamless interactions with them using virtually synthesized and/or spatialized audio signals. In addition, I am interested in exploring and implementing application prototypes for daily life interactions, better experience with auditory interfaces, museum experience enhancement, remote collaboration, etc.

Publications
Google ScholarResearchGate

Student Projects

Currently, I don't have available student projects.

Master project

Autumn Semester 2020 (completed)
Musical Timbre Transfer for Arbitrary Notification Sounds for Less Intrusive Notification Delivery

Student: Andreas Roth
Supervisor: Jing Yang
In this project, we developed a method to transfer notification music into different musical timbres for less intrusive notification delivery.

Lab project

Spring Semester 2020 (completed)
Audio Style Transfer for Seamless Integration of Notifications into Music

Student: Tristan Cinquin
Supervisor: Jing Yang, Gábor Sörös
In this project, we explored audio style transfer technique and applied it to seamlessly integrate notifications into background music.

Semester project

Spring Semester 2019 (completed)
Inside-out Acoustic Head Tracking Using Imaginary Anchor Sources

Student: Felix Pfreundtner
Supervisor: Jing Yang, Gábor Sörös
We proposed a method to infer a person's head pose based on the room impulse response. We tested the method in simulated environments and real-world rooms.

Bachelor project

Spring Semester 2019 (completed)
Gaze Tracking-based Audio Augmentation

Student: Cheuk Yu Chan
Supervisor: Jing Yang
We implemented a prototype that activated audio augmentation based on a user's visual focus. We tested the prototype's applicability in a museum scenario, in which the gaze-based audio augmentation could enrich people's perception of paintings.

Master project

Autumn Semester 2018 (completed)
Ultrasound Based Device-Free Gesture Tracking

Student: Kim Marbach
Supervisor: Jing Yang
In this project, we implemented an ultrasound-based system that can track the user's hand movements around the smartphone. Besides, we built a NN-based gesture and speech recognition pipeline. We integrated both frameworks on a smartphone for touchless control and interactions. We proposed two demos to showcase the application.

Bachelor project

Autumn Semester 2018 (completed)
Spatial Audio based Motion Reaction on Smartphones

Student: Daniel Gstöhl
Supervisor: Jing Yang
In this project, we explored the interaction with smartphone based on spatial audio signals and motion gestures. We designed a rhythm game to demonstrate the idea.

Master project

Spring Semester 2018 (completed)
Spatial Audio for Human-Object Interactions

Student: Yves Frank
Supervisor: Jing Yang, Gábor Sörös
We aim to develop a system that can produce spatial audio messages from the object to the user in real time, which enhances a quick and lively interaction between the user and the objects.

Bachelor project

Autumn Semester 2017 (completed)
Eye Contact Detection on Constrained Devices

Student: Philipp Schimmelfennig
Supervisor: Mihai Bâce, Jing Yang
We explored computer vision and machine learning methods to detect eye contact in real time on constrained devices like Raspberry Pi.

Master project

Autumn Semester 2017 (completed)
User-centric rendering for handheld augmented reality

Student: Shiheng Wang
Supervisor: Jing Yang, Gábor Sörös
We developed a user-perspective rendering system on hand-held mobile devices. The system can render the digital contents from the user's viewpoint instead of an arbitrary perspective such as the rear camera of the smartphone.

Master project

Spring Semester 2017 (completed)
Incorporating Spatio-Temporal Context for Predicting the Next Place Using Neural Networks and Random Forests

Student: Jorim Urner
Supervisor: Dominik Bucher, Jing Yang, David Jonietz
We explored how GPS data obtained from smartphone users can be used to predict the user's next place based on neural networks and random forests.

Teaching

Informatik II

This course is for Bachelor's students at Department of Information Technology and Electrical Engineering. This course covers the most common problem solving methods, algorithms, data structures, and Java coding practices. My duty mainly included weekly 1-hour tutorial, exercise correction, and exam correction.

Informatik I

This course is for Bachelor's students at Department of Mechanical Engineering. This course covers fundamental programming and operational skills for developing high-quality programs in C++ language. My duty mainly included weekly 2-hour tutorial, assignment correction, and exam correction.

Einführung in die Programmierung

This course is for Bachelor's students at Department of Computer Science. This course covers introduction to fundamental concepts of modern programming and operational skills for developing high-quality programs, including large programs as in industry. My duty mainly included weekly 2-hour tutorial, assignment correction, and exam correction.

Seminar on Computational Haptics

This seminar aims to familiarize students with exciting new research topics in the area of computational haptics and teach basic scientific writing and oral presentation skills.

Former Students

I appreciate the rewarding experience of supervising students for their Bachelor, Master, and lab projects. Sincere thanks to all of you who worked with me, are working with me, and will work with me.

  • Andreas Roth (now software engineer at ti&m)
  • Tristan Cinquin (now MSc student at ETH)
  • Felix Pfreundtner (now running his own start-up)
  • Cheuk Yu Chan (now MSc student at ETH)
  • Kim Marbach
  • Daniel Gstöhl
  • Yves Frank (now at Google)
  • Jorim Urner (now at Eidg. Forschungsanstalt WSL)
  • Shiheng Wang (now at Intellion AG)
  • Philipp Schimmelfennig
Contact Form
Feel free to contact me

Address

ETH Zentrum, CNB H107.2
Universitätstrasse 6
CH-8092 Zurich

Phone

+41 44 632 4142

Email

jing.yang@inf.ethz.ch