ETH Zurich : Computer Science : Pervasive Computing : Distributed Systems : People : Gábor Sörös


soeroesg Gábor Sörös
Dr. sc. ETH Zurich

ETH Zürich (Swiss Federal Institute of Technology Zurich)
Department of Computer Science
Distributed Systems Group
ETH Zentrum
Universitätsstrasse 6
CH-8092 Zürich, Switzerland

phone:+41 44 632 0121
fax:+41 44 632 1659

About me

Since July 2017, I work full time at the ETH Spin-off Kapanu but I still keep close contact with the Institute for Pervasive Computing at ETH where I was a postdoctoral researcher and a PhD student before. I still actively supervise 3 PhD students at ETH.

My research interests include mobile and wearable computer vision, human computer interaction, and augmented reality. From 2011 to 2015, I was a scientific advisor to the ETH Spin-off Scandit on visual code scanning with mobile and wearable devices. In 2014, I completed an R&D internship in mobile computer vision and augmented reality at Qualcomm Research. Since 2016, I also work with Kapanu on building cutting-edge augmented reality for dentistry.

I studied electrical engineering in Budapest and in Karlsruhe with focus on communication systems, and visual computing in Vienna with focus on mobile augmented reality. During my studies, I was working as a student assistant at the Computer and Automation Research Institute of the Hungarian Academy of Sciences. I joined ETH Zurich as a research and teaching assistant in 2011 and defended my doctoral thesis in May 2016. (Full CV)

Research interests

Visual codes


Augmented reality


Interaction with smart objects


Mobile optical character recognition

  • Price label recognition
  • Credit card recognition
  • Business card recognition
  • Play card recognition

Other activities

08/2017: We are featured on TechCrunch and The Verge
03/2017: We presented our AR technology at IDS 2017, a dental trade show with over 155.000 visitors from 157 countries
07/2016: We are building cutting-edge augmented reality for dentistry at Kapanu
05/2016: I successfully defended my PhD thesis
01/2016: I attended the Dagstuhl seminar 16042 on eyewear computing
10/2015: I presented our research to the President of ETH and the Vice President of Switzerland
03/2015: Our work on gesture recognition was nominated for the ETH Spark Award 2015 as one of the 20 most promising inventions
03/2015: I presented our research to the Rector and the President of ETH
10/2014: I completed a 4-months internship on Mobile Augmented Reality at Qualcomm Research Vienna, Austria
09/2014: Our work is featured in ETH unterwegs
07/2014: Our work on gesture recognition won the Swisscom ICT Award 2014
10/2014: We are featured in Neue Zürcher Zeitung
09/2014: I was a student volunteer at the ECCV 2014 conference in Zurich
03/2014: I visited the Interactive 3D Technologies group at Microsoft Research Cambridge, UK
02/2014: I participated in the ETH - Disney Research Augmented Reality Games Hackathon in Zurich
09/2013: Our work is featured in ETH unterwegs
09/2013: I was local co-organizer of the Ubicomp 2013 and ISWC 2013 conferences in Zurich
06/2013: I attended the 4th UBI Summer School on Mobile Augmented Reality Interfaces in Oulu, Finland
05/2013: I presented my poster on next generation barcode scanning at the Swiss Vision Day 2013
10/2012: I was a student volunteer at the 3DIMPVT conference in Zurich
07/2012: I attended the International Computer Vision Summer School in Sicily
05/2012: I was a finalist in Mobile Visual Computing for the Qualcomm Innovation Fellowship
07/2011: I attended the University of Zurich Summer School on Interaction, Visualization and Ubiquitous Computing
07/2011: I attended the Networked Embedded Systems Summer School in Bertinoro, Italy

I was a reviewer of the Ubicomp'13, MUM'13, UIST'14, ISMAR'15, Ubicomp'15, ISWC'15, CHI'16, UIST'16, MobileHCI'16, Ubicomp'16, Ubicomp'17, ISMAR'17, ETRA'18, ISMAR'18, CHI'19 conferences, the IEEE Transactions on Multimedia, the IEEE Transactions on Computational Imaging, the Elsevier Signal Processing: Image Communication, the Elsevier Image and Vision Computing, the Hindawi Advances in Human-Computer Interaction, the SPIE Journal of Electronic Imaging, and the ACM Interactive, Multimedia, Wearable and Ubiquitous Technologies (IMWUT) journals


FS 2017: Informatics II for Electrical Engineers

FS 2016: Informatics II for Electrical Engineers

FS 2015: Informatics II for Electrical Engineers, Ubiquitous Computing and Ubiquitous Computing Seminar

FS 2014: Informatics II for Electrical Engineers, Seminar 'Smart Environments'

FS 2013: Informatics II for Electrical Engineers, Ubiquitous Computing and Seminar 'Interaction in Intelligent Environments'

HS 2012: Distributed Systems

FS 2012: Informatics II for Electrical Engineers and Ubiquitous Computing

HS 2011: Distributed Systems

FS 2011: Informatics II for Electrical Engineers

Student projects

I am always looking for talented students with background in both distributed systems and visual computing. Electrical engineers with experience in signal and image processing are also welcome.

Available Projects

M Mobile and Wearable Augmented Reality Gábor Sörösavailable
M Machine Learning on Mobile GPU Gábor Sörösavailable

Completed Projects

M Spatial Audio for Human-Object Interactions Yves FrankJing Yang,
Gábor Sörös
FS 18
M User-centric rendering for handheld augmented reality Shiheng WangJing Yang,
Gábor Sörös
HS 17
L Gaze Estimation with Convolutional Neural Networks Andrey IhnatovMihai Bâce,
Gábor Sörös
HS 16
L Facial Augmented Reality Andreas HessGábor SörösHS 16
B Temporal Context in Human Pose Estimation Susanne KellerJie Song,
Gábor Sörös
HS 16
B Visible Light Communication for Smartglasses Pascal JosephyGábor Sörös,
Stefan Schmid
FS 16
B Solfege Sign Recognition with a Wearable Camera Julia GigerGábor SörösFS 16
B Gesture Recognition on Wearable Devices Sander StaalMihai Bâce,
Gábor Sörös
FS 16
M Online Gyroscope-Camera Autocalibration for Image Enhancement on Smartphones Luc HumairGábor SörösFS 15
L Image Processing on Mobile GPU Carlo BeltrameGábor SörösFS 15
B Wearable Shopping Assistant Mauro GueriniGábor SörösFS 15
B Image Processing on Mobile GPU Marc FischerGábor SörösFS 15
M Blur Removal from Document Images Stephan SemmlerGábor SörösHS 14
B Smart Playing Cards with Smart Glasses Michael FranzGábor SörösFS 14
B Multiframe Blur Estimation using Inertial Measurement Sensors Severin MüngerGábor SörösFS 14
B Rapid Object Reconstruction for Product Augmented Reality Sandro LombardiGábor SörösFS 14
B Developing a Multi-Level Visual Code David ChettritGábor Sörös,
Leyna Sadamori
FS 14
B A Biking Assistant on a Wearable Computer Andy ZimmermannGábor SörösHS 13
B Optical Character Recognition with a Head-Mounted Camera Thomas KnellGábor SörösFS 13
B A Magic Lens for Visualizing Device Interactions Markus SchalchSimon Mayer,
Gábor Sörös,
Marian George
FS 13
B Motion Blur Compensation using Inertial Measurement Sensors Carlo BeltrameGábor SörösFS 13
M Optical Character Recognition on Mobile Phones (in cooperation with MIT) Ekansh AnandChristian Floerkemeier,
Gábor Sörös
FS 12
L Uncovering Device Whispers Bram Scheidegger,
Claude Barthels
Simon Mayer,
Christian Beckel,
Gábor Sörös
FS 12
L Automatic Topology Estimation in Wireless Lamp Networks Moritz Hoffmann,
Claudio Gargiulo
Gábor SörösFS 12
B Optical Character Recognition on Mobile Phones Luc HumairChristian Floerkemeier,
Gábor Sörös
FS 12



ETH Zurich Distributed Systems Group
Last updated Jan 27, 2018 soeroesg