Description of Activities
The main research field of the group is 3D machine perception. Principally, we process camera images, depth sensors, and LiDAR devices. The main active research topics are
- Calibration of different modalities, especially LiDAR devices and digital cameras.
- Stereo vision exploiting affine transformations.
- Visual odometry using vehicle-mounted sensors.
The application of affine transformations is the main focus of our research. This topic originated at ELTE.
The main application field is autonomous driving. At the university, a sensor-kit has been developed including cameras with narrow and wide field-of-view lenses, LiDAR sensor(s), IMU and RTK-GPS. The sensors are synchronized in time. A remotely controllable electric go-kart has been constructed here.
A programmable robotic arm is also developed for which the goal is the automatic unpacking of boxes; our research group developed a 2D LiDAR-based measuring software to detect the dimensions of the object that is gripped by the robot.
The group yearly organizes a competition for students, autonomous driving related tasks should be solved by the participants.
Our research work is supported by Robert Bosch GmbH.
Research Interests
Stereo and Multi-view 3D Computer Vision
- 3D Reconstruction
- Structure from Motion /Simultaneous Localization and Mapping
- Visual odometry
Multi-modal calibration
- Camera LiDAR
- Multi LiDARs
- 2D LiDARs
- RGB-D sensors
Research/service concepts/Methodology
We believe that theory and practice meet in modern research. Therefore, we address problems that appear in real-life applications. We prefer to use our own testing data, we do not only download those from the Internet. For this reason, we have developed (i) ELTECar: a car equipped with several sensors and (ii) ELTEKart: a remotely controllable electric go-kart.
Research Staff
- Levente Hajder senior researcher (research group leader, bibliography: MTMT)
- Lajos Loczi, senior researcher
- Iván Eichhardt, senior researcher
- Bandó Kovács, engineer
- Tekla Tóth, PhD student
- Tamás Tófalvi, PhD student
- Máté Cserép, PhD student
Projects
- 3D reconstruction from rectified stereo images using affine transformations
- Machine vision for an unpacking robot
- LiDAR-camera calibration using spherical calibration objects
- Calibration of multi 2D LiDAR sensors
- Homography estimation for offside detection using the center circle
5 important publications in the field
- T. Tóth, L. Hajder (2023): A minimal solution for image-based sphere estimation, International Journal of Computer Vision [DOI]
- L. Hajder, D. Baráth (2020): Relative planar motion for vehicle-mounted cameras from a single affine correspondence, IEEE International Conference on Robotics and Automation [DOI]
- D. Baráth, I. Eichhardt, L. Hajder (2019): Optimal multi-view surface normal estimation using affine correspondences, IEEE Transactions on Image Processing [DOI]
- D. Baráth, L. Hajder (2018): Efficient recovery of essential matrix from two affine correspondences, IEEE Transactions on Image Processing [DOI]
- D. Baráth, T. Tóth, L. Hajder (2017): A minimal solution for two-view focal-length estimation using two affine correspondences, IEEE Conference on Computer Vision and Pattern Recognition [DOI]
Infrastructure
ELTECar testing car and ELTEKart controllable go-kart
16-beam Velodyne VLP-16 LiDARs
HikVision 2 MPixel color cameras. With normal and fisheye optics
RTK compensation GPS
Intel Intellysense depth camera