Portrait of Dr. Hakan Yekta Yatbaz

Lecturer (Assistant Professor) in Autonomous Systems · Queen's University Belfast

Hakan Yekta Yatbaz

I build introspective perception for autonomous systems that know when they are failing.

I am a Lecturer (Assistant Professor) in Autonomous Systems in the School of EEECS at Queen's University Belfast. My research focuses on making AI in autonomous and intelligent systems safe, reliable, and trustworthy across robust sensing, run-time monitoring and introspection, explainable representations, and cooperative autonomy. Before joining Queen's, I was a Postdoctoral Research Fellow at WMG, University of Warwick (working on the EU-funded EVENTS and Hi-Drive projects), where I also completed my PhD advised by Dr. Roger Woodman and Prof. Mehrdad Dianati.

01 - News

Recent

  1. Oct 2026

    Gave an invited seminar for the IEEE QUB Student Branch: "Can We Trust AI in Autonomous Systems? From Perception to Run-Time Error Detection".

  2. 2026

    Appointed Associate Editor for Connected Mobility and Automation, Frontiers in Future Transportation.

  3. Sept 2025

    Joined Queen's University Belfast as Lecturer in Autonomous Systems (School of EEECS).

  4. Feb–Sept 2025

    Postdoctoral Research Fellow at WMG, University of Warwick, working on the EU-funded EVENTS and Hi-Drive projects.

  5. Oct 2024

    Submitted PhD thesis on run-time error detection for DNN-based perception in automated driving systems.

  6. Oct 2025

    Multi-Layer Self-Assessment with Filtering for 3D Object Detection published in ACM Transactions on Intelligent Systems and Technology (TIST).

Earlier news
  1. Sept 2024

    Integrity Monitoring of 3D Object Detection using Spatial Filtering presented at IEEE ITSC 2024 (Edmonton, Canada).

  2. Jun 2024

    Early-Layer Neural Activation Monitoring for 3D Detection presented at IEEE/CVF CVPRW 2024 (SAIAD Workshop).

  3. May 2024

    Run-Time Introspection of 2D Object Detection Using Learning Representations published in IEEE Transactions on Intelligent Vehicles (T-IV).

  4. Feb 2024

    Survey on Introspection of DNN-Based Perception in Automated Driving published in IEEE Transactions on Intelligent Transportation Systems (T-ITS).

02 - Throughline

Sensing under noise, introspection at run time, representations that explain, autonomy that cooperates.

Each dot is a paper: from multimodal anomaly sensing to neural activation monitoring, and next, resilient cooperative autonomy.

  1. 2019 Scanpath STA IEEE Sensors 2019 · Sensing
  2. 2020 Signature Stress IEEE IWBF 2020 · Xai
  3. 2021 Color-Coded CNN IEEE Sensors 2021 · Xai
  4. 2022 Hazardous Events IEEE ITSC 2022 · Autonomy
  5. 2022 Forest Fire WMSN ACM TOMM 2022 · Sensing
  6. 2023 E-Health IoT IoT Elsevier 2023 · Sensing
  7. 2023 ICCVW Patterns ICCVW 2023 · Introspection
  8. 2024 T-ITS Survey IEEE T-ITS 2024 · Introspection
  9. 2024 T-IV Introspection IEEE T-IV 2024 · Xai
  10. 2024 Early-Layer 3D CVPRW 2024 · Xai
  11. 2024 Spatial Filtering IEEE ITSC 2024 · Autonomy
  12. 2025 Audio-IMU HAR Sci. Rep. 2025 · Sensing
  13. 2025 Multi-Layer 3D ACM TIST 2025 · Introspection
  14. 2026 Cooperative Autonomy Direction · Autonomy
  15. Next Your PhD? See open problems

Hover, tap or tab to a dot. Accent dots mark flagship works.

  • Sensing

    Multi-modal 2D/3D perception under weather and sensor noise.

  • Introspection

    Run-time monitors that flag perception errors without ground truth.

  • Representations

    Early-layer neural activations and compact latent encodings.

  • Autonomy

    Spatial filtering and collaborative V2X for resilient autonomy.

03 - Experience

Education and experience

Education

  1. Middle East Technical UniversityB.Sc. & M.Sc. in Computer Engineering2013–2020
  2. University of Warwick (WMG)Ph.D. in Engineering (Autonomous Systems)2020–2024

Work

  1. METU NCCGraduate Teaching Assistant2018–2020
  2. University of WarwickGraduate Teaching Assistant2020–2025
  3. WMG, University of WarwickPostdoctoral Research FellowFeb–Sept 2025
  4. Queen's University BelfastLecturer (Assistant Professor) in Autonomous SystemsSept 2025–now

04 - Selected work

Three flagship works, opened up.

Architectures, key findings, and code for run-time perception monitoring and self-assessment in automated driving.

Plate IArchitecture schematic
3D LiDAR Point Cloud Stage 1 Early F₁ Stage 2 Mid F₂ Stage 3 Deep F₃ 3D Boxes Blind to OOD Multi-Layer Spatial Filtering & Fusion Ego-corridor ROI + cross-layer monitor Integrity Alert Error Flagged
Multi-layer activation extraction across early, middle, and deep 3D backbone stages combined with spatial ego-corridor filtering to flag silent 3D detection failures at run time. ACM TIST 2025.

Plate I · ACM TIST 2025 · 3D LiDAR Introspection

Multi-Layer Self-Assessment

Filtering and cross-layer activation monitoring for 3D object detection

Deep 3D object detectors can fail silently when encountering adverse weather, sparse point clouds, or out-of-distribution road scenes. Instead of relying on a single late feature map or miscalibrated confidence scores, this framework extracts activation signatures across multiple backbone depths and applies spatial ego-corridor filtering so the safety monitor focuses on hazards that matter to the vehicle's trajectory.

Backbone feature hierarchy
MultiLayer
Safety-critical ROI focus
SpatialFilter
Published in
ACMTIST '25
Plate IITaxonomy schematic
1. Input-Level Sensor & domain shift 2. Activation-Level Internal latent patterns 3. Output-Level Uncertainty & temporal Run-Time Safety & Fallback Decision “Detecting when a perception network does not know what it does not know.”
Unified taxonomy of DNN perception introspection in automated driving, contrasting input reconstruction, internal activation monitoring, and output uncertainty estimation. IEEE T-ITS 2024.

Plate II · IEEE T-ITS 2024 · Survey & Taxonomy

Introspection of DNN Perception

State-of-the-art and open research challenges in automated driving

How can an automated vehicle tell that its deep neural perception pipeline is making a critical mistake without ground-truth labels at run time? This work synthesises the field of DNN introspection across 2D/3D detection and segmentation, formalising failure triggers, evaluation metrics, and the latency–reliability trade-offs required for safety-critical deployment.

Google Scholar citations
36+Citations
IEEE ITS Society flagship
T-ITS2024
Plate IIIMethod schematic
Early Activations High spatial fidelity Representation Encoder Compact latent embedding Early Detection Low-latency alert Key Insight (IEEE T-IV & CVPRW SAIAD 2024) Early backbone layers retain structural cues of missed objects that deeper layers suppress.
Learning compact representations from early and intermediate neural activation patterns enables faster, more reliable error detection than waiting for final detector layers. IEEE T-IV 2024 & CVPRW 2024.

Plate III · IEEE T-IV 2024 & CVPRW 2024 · Activation Representations

Early-Layer & Representation Introspection

Detecting 2D and 3D perception errors before final-layer suppression

Prior introspection methods almost exclusively inspect the penultimate layer of a detector—where features of missed objects have already been attenuated. Across our IEEE T-IV and CVPRW SAIAD papers, we demonstrated that early-layer neural activations and learned representation embeddings capture rich failure cues while cutting monitoring latency.

2D & 3D object detection
2D/3DVision & LiDAR
Activation tap depth
EarlyBackbone

Code & open research

  • Open source

    multi-layer-introspection

    Reference implementation for multi-layer self-assessment and spatial filtering in 3D LiDAR object detection (ACM TIST 2025).

    github.com/yatbazhakan/multi-layer-introspection

  • Preprints & papers

    Google Scholar profile

    Full citation record, open-access preprints, and bibliometric indices across autonomous driving and intelligent sensing.

    scholar.google.com

  • Repositories

    GitHub (@yatbazhakan)

    Codebases, experimental scripts, and reproducibility packages for DNN introspection and sensor analytics.

    github.com/yatbazhakan

05 - Publications

Publications

Full list on Google Scholar

Showing 20 of 20 publications

2026

MMM 2026 ConferenceAI Platforms / NLP

ZhadigerAI: Software-as-a-Service AI Platform for Kazakh and English

A. Baglanova, N. Fakhrutdinov, U. Azirakhmet, R. Kalimzhanov, Z. Babakhojayeva, H. Y. Yatbaz, A. Yazıcı

32nd International Conference on Multimedia Modeling (MMM 2026) · Lecture Notes in Computer Science (LNCS), Springer Nature

A bilingual Software-as-a-Service AI platform integrating speech and language processing pipelines for Kazakh and English.

2025

ACM TIST 2025 JournalAutonomous Systems

Multi-Layer Self-Assessment with Filtering for 3D Object Detection in Autonomous Vehicles

H. Y. Yatbaz, K. Koufos, M. Dianati, R. Woodman

ACM Transactions on Intelligent Systems and Technology (TIST), Vol. 17, No. 2

Fuses neural activations across multiple backbone layers with spatial filtering to detect 3D LiDAR perception errors at run time.

Sci. Rep. 2025 JournalMultimodal Sensing

Hierarchical Human Activity Recognition with Fusion of Audio and Multiple Inertial Sensor Modalities

T. A. Yılmaz, H. Y. Yatbaz, E. Ever, A. Yazıcı

Scientific Reports (Nature Portfolio), 15(1)

A hierarchical multi-modal fusion architecture combining acoustic cues and distributed inertial sensors for robust human activity recognition.

2024

IEEE ITSC 2024 ConferenceAutonomous Driving

Integrity Monitoring of 3D Object Detection in Automated Driving Systems using Raw Activation Patterns and Spatial Filtering

H. Y. Yatbaz, M. Dianati, K. Koufos, R. Woodman

27th IEEE International Conference on Intelligent Transportation Systems (ITSC), Edmonton, Canada

Combines raw internal neural activations with ego-vehicle spatial context filtering to focus integrity monitoring on safety-critical zones.

CVPRW 2024 ConferenceAutonomous Driving

Run-Time Monitoring of 3D Object Detection in Automated Driving Systems Using Early Layer Neural Activation Patterns

H. Y. Yatbaz, M. Dianati, K. Koufos, R. Woodman

IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), SAIAD Workshop

Shows that early-layer LiDAR backbone activations carry strong failure signatures before errors propagate to 3D bounding-box heads.

IEEE T-IV 2024 JournalAutonomous Driving

Run-Time Introspection of 2D Object Detection in Automated Driving Systems Using Learning Representations

H. Y. Yatbaz, M. Dianati, K. Koufos, R. Woodman

IEEE Transactions on Intelligent Vehicles (T-IV), Vol. 9, No. 5, pp. 4880–4892

Learns compact, interpretable representations of detector feature maps to flag silent false negatives in 2D automated driving perception.

IEEE T-ITS 2024 JournalAutonomous Driving

Introspection of DNN-Based Perception Functions in Automated Driving Systems: State-of-the-Art and Open Research Challenges

H. Y. Yatbaz, M. Dianati, R. Woodman

IEEE Transactions on Intelligent Transportation Systems (T-ITS), Vol. 25, No. 5, pp. 3317–3336

A systematic survey and taxonomy of run-time error detection and introspection mechanisms for deep neural perception in automated vehicles.

Warwick PhD 2024 PhD ThesisDoctoral Thesis

Runtime Error Detection for Deep Neural Network-Based Object Detection for Perception in Automated Driving Systems

H. Y. Yatbaz (Supervised by Prof. Mehrdad Dianati, Dr. Roger Woodman)

PhD Thesis · WMG, University of Warwick, UK

Doctoral dissertation establishing multi-layer activation introspection and spatial filtering for 2D and 3D perception in automated driving.

2023

ICCVW 2023 ConferenceAutonomous Driving

Introspection of 2D Object Detection using Processed Neural Activation Patterns in Automated Driving Systems

H. Y. Yatbaz, M. Dianati, K. Koufos, R. Woodman

IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), ROAD++ Workshop, Paris, France

Introduces processed neural activation pooling to monitor 2D object detectors for missed detections in road scenes.

IoT Elsevier 2023 JournalE-Health / IoT

A Smart E-Health Framework for Monitoring the Health of the Elderly and Disabled

A. Yazıcı, D. Zh. Zhumabekova, A. Nurakhmetova, Z. Yergaliyev, H. Y. Yatbaz, Z. Makisheva, M. I. Lewis, E. Ever

Internet of Things (Elsevier), Vol. 24, Art. 100971

An end-to-end IoT and edge-sensing architecture for continuous anomaly and health monitoring of vulnerable individuals.

2022

ACM TOMM 2022 JournalWireless Sensing

An Effective Forest Fire Detection Framework Using Heterogeneous Wireless Multimedia Sensor Networks

B. Kizilkaya, E. Ever, H. Y. Yatbaz, A. Yazıcı

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 18, No. 4, Art. 108

Combines visual and scalar environmental sensors in heterogeneous wireless multimedia networks for low-false-alarm wildfire detection.

IEEE ITSC 2022 ConferenceAutonomous Driving

Detecting Hazardous Events: A Framework for Automated Vehicle Safety Systems

D. Xiao, W. G. Geiger, H. Y. Yatbaz, M. Dianati, R. Woodman

25th IEEE International Conference on Intelligent Transportation Systems (ITSC), Macau, China

A safety monitoring framework for automated vehicles that identifies hazardous operational events and triggers fallback behaviours.

MAMS 2022 JournalStructural ML

Prediction of Punching Shear Strength of Slab-Column Connections: A Comprehensive Evaluation of Machine Learning and Deep Learning Based Approaches

S. Derogar, C. Ince, H. Y. Yatbaz, E. Ever

Mechanics of Advanced Materials and Structures (Taylor & Francis), Vol. 31, No. 17, pp. 3888–3904

Benchmarks machine learning and deep learning models for predicting structural punching shear strength with high generalisation.

ICISCT 2022 ConferenceE-Health / ML

Critical Analysis of Validation Methods for Machine Learning Models Used in E-Health Applications

H. Y. Yatbaz, A. Yazıcı, E. Ever

International Conference on Information Science and Communications Technologies (ICISCT), Tashkent, Uzbekistan

Evaluates cross-validation pitfalls and data leakage in sensor-based e-health machine learning pipelines.

2021

IEEE Sensors 2021 JournalE-Health / CNN

Activity Recognition and Anomaly Detection in E-Health Applications Using Color-Coded Representation and Lightweight CNN Architectures

H. Y. Yatbaz, E. Ever, A. Yazıcı

IEEE Sensors Journal, Vol. 21, No. 11, pp. 12799–12810

Encodes heterogeneous sensor streams into compact 2D colour-coded images for lightweight CNN anomaly detection.

2020

IEEE IWBF 2020 ConferenceBiometrics / Forensics

Deep Learning Based Stress Prediction From Offline Signatures

H. Y. Yatbaz, M. Erbilek

8th International Workshop on Biometrics and Forensics (IWBF), Porto, Portugal

Investigates deep visual representations for predicting human psychological stress from offline handwritten signatures.

IEEE SIU 2020 ConferenceSignal Processing

Exploring Activity Transitions in the STA-based Activity Recognition

S. Eraslan, H. Y. Yatbaz, E. Ever, Y. Yeşilada

28th Signal Processing and Communications Applications Conference (SIU), Gaziantep, Turkey

Models sequential transitions between daily living activities using Scanpath Trend Analysis over ambient sensor events.

IET Chapter 2020 Book ChapterSensory Analytics

Statistical Analysis for Sensory E-Health Applications: Opportunities and Challenges

H. Y. Yatbaz, A. C. Tasıran

Book chapter in Sensory Data Analysis for Health Monitoring, Institution of Engineering and Technology (IET), pp. 165–186

Reviews statistical modelling methods and reliability challenges for noisy continuous health-monitoring sensor data.

2019

IEEE Sensors 2019 JournalAmbient Sensing / IoT

Activity Recognition Using Binary Sensors for Elderly People Living Alone: Scanpath Trend Analysis Approach

H. Y. Yatbaz, S. Eraslan, Y. Yeşilada, E. Ever

IEEE Sensors Journal, Vol. 19, No. 18, pp. 8249–8260

Adapts eye-tracking Scanpath Trend Analysis (STA) to recognise daily activities and anomalies from binary ambient home sensors.

2018

IEEE LCNW 2018 ConferenceMobile Networks

Hybrid Approach for Disaster Recovery using P2P Communications in Android

H. Y. Yatbaz, B. Cinar, A. Gökdemir, E. Ever, F. M. Al-Turjman, H. X. Nguyen, A. Yazıcı

43rd IEEE Conference on Local Computer Networks Workshops (LCN Workshops), Chicago, USA

A resilient peer-to-peer communication protocol on mobile devices for emergency coordination when infrastructure fails.

06 - Research vision

Next: perception that knows its limits in shared spaces.

Where the thread leads: from single-vehicle neural activation monitors to self-assessing, cooperative multi-agent autonomy.

Field Plate Queen's University Belfast
With the instrumented autonomous research vehicle in front of the Lanyon Building at Queen's University Belfast. School of EEECS.

Real-World Autonomy · Queen's University Belfast

From Neural Activations to Road-Ready Trust

Bridging theoretical AI safety and physical autonomous platforms

At Queen's University Belfast (School of EEECS), our research connects foundational advances in deep neural network introspection with real-world multi-modal sensing platforms. By monitoring internal activation dynamics across LiDAR, camera, and cooperative V2X streams, we aim to build autonomous systems that continuously quantify their own perceptual reliability in complex, everyday environments.

Research strands
04Core Agendas
Doctoral supervision
DfE& CTA Funded

Explore funded PhD studentships & project proposals

07 - PhD & Collaborate

Open problems. Let's work on them together.

I have a ring-fenced, fully funded DfE PhD studentship available (open to UK/NI nationals, Republic of Ireland CTA citizens, and UK Settled Status / ILR holders, plus competitive international nominations) alongside academic and industry collaborations.

  1. Robust & Self-Calibrating 3D Sensing in Autonomy

    • Multi-modal 3D fusion
    • Self-healing perception
    • Domain shift & weather
  2. Anticipatory Introspection & Self-Correcting Autonomy

    • Failure anticipation
    • Latent-steered E2E driving
    • AI safety & control
  3. Causally Faithful Embodied VLMs & Latent Representations

    • Embodied VLMs / VLAs
    • Shortcut & confounder auditing
    • Compact latent probing
  4. Cooperative Autonomy & Anticipatory Teleoperation

    • Cooperative V2X autonomy
    • Networked teleoperation
    • Human-AI shared control

Ways to work together

Prospective PhD students (Ring-Fenced DfE Slot)

100% Home fees + ~£19.2k–£20.7k/yr tax-free stipend for UK/NI, Irish (CTA), EU Settled Status, and ILR candidates (CS, EE, Physics, Maths, Eng, or industry software engineers). No formal proposal needed for an initial coffee chat.

Academic & industry partners

Joint Horizon Europe / UKRI proposals, visiting researcher exchanges, and safety-critical perception validation for automated mobility.

MSc & BEng supervision

Queen's University Belfast students interested in dissertation projects on AI safety, LiDAR perception, or XAI are welcome to reach out.

Topics, funding eligibility & how to apply

Ashby Building, Room 08.010 · School of EEECS, Queen's University Belfast, Belfast, UK

08 - Service & background

Talks, service and background

Editorial & Peer Review

Associate Editor, Connected Mobility and Automation (Frontiers in Future Transportation).

  • IEEE Transactions on Intelligent Transportation Systems
  • IEEE Transactions on Intelligent Vehicles
  • IEEE Transactions on Fuzzy Systems
  • IEEE Sensors Journal
  • Scientific Reports (Nature Portfolio)

Affiliations: Associate Fellow of Advance HE (PR307078) · Member, IEEE Intelligent Transportation Systems Society.

Invited Talks & Education

  • Can We Trust AI in Autonomous Systems? From Perception to Run-Time Error Detection — IEEE QUB Student Branch (09 Oct 2026). Key challenges in trustworthy AI, machine-learning safety, reliable perception, computer vision, and run-time error detection for autonomous systems that make decisions in real time.
  • Ph.D. in Engineering, University of Warwick (2020–2024). Runtime error detection for DNN-based perception in automated driving, advised by Dr. Roger Woodman and Prof. Mehrdad Dianati.
  • B.Sc. and M.Sc. in Computer Engineering, Middle East Technical University (METU NCC) (2013–2020).

For hosts

Dr. Hakan Yekta Yatbaz is a Lecturer (Assistant Professor) in Autonomous Systems in the School of Electronics, Electrical Engineering and Computer Science (EEECS) at Queen's University Belfast. His research focuses on safe, reliable, and trustworthy AI for autonomous systems, spanning robust multi-modal sensing, run-time monitoring and introspection, explainable representations, and cooperative autonomy. Before joining Queen's, he was a Postdoctoral Research Fellow at WMG, University of Warwick, where he worked on the EU-funded EVENTS and Hi-Drive automated driving projects and completed his Ph.D. in Engineering. He holds B.Sc. and M.Sc. degrees in Computer Engineering from Middle East Technical University (METU NCC) and serves as an Associate Editor for Frontiers in Future Transportation.