Gesture-based NUIs assume the user’s hand is a pointing device, not an occluding object. In roof crack inspection, the most informative region is often exactly where the inspector gestures. Our results suggest that (e.g., acoustic emission).
Thus, the "instant" is not physical but perceptual—a blind spot induced by the NUI’s temporal quantization and interaction logic. instant roof nui crack
| Vulnerability Class | Mechanism | NUI Contribution | |---------------------|-----------|------------------| | | Crack growth between samples | Fixed sampling rate without anti-aliasing filters | | Gesture-induced masking | User’s hand occludes the crack region during a swipe command | Interaction priority > sensor priority | | Voice confirmation bias | User says "confirm safe", system lowers sampling rate to save power | Feedback loop reduces vigilance | | Predictive smoothing | Kalman filter interprets crack jump as sensor noise | Over-smoothing deletes transient events | | Visual clutter neglect | AR annotations obscure the actual crack | Information layering creates blind spots | Gesture-based NUIs assume the user’s hand is a
Natural User Interfaces (NUIs)—encompassing touch, gesture, voice, and gaze-based interaction—are increasingly deployed in augmented reality (AR) headsets and mobile field tools for structural inspections. Roof assessments, in particular, benefit from hands-free interaction: an inspector can point at a suspicious shingle, say "scan this area," and receive an instant material stress reading. Thus, the "instant" is not physical but perceptual—a