Sketch-Based Object Detection Tool Revolutionizes Cancer Detection.

Researchers at the University of Surrey have developed a framework for object detection based on sketches, which can detect specific objects in a scene without requiring extra boundary boxes or class labels. The model is trained with a multi-category cross-entropy loss across the prototypes of all conceivable categories or instances in a weakly supervised object detection (WSOD) environment. The framework outperforms supervised and weakly supervised object detectors in a zero-shot setting and combines CLIP and Sketch-Based Image Retrieval (SBIR) to produce a sketch-aware detector that can function in a zero-shot fashion.