Reinherit header image

ReInHerit Digital Hub

Object recognition

Referenced webinar(s)

Referenced app(s)

Author(s)
ReInHerit Project

Publication date
April 17, 2023

Terms of reuse
MIT - CC BY 4.0

Share your experience in the ReInHerit chat!

Object recognition is the task of identifying objects in an image or video frame. SSD (Single Shot Detector) and MobileNet are two deep learning-based neural network architectures that can be used for object recognition.

MobileNet is a lightweight neural network architecture designed to run efficiently on mobile and edge devices. It uses depthwise separable convolutions to reduce the number of parameters and computational complexity while maintaining high accuracy. SSD is a single-shot detection neural network architecture that predicts object bounding boxes and class probabilities directly from input images.

When combined, SSD/MobileNet becomes a powerful object recognition system that can run in real-time on mobile and edge devices. The MobileNet backbone is used to extract features from the input image, while the SSD head is used to predict object bounding boxes and class probabilities.

The SSD/MobileNet network is trained on a large dataset of annotated images, which is used to learn the relationships between image features and object classes. During inference, the network takes an input image and outputs a list of predicted object bounding boxes and their corresponding class probabilities.

For these computational capabilities a SSD/Mobilenet object detector has been used in the ReInHerit toolkit Smart Lens app (the app can use also CBIR and image classification) to recognize artwork details.

Example of object detection in Smart Lens

This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 101004545.

EU commission logo