Towards Sim-to-Real Industrial Parts Classification with Synthetic DatasetShow others and affiliations
2023 (English)In: Proceedings, 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops: Vancouver, Canada 18 – 22 June 2023, IEEE, 2023, p. 4454-4463Conference paper, Published paper (Refereed)
Abstract [en]
This paper is about effectively utilizing synthetic data for training deep neural networks for industrial parts classification, in particular, by taking into account the domain gap against real-world images. To this end, we introduce a synthetic dataset that may serve as a preliminary testbed for the Sim-to-Real challenge; it contains 17 objects of six industrial use cases, including isolated and assembled parts. A few subsets of objects exhibit large similarities in shape and albedo for reflecting challenging cases of industrial parts. All the sample images come with and without random backgrounds and post-processing for evaluating the importance of domain randomization. We call it Synthetic Industrial Parts dataset (SIP-17). We study the usefulness of SIP-17 through benchmarking the performance of five state-of-the-art deep network models, supervised and self-supervised, trained only on the synthetic data while testing them on real data. By analyzing the results, we deduce some insights on the feasibility and challenges of using synthetic data for industrial parts classification and for further developing larger-scale synthetic datasets. Our dataset † and code ‡ are publicly available.
Place, publisher, year, edition, pages
IEEE, 2023. p. 4454-4463
Series
IEEE Computer Society Conference on Computer Vision and Pattern Recognition workshops, ISSN 2160-7508, E-ISSN 2160-7516
Keywords [en]
Benchmarking, Computer vision, Deep neural networks, Internet protocols, Five state, Industrial parts, Industrial use case, Performance, Post-processing, Randomisation, Real-world image, State of the art, Synthetic data, Synthetic datasets, Classification (of information)
National Category
Computer Vision and Robotics (Autonomous Systems)
Research subject
User Centred Product Design
Identifiers
URN: urn:nbn:se:his:diva-23236DOI: 10.1109/CVPRW59228.2023.00468Scopus ID: 2-s2.0-85170821045ISBN: 979-8-3503-0249-3 (electronic)ISBN: 979-8-3503-0250-9 (print)OAI: oai:DiVA.org:his-23236DiVA, id: diva2:1799175
Conference
2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Vancouver, Canada 18 – 22 June 2023
Funder
Knut and Alice Wallenberg FoundationSwedish Research Council, 2018-05973
Note
© 2023 IEEE.
This work is partially supported by the Wallenberg AI, Autonomous Systems and Software Program (WASP) funded by the Knut and Alice Wallenberg Foundation. The computations were enabled by resources provided by the Swedish National Infrastructure for Computing (SNIC), partially funded by the Swedish Research Council through grant agreement no. 2018-05973, as well as by the Berzelius resource provided by the Knut and Alice Wallenberg Foundation at the National Supercomputer Centre.
2023-09-212023-09-212023-10-10Bibliographically approved