Since the volume of multimedia content available on the Web is continuously increasing, a clear need for advanced techniques capable of performing an effective retrieval and management of such data. In this context, in order to reason on digital shapes and their associated semantic, we see a growing interest in exploiting the potential of the Semantic Web in different research fields. We present here the design and initial development of our new system, that we call be-SMART for inspecting digital 3D shapes by extracting geometrical and topological in formation from them and for structuring and annotating these shapes using ontology-driven metadata. We describe the general structure of the system, its modules and their mutual relations. We also provide motivations for further work in developing new techniques for managing 3D models on the Web.