SENSO3D Kicks Off: The Journey Begins!

Welcome to SENSO3D — Where AI Meets Immersive 3D Innovation

We are proud to announce the official launch of the SENSO3D project, a breakthrough initiative under the CORTEX2 Horizon Europe Program. Developed by the R&D team at Sensomatt, SENSO3D aims to revolutionize 3D content creation using artificial intelligence, enabling rapid generation of interactive, immersive environments from 2D data.

The project officially started on July 1, 2024, and will run for nine months, concluding in March 2025. SENSO3D has been selected as part of CORTEX2 Open Call Track 1, focusing on the co-development of tools that bring next-generation extended reality (XR) applications to life.

What Is SENSO3D?

SENSO3D is an AI-powered 3D object library and scene generation platform,designed to simplify how designers, developers, and content creators build virtual environments for use in AR/VR, digital twins, simulation, training, and interior design

Our goal? To enable automatic 2D-to-3D conversion, scene detection, object classification, and even full environment creation based on text descriptions — all packaged into a Unity/WebXR-ready toolkit.

What Have We Done So Far?

This first month has been focused on planning, setup, and R&D initiation. Key activities in July include:

  • Defining the AI Model Pipeline: We are finalizing which machine learning architectures will support object detection, reconstruction, and classification.

  • Planning Data Collection: We’re preparing to capture thousands of 2D images and start building a dataset of office and interior objects—essential for
    training our AI models.
  • Toolchain Assembly: The development team has configured the full production pipeline, including:

    o Git-based version control for 3D assets
    o Unity project workspace
    o Integration planning for WebXR

Git-based version control for 3D assets

  • Establishing KPIs and Milestones: Our first set of KPIs is aligned with object detection accuracy, repository size, Unity integration, and use-case deployment.

Why It Matters

In a world moving rapidly toward remote collaboration and immersive media, tools like SENSO3D can democratize access to XR development, making it easier for small businesses, educators, designers, and creators to produce 3D content—without advanced technical skills.

SENSO3D supports:
  • Virtual training environments
  • Remote business meetings in VR
  • Scene planning for architecture & interior design
  • Educational simulations and digital storytelling

What’s Next?

In August, our work will shift toward:

  • Training and testing early AI models
  • Starting the 3D scanning of selected office and conference room objects
  • Laying the foundation for the first Unity-based interactive prototype We’re just getting started—big things are coming!

Stay Connected

Follow the journey and see how AI is transforming the way we build virtual spaces.📩 Subscribe to our newsletter for monthly updates, video demos, and early access previews

Published On: July 31, 2024Categories: Project News