Sunbiose

Technologies
#
Mobile AR
#
Virtual Reality
#
Generative AI
#
Unity
Composite project artwork: mobile AR devices, Agri-PV orchard and Meta Quest 3 learner.
Categories
#
Augmented Reality
#
Virtual Reality
#
Artificial Intelligence
#
Education
#
Maintenance & Installation
#
Industrial education

AR, VR & AI for solar training

Helping people visualize agrivoltaic systems, learn installation procedures and understand the reasoning behind every answer.

Agriculture and solar energy, on the same land

Sunbiose investigated how agriculture and solar electricity generation can share the same land. This approach, known as Agri-PV or agrivoltaics, places solar installations above crops while keeping agricultural production at the heart of the design. The project combined field research, system development and knowledge sharing to support practical, economically viable applications.

The Dutch government-funded project brought together a large, multidisciplinary consortium of research institutions, technology companies and agricultural organizations. Coordinated by Renergize Consultancy, it included Wageningen Research, TNO, GroenLeven, Brite Solar and ZLTO. Its research addressed crop growth, light management, soil and biodiversity, alongside technical and business considerations.

Sunbiose received Dutch government funding through the MOOI programme, administered by RVO (Netherlands Enterprise Agency), under project MOOI22003.

Visit the Sunbiose project website · Official project record · RVO MOOI programme

Zumoko’s role: from visualization to interactive learning

As the technology contractor, Zumoko developed and delivered the Agrisolar AR mobile application, the Sunbiose VR training application, and their shared AI and content-production infrastructure. Our work covered application development, interactive 3D demonstrations, assessments, multilingual narration and integration with the project’s e-learning platform.

The result connects three ways of learning: exploring solar installations in augmented reality, practising procedures in an immersive virtual environment, and receiving AI-assisted explanations tailored to quiz answers.

  • 2 applications: Mobile AR and standalone VR
  • 64 learning steps: Structured installation content
  • 85 quiz questions: Across three assessment modules
  • 2 languages: Dutch and English text and narration

Mobile AR: make Agri-PV tangible

The Agrisolar AR app for iOS and Android turns a phone or tablet into a window onto a solar installation. Users can place a virtual canopy on a tabletop, reposition and rotate it, or explore the structure at full scale on location. Moving around the model helps people understand its dimensions, components and relationship to the surrounding space.

Information is tailored to growers, residents and policymakers, explaining topics such as light management, crop protection and ecological considerations. Additionally there are eight AR learning topics with associated quiz questions for installers that cover the inverter system, components, grounding, DC and AC connections, smart dongles and signal cabling. Animated 3D guides make assembly sequences easier to follow.

Zumoko built the mobile experience with Unity 6, AR Foundation, ARKit and ARCore. QR codes and deep links connect the consortium’s e-learning platform directly to relevant content inside the app, bringing web-based learning and spatial demonstrations together.

Agrisolar AR solar canopy and orchard viewed on a tablet.
Agrisolar AR inverter model and animated cable routes on a tablet.
Agrisolar AR demonstration with a mobile device and a shared display.

1 / 3

VR training: learn inside a virtual solar orchard

The Sunbiose VR application for Meta Quest 2 and Meta Quest 3 places learners inside a virtual Agri-PV orchard. They can study an inverter system at close range, follow narrated 3D demonstrations and work through installation sequences at their own pace.

Training covers inverter components, mounting, grounding, electrical connections and cable assembly. Detailed models and animations show how parts fit together and how connections are made. Learners can move backwards and forwards through the lesson, replay a demonstration and then check their understanding through interactive assessments.

Zumoko developed the standalone VR application in Unity 6 with the Universal Render Pipeline, Meta XR SDK and XR Interaction Toolkit. We optimized models, materials, lighting and cable geometry for headset use, and delivered Dutch and English interfaces, lesson text and narration.

Learner using Meta Quest 3 while the Sunbiose VR application is mirrored on a laptop.
Dutch narrated learning content inside the Sunbiose virtual Agri-PV orchard.
Close-up 3D inverter component demonstration in Sunbiose VR.
Animated signal connector assembly in the Sunbiose training application.

1 / 4

AI that explains the answer

Our AI development extended beyond content authoring. Zumoko built a shared AI feedback service for the AR and VR applications so learners can understand why an answer is correct or incorrect. After answering a quiz question, they can request an explanation based on their selected answers, the question and the lesson context, with both text and spoken feedback.

Context-aware explanations with Google Gemini

We developed a generation workflow using Google Gemini large language models, with lesson material and the inverter manual supplied as context. The explanation is tied to the training content and the learner’s answer combination. Gemini context caching supports reuse of that reference material during generation.

A shared backend for AR and VR

To make common responses readily available, we pre-generated feedback for 1,315 answer combinations across 85 quiz questions. Text is stored in Firebase Realtime Database, with narration in Cloud Storage. Python Cloud Functions retrieve the appropriate explanation for the question, answers and selected language.

When a stored response is unavailable, a live-generation fallback uses Gemini and text-to-speech to produce feedback. The applications also cache audio for replay. This combines prepared learning content with on-demand generative AI in one service used by both applications.

Dutch multiple-choice inverter quiz in Sunbiose VR.
Correct and incorrect answer feedback in the Agrisolar AR mobile quiz.

1 / 2

AI-assisted content production, built for reuse

Zumoko also developed the tools that turn source lessons into application-ready learning content. Our Python automation pipeline processes structured CSV content, generates translations through the OpenAI API, and prepares narration using OpenAI text-to-speech and local Piper ONNX voices.

The pipeline produces JSON data, audio files and PDF review documents, then imports the content into Unity ScriptableObjects. AI tools supported lesson authoring and translation, while the review documents made the resulting material available for checking before application integration.

This shared workflow supports consistent terminology, narration and quiz content across mobile AR and VR. It also provides a repeatable process for updating lessons and producing language variants without rebuilding each screen manually.

What Zumoko delivered

  • Two immersive applications: Agrisolar AR for iOS and Android, and Sunbiose VR for standalone Meta Quest headsets.
  • Interactive training content: solar-canopy visualization, detailed inverter models, animated installation procedures and three quiz modules.
  • AI learning services: contextual explanations, prepared answer combinations, live-generation fallback and narrated feedback.
  • A reusable production pipeline: AI-assisted authoring, translation, speech generation and structured content import.
  • A connected learning experience: Dutch and English content, plus QR-code and deep-link integration with the project’s e-learning platform.

Together, these deliverables translate technical Agri-PV knowledge into experiences people can explore, replay and assess. They support Sunbiose’s knowledge-sharing goals by making solar technology more accessible to stakeholders and installation learners.

Technology stack

Unity 6 · C# · Universal Render Pipeline · AR Foundation · ARKit · ARCore · Meta XR SDK · XR Interaction Toolkit · Python · Google Gemini · OpenAI API · Firebase · Cloud Functions · Text-to-speech · Piper ONNX

Our Best Work

01 / 13

Build your next AR, VR or AI application

Share your contact details,
and we will make sure to get in touch!