I'm looking for a developer who can create a framework to dynamically create, store, edit and experience a step-by-step sequence. This is not a fixed sequence, but rather a dynamic application, allowing to author/edit the steps and to experience them. The steps eventually need to be stored on a server/website in some format (JSON for instance). A user can then connect to this JSON to experience the sequence.
The user needs first to:
- Establish tracking (for now, selecting some 3D points in space, like corners, will suffice). We just need a reference 3D origin, to be able to place the POI (points of interest) of the sequence on the right spot. No 3D models are needed.
Once 'tracking' is fixed, in editing mode the user can:
- Record information for each step in the sequence, like (3D POI info, speech, text, 3D paths, pictures and /or movies)
- Review steps, to remove or edit them.
Once 'tracking' is fixed, in play-mode:
- Step information is shown: POI informaton with circles/arrows, pictures/movies are playable, text is shown.
- Saying 'Next step' will advance to the next step in the sequence.
So the tools needed are rather easy:
- Most likely Unity 3D
- recording 3D points
- recording audio/images/video
- recording 3D paths (like movement of hand, or of the AR device)
- Displaying content in a nice GUI
- Speech recognition
- Save a sequence to JSON in generic format
- Reading the sequence from JSON and playing it.
The harder part probably is the dynamic essence of the program. We are outsourcing this, because we normally write for VR in a different language. However, we are used to meta-programming and need something similar for this pilot project. So the program should have a lot of prototypes and classes, which are constructed and sequenced by a JSON file.
In a later phase, this should also work on ARKit/ARCore. So not only on Hololens. The JSON should therefore not be Hololens specific.
Let me know if you have any questions. I can explain some more in detail.
17 freelancerów przeciętnie składa ofertę za €27/godz. do tego projektu
Hello, Thank you for your job posting. I have I have rich experience in AR app development. I provide you best quality and 100% support. Please check my portfolio Look forward to hearing from you. Regards