React-Native with 3D Animation | sensor accelerometer

Question

all right?

I’m starting a very unusual React-Native project involving React-Native and 3D sensors.

I have an accelerometer, motion sensor, which is attached to strategic points of the human body. Arms, leg, back and etc...

I receive the data from the quiet axes however, I would like to express these movements in a 3D animation, where the person moves, I receive the data and my "character" repeats the movements. The App needs to be in React. I’ve seen some things with Unity but React-Native and Unity don’t speak very well, as far as I know.

Does anyone have any idea how I can do this?

I want to model using Blender but I’m still pretty lost in it.

Can you give me that light? Thanks for your attention.

Answer 1

You can use Rigging Animation in Unity to make a detailed simulation of the animation with each joint, it will be your biggest challenge but it is not impossible, have a lot of good material on the internet, even more if you know English.

For the exchange of data you could make a Nodejs server or ASP.NET (as you prefer) as an intermediary between the two can use JSON formats, it is great to do this part, Unity 2020 has a new implementation of the old Web Request and is well functional, here the documentation to help.