Of course, this technology is also very difficult. And this is not just a technology, it involves many fields, from information control systems, to hardware systems, to the entire telex control system, which is very complex.
Among them, the most rare or core one is the telex control system, and the other is the information control system.
To put it simply, it is to synchronously transmit the data of human arm movement to the robotic arm, so that people can flexibly control the robotic arm just like using an arm.
The principle is very simple, but the actual technology is very complex. The first is the technology for collecting human arm movement information. This technology requires the sensor worn on the body to accurately capture the movement signal of the arm.
Regarding this aspect, there are currently three mainstream solutions.
The first is to use a brain wave control scheme, which is the brain-computer control technology that has become popular recently. In fact, it uses brain waves generated by thinking and imagination to control the movement of related robots.
When we imagine a thing or an image or an object, the brain waves we release are different. Brain-computer control technology uses these different brain waves of us to control equipment.
For example, after your brain imagines an idea of moving forward, the brain will release such a brain wave. The brain-computer system will recognize this brain wave and convert it into corresponding electrical signal instructions to control the device to move forward.
At present, this technology has been applied in some fields, including this kind of brain-computer controlled wheelchair for patients with high paraplegia. Patients can control the wheelchair through their brain to stop movement and so on.
There is also the use of this brain-computer control technology to perform text-related input. It is said that the input speed can reach 70 words per minute, which can be said to be very fast.
At present, some technology companies want to use this brain-computer control technology to develop related bionic mechanical arms (prostheses), so that people with disabilities can also use this bionic mechanical prostheses to obtain corresponding movement operation capabilities.
Although the progress in this area is relatively slow, many companies have developed prototypes of related bionic mechanical prostheses. Although there is still a long way to go before practicality, the most important step has been taken. In the future,
It just requires continuous development and progress.
The second solution is to use sensors to record limb movement trajectories for operational control.
Each of our limbs, such as the movements of the arms and fingers, have trajectory displacements in the three-dimensional space. This solution uses relevant sensors worn on the hands to record these trajectory displacements, and then synchronize them to the robotic arm.
, to achieve synchronous movement of the robotic arm and the human arm.
The third technology is a bionic control technology that uses myoelectric signals to control the movement of the manipulator in real time.
Collect muscle electromyographic signals and joint angle signals when the human upper limbs perform flexion and extension movements on the vertical plane, and input the processed electromyographic signals and time signals into a neural network predictor to predict joint angles.
The predicted joint angles are used as control signals for the virtual manipulator to control the manipulator to perform the same movements as a human.
The test results show that the maximum mean square error between the movement trajectory of the manipulator and the elbow joint angle trajectory of the human upper limb is less than 2°, and there is a strong correlation, realizing the movement of the manipulator controlled by myoelectric signals.
However, this technology is still not mature enough. The main problem is that the capture of these electromechanical signals is not accurate enough, and it is easily interfered by human body bioelectricity and surface static electricity.
Therefore, the second set of solutions is currently the most used and the best solution. In fact, the research on the related technologies mentioned in this set of solutions has always been a key scientific research project of Haoyu Technology.
Because this technology is not only related to the development progress of their related bionic synchronized robotic arms, but also related to the sale of their upcoming VR glasses. Therefore, the research and development of this technology started very early, and there are already good results.
results.
Earlier we mentioned several ways of human-computer interaction with VR glasses. In addition to the control handles currently used by everyone, wearable gloves with sensors all over them have also become a key area of research for many VR manufacturers.
With this wearable control glove, VR glasses users can control many functions. They can even experience grabbing objects in front of them with their hands, or stroking objects in front of them, etc., experiencing things that some interactive devices could not experience before.
Functional feeling.
The team of the Automated Machinery Technology Research Laboratory wants to use this set of technological achievements that have been initially successfully developed to control the robotic arm.
In fact, the principles of the two are basically the same, except that the wearable gloves used on VR eye equipment control virtual limbs in the VR virtual world. In the Automated Mechanical Technology Research Laboratory, this kind of wearable gloves is used
to control a real manipulator.
However, the technical difficulty of controlling a manipulator in reality is much higher than that of manipulating a virtual manipulator in the virtual world.
Problems related to controlling virtual devices can be corrected and compensated by programs. However, controlling real manipulators requires the cooperation of hardware and software.
Not to mention anything else, let’s just talk about the complex parts, numerous sensors, and some related instruction set programs on this manipulator, as well as the coordination and unification between these complex devices. This cannot be developed casually.
from.
Furthermore, this is a complex systematic engineering project involving a wide range of subject areas. Although Wu Hao and his colleagues are constantly strengthening their scientific research capabilities, their advantage is still in information technology, especially in hardware technology, especially basic technology.
It's still relatively weak.
This has brought many unexpected difficulties to the entire R&D team. Some of them can be solved with money, but some cannot even be solved with money.
Therefore, Wu Hao has been paying close attention to the entire project research and development process, and has personally invested in related research and development, helping the research and development team solve many difficult problems.
There are also some issues that can only be figured out together with the R&D team members, such as some problems with materials and parts. On the one hand, they can only figure out solutions on their own, and on the other hand, they can ask some other related equipment and parts.
Parts supplier asks for help.
Even in terms of some materials and important load-bearing and pressure-bearing parts, he also asked relevant military industrial companies for help, hoping that they could manufacture customized parts for him.
Fortunately, he is here as a non-staff expert, so there is no big problem. Moreover, the price of such customized parts is relatively high, and these companies are also willing to accept private orders for these.
