Skip to main content

How to teleoperate robotic manipulators in real-time

Innovative teleoperation system for real-time robot control

Imitation learning presents a viable approach for instructing robots to consistently perform routine tasks, such as dishwashing and cooking. However, the efficacy of these frameworks hinges on comprehensive human demonstrations, encompassing data that enable the replication of precise movements by robotic system.
One approach to obtaining these demonstrations is through teleoperated system, where humans control robotic manipulators to execute designated task. Despite their potential, manyh current teleoperation systems struggle to accurately process and replicate the sophisticated, coordinated movements characteristic of human performace.
Researchers at the University of California, San Diego have unveiled Bunny-VisionPro, a novel system enabling the teleoperation of robotic systems for bimanual dexterous manipulation tasks. Presented in a recent paper on the arXiv preprint server, this system aims to streamline the process of gathering human demonstrations for imitation learning.
According to co-author Xiaolong Wang, "Our latest paper was driven by the imperative to enhance bimanual dexterous teleoperation in robotics," he shared with Tech Xplore.
"We observed that current vision-based teleoperation systems seldom emphasize dual-hand control, which is essential for intricate tasks demanding had coordination."
Wang and his colleagues focused their latest research on developing a universal teleoperation system that could effectively generalize across diverse robots and tasks, significantly simplifying the acquisition of demonstrations for robotic control algorithm training.
Their developed system, Bunny-VisionPro, has the potential to render teleoperation and demonstration data collection as intuitive and immersive as a VR gaming experience.
"According to Wang, Bunny-VisionPro, is a pioneering bimanual dexterous teleoperation system enabling human operators to mange dual robot arms and multi-fingered hands in real-time, thereby enhancing the quality of demonstrations collected for imitation learning."
The team's system enables teleoperation of a portable and lightweight device, enhancing user interaction with visual and haptic feedback for a fully immersive experience.
The Bunny-VisionPro system has shown in initial testing its capability to safely control robotic manipulators in real-time with minimal latency, effectively avoiding collisions with nearby obstacles. its straightforward installation and deployment in laboratory setups make it an ideal choice for gathering demonstrations in robotics laboratories.
The Bunny-VisionPro system comprises three essential modules: an arm motion control module, a hand and motion retargeting module, and a haptic feedback module.
"According to Wang, Bunny-VisionPro's arm motion control module excels in translating human wrist poses to the robot's end-effector poses, overcoming challenges such as singularities and collision prevention. The hand and motion retargeting module extends this capability to accurately map human hand poses, including intricate loop-joint structures, to corresponding robot hand configurations. Finally, the haptic feedback module enchances user immersion by converting robot tactile sensing into human-perceptible haptic feedback, leveraging sophisticated algorithmic and hardware designs."
The new teleoperation system devised by Wang and his colleagues excels in enabling real-time, safe control of bimanual robotic systems. Setting it apart from previous solutions, this system seamlessly integrates both haptic and visual feedback, enhancing the immersive experience for human operators during demonstration collection and significantly boosting teleoperation success rates.
"Our developed real-time bimanual dexterous teleoperation system strike a crucial balace between safety and performance," Wang emphasized. "It empowers precise control over robotic arms and multi-figered hands with minimal latency, seamlessly integrating collision avoidance and sigularity handling. This capability is pivotal for ensuring reliable operation across diverse real-world robotic applications."
The advancements led by Wang and his team promise to streamline teleoperation for gathering demonstrations in imitation learning frameworks. Looking ahead, Bunny-VisionPro has the potential for global adoption in robotics labs and could serve as a catalyst for the creation of comparable immersive teleoperation systems.
"In forthcoming studies, our aim is to augment manipulation capabilities through the integration of tactile data, enhancing precision and adaptability," Wang explained. "Moreover, our system's open-source code is readily available for access on GitHub.
Further details: The paper authored by Runyu Ding and colleagues, "Bunny-VisionPro: Real-time Bimanual Dexterous Teleoperation for limitation Learning," is available on arXiv (2024). DOI: 10.48550/arxiv.2407.03162


What is FS News 365?

FS News 365 is your go-to source for the latest news and updates on a wide range of topics, including technology, science, health, and more. Our mission is to provide timely and accurate information to keep you informed and engaged.

How often is the content updated?

We strive to update our content daily with the latest news and developments. Be sure to check back frequently or subscribe to our newsletter for regular updates.

Who writes the articles for FS News 365?

Our articles are written by a team of experienced journalists and industry experts who are passionate about delivering high-quality news and insights to our readers.

How can I subscribe to FS News 365?

You can subscribe to our newsletter by entering your email address in the subscription box on our homepage. This way, you'll receive regular updates directly to your inbox.

Can I contribute to FS News 365?

Yes, we welcome guest contributions from knowledgeable individuals in various fields. If you're interested in writing for us, please visit our "Contact Us" page and submit a proposal.

Is FS News 365 available on social media?

Yes, you can follow us on our social media channels for real-time updates and to join our community of readers. Links to our social media profiles can be found on the blog.

How do I navigate the blog?

Our blog is designed for easy navigation. Use the menu at the top of the page to explore different categories and sections. You can also use the search bar to find specific topics or articles.

Are there any advertising opportunities on FS News 365?

Yes, we offer various advertising options. For more information, please visit our "Advertise With Us" page or contact us directly through the "Contact Us" page.

How do I report a problem with the website?

If you encounter any issues with our website, please let us know by using the "Contact Us" page. We appreciate your feedback and will work to resolve any problems promptly.

Labels:

Comments

Post a Comment

Popular posts from this blog

NASA chile scientists comet 3i atlas nickel mystery

NASA and Chilean Scientists Study 3I/ATLAS, A Comet That Breaks the Rules Interstellar visitors are rare guests in our Solar System , but when they appear they often rewrite the rules of astronomy. Such is the case with 3I/ATLAS , a fast-moving object that has left scientists puzzled with its bizarre behaviour. Recent findings from NASA and Chilean researchers reveal that this comet-like body is expelling an unusual plume of nickel — without the iron that typically accompanies it. The discovery challenges conventional wisdom about how comets form and evolve, sparking both excitement and controversy across the scientific community. A Cosmic Outsider: What Is 3I/ATLAS? The object 3I/ATLAS —the third known interstellar traveler after "Oumuamua (2017) and 2I/Borisov (2019) —was first detected in July 2025 by the ATLAS telescope network , which scans he skies for potentially hazardous objects. Earlier images from Chile's Vera C. Rubin Observatory had unknowingly captured it, but ...
Post a Comment
Read more

bermuda triangle rogue waves mystery solved

Bermuda Triangle Mystery: Scientist Claims Rogue Waves May Explain Vanishing Ships and Aircraft for decades, the Bermuda Triangle has captured the world's imagination, often described as a supernatural hotspot where ships vanish and aircraft disappear without a trace. From ghostly ships adrift to unexplained plane crashes, this stretch of ocean between Bermuda, Puerto Rico and Florida remains one of the most infamous maritime mysteries. But now, Dr. Simon Boxall, an oceanographer at the University of Southampton , suggests the answer may not be extraterrestrial at all. Instead, he argues that the truth lies in rogue waves — giant, unpredictable surges of water capable of swallowing even the largest ships within minutes. The Bermuda Triangle: A Legacy of Fear and Fascination The Bermuda Triangle has inspired decades of speculation , with theories ranging from UFO abductions to interdimensional rifts. Popular culture, documentaries and countless books have kept the legend alive, of...
Post a Comment
Read more

nist breakthrough particle number concentration formula

NIST Researchers Introduce Breakthrough Formula for Particle Number Concentration Understanding the number of particles in a sample is a fundamental task across multiple scientific fields — from nanotechnology to food science. Scientists use a measure called Particle Number Concentration (PNC) to determine how many particles exist in a given volume, much like counting marbles in a jar. Recently, researchers at the National Institute of Standards and Technology (NIST) have developed a novel formula that calculates particle concentrations with unprecedented accuracy. Their work, published in Analytical Chemistry , could significantly improve precision in drug delivery, nanoplastic assessment and monitoring food additives. Related reading on Nanotechnology advancements: AI systems for real-time flood detection . What is Particle Number Concentration (PNC)? Defining PNC Particle Number Concentration indicates the total count of particles within a specific volume of gas or liquid,...
Post a Comment
Read more