Willow Garage Blog
Clearpath Robotics aims to progress robotics development by providing universities with robust platforms for prototyping and research. To give robotics research an extra boost, Clearpath Robotics introduced the PartnerBot Grant Program this summer.
The PartnerBot Grant Program is a one-year commitment during which a prestigious research team will use the Clearpath Robotics Husky A200 to pursue its research goal, publish for public review, and add code to the rapidly growing open source ROS (Robot Operating System) community. Initially aimed at donating $25,000 worth of equipment, the sheer number of applicants and outstanding quality of the submissions prompted Clearpath Robotics to increase the total value to $100,000.
The Husky A200 is a rugged, all-terrain robotic platform for rapid prototyping and research applications. In the past we've seen it used for prototyping planetary rovers, researching autonomous navigation, environment mapping, and countless other applications. The Husky A200 integrates seamlessly with the free and open source ROS robotics framework that offers full control of the Husky, including (but definitely not limited to) autonomous navigation, perception, and mapping. Using the standardized platform and open software allows researchers to cooperate, share findings, and repeat experiments.
More than 150 universities world wide showed interest in the PartnerBot Grant Program. Clearpath Robotics has received submissions from every continent on the planet (except from Antarctica) with applications ranging from mine clearing, to agricultural robots, to planetary rovers, and everything in between. With such a great turnout and impressive applications it seemed a shame to support only one research project, so Clearpath Robotics has worked feverishly over the past month to scrape together enough money to support the following 10 distinguished research teams.
- University of California, Santa Cruz
- University of Coimbra
- Orebro University
- Universidad de Chile
- Drexel University
- Federal University of Minas Gerais
- University of Hohenheim
- University of Michigan
- Queensland University of Technology
- University of Bremen
Clearpath Robotics would like to thank everyone who invested time and energy to submit a proposal. The judging process was tough, selecting only one would have been impossible - even 10 was difficult. To read more about the outstanding research projects and PartnerBot recipients, visit the PartnerBot site.
During his internship at Willow Garage, Aaron Blasdel, a recent graduate from The University of Tokyo, developed software to model and analyze robotic grippers.
Due to the broad and varied nature of the robot grasping and manipulation problem, new and interesting grippers are regularly constructed. Aaron constructed models of the Robotiq 3-Fingered Adaptive Gripper and various configurations of the Sandia Hand for the publicly available GraspIt! simulator. In the case of the Robotiq hand, the challenge was to model in simulation its mechanical adaptation capabilities. For the modular Sandia Hand, which uses fingers magnetically attached to a palm structure to form a virtually limitless number of possible designs, Aaron analyzed and compared a number of different configurations. For both hands, he then used the simulation engine to pre-compute grasps for a large set of common household objects.
Simulation and optimization can help us better use existing hand models, and also find new points in the design space which can in turn lead to functional improvements in the future.
During his internship at Willow Garage Tobias Kunz, a PhD student from Georgia Tech, worked on a project to enable the PR2 to quickly transport objects on a tray without them falling off. This effort in conjunction with the sushi challenge aim to give robots the ability to perfrom tasks like efficient transport of every day objects and dynamic place setting.
Dynamic trajectories are important for robots to execute delivery or butler tasks at home in a timely manner. The problem also appears in industrial robotics when objects are transported on tray-like end-effectors at high speeds. An identical problem is that of carrying an open container of liquid. Just keeping the tray horizontal is not enough to keep the object from sliding off when moving fast.
Instead, the tray needs to be tilted in a way that minimizes lateral force on the object.
Tobias implemented two different methods. The first method explicitly calculates the time-optimal trajectory for a free-floating tray along a straight line in workspace given constraints on the linear and angular accelerations of the tray. The second method considers arbitrary paths and the kinematic limitations of the robot arm. STOMP, a local trajectory optimization method, is used to iteratively minimize the lateral force acting on the object while also avoiding obstacles. The video shows the PR2 executing trajectories generated by this this method using different types of objects with different start and end locations for the tray.
Tobias’ work demonstrates the use of motion planning to enable robots to execute tasks with complex dynamic constraints. His goal is to get robots to do even more complex tasks in the future, just like humans can.
You can download and playback these dynamic butler trajectories on your own PR2 robot. The necessary instructions are available here.
The business model at Willow Garage is built on the premise that we will spin off businesses when we see near-term market potential and when we see the opportunity to make a difference in people's lives. We now have seven spin-offs, and while we love all our children equally, today belongs to Suitable Technologies.
Suitable today introduced Beam Remote Presence System, a mobile videoconferencing platform. Beam lets people be in two places at once – literally. The Beam is driven by its pilot from anywhere with an Internet connection and uses Beam as their remote presence at a different location. The video below provides a good overview of how Beam will be used.
Beam is no robot. To paraphrase Senator Lloyd Bentsen, we know robots, and Beam is no robot. For example, there is no autonomy whatsoever with Beam. Everything is controlled by the Beam pilot working remotely.
We have, however, conducted a great deal of research on the implications of robots someday working alongside and physically sharing space with humans. That research has been incorporated into the design of Beam in order to produce a solution that will effortlessly slip into the workplace. For example, our research, (along with our personal experience) shows that it only takes about twenty minutes on average before a person forgets they are interacting with someone via Beam and begins to take for granted that they are simply having a conversation with a colleague.
By now, the story of Suitable's beginnings are familiar to anyone that follows Willow Garage. Dallas Goecker, a Willow Garage electrical engineer working remotely from Indiana, grew tired of being the lone voice on the Polycom during company meetings. Skype also fell short because Dallas needed mobility to truly interact with his co-workers. A DIY initiative known as Project Texai was created to fashion a mobile device that allowed Dallas to remotely control where and when he wanted to go within Willow's office. Texai touched a nerve in the market, and even made a guest appearance as Shel-bot on the Big Bang Theory. Ultimately, "Skype on a stick" fell short with respect to networking, navigation, and audio. The team at Suitable then went back to the drawing board.
Following 18 months of R&D, Beam offers state-of-the-art technology in a sleek RPD. We wish them the best of luck as Beam hits the market.
During his internship at Willow Garage, Adam Zimmerman from the University of Illinois, created a version of Rviz for Android tablets. Rviz is a ROS visualization program used to help understand robot systems by providing a 3D environment that lets users see the world from a robot's perspective. This project was started in response to community demand for a mobile robot visualizer that ran on a tablet.
Rviz for Android uses a custom-made OpenGL rendering engine to display information received in ROS messages. The application was written in Java using the ROSJava API to publish and subscribe to ROS topics and transform between TF frames. The Rviz for Android interface is similar to the desktop Rviz interface, featuring a view panel and a list of enabled display types. The 3D display panel is manipulated using intuitive touch gestures. Many of the standard Rviz display types, such as robot model, point cloud, map, and interactive markers, are included. Instructions for adding new display types and camera controls are available online on the source code repository. A Web server, written in Python, runs alongside the ROS core to supply the tablet with meshes and textures referenced by URDF files and marker messages. This server can also create ROS nodes upon request from the tablet. These created nodes can be any ROS application, including message throttlers or compressors to more easily move large amounts of data to the tablet.
Because very little of the desktop Rviz code was portable to the Android platform, Rviz for Android is written almost entirely from scratch. Porting all of the desktop C++ Rviz code to Android using the Android NDK wasn’t a feasible solution for this project. The desktop Rviz code makes use of the Ogre3D graphics engine which has tenuous Android support. Even if Ogre3D was well supported on Android, a good deal of the Rviz code would need to be rewritten in Java to interface with ROSJava. Compiling roscpp natively on an Android device is outside the scope of the Android NDK and requires a good deal of functionality that it doesn't currently include. Another alternative considered was to use an HTML5 Web visualizer like wviz, but WebGL and Web sockets have extremely limited support on current iOS and Android devices. Rviz for Android lets users visualize and debug robot applications in environments where using a desktop or laptop computer is impossible. It provides an intuitive touch interface and an easily extensible platform to meet the needs of any robot application. The application supports any Android tablet running Android 3.2 or higher, and the source code, compiled application package, and tutorials for creating new display types are available online at https://bitbucket.org/zimmrmn3/rviz-for-android
Irene Rae from the University of Wisconsin-Madison spent the summer of 2012 exploring how the appearance of an embodied system affects the interaction between people using that system to communicate.
While embodied systems like the Texai can provide greater access to informal and opportunistic interactions to remote users, their physical traits such as height, color, or proportion may mediate the way that people who are local to the system might treat them.
The study looked at how changes as simple as modifying the height of the system may cause subtle shifts in the way that the local user behaves toward the remote user, possibly supporting or undermining the remote user’s authority and ability to persuade others.
Look for the final results in our upcoming publications!
If you have a robot that needs to move, MoveIt is the planning framework for you. MoveIt is an open source project that includes various planning techniques, kinematics, dynamics, collision checking, constraints evaluation and sampling, visualization, and more. To easily enable MoveIt to run on your robot, Dave Coleman of the University of Colorado Boulder and Willow Garage intern developed the MoveIt Setup Assistant to get your robot quickly up and running.
MoveIt is a framework that connects a wide variety of planning techniques and collision-checking algorithms to useful tools such as benchmarking and visualization. The MoveIt Setup Assistant helps you generate all needed configuration and launch files, with an easy to use visual front.
Additionally, Dave contributed to the Open Motion Planning Library (OMPL) by implementing a new planning algorithm, Transition-based RRT, that keeps random tree search in low cost regions of the configuration state. This is convenient for minimizing objectives such as mechanical work over a trajectory, or taking probability of occupancy into account in an occupancy grid.
Finally, to aid OMPL development, Dave developed the ompl_rviz_viewer. The visualizer shows cost maps in RViz along with all searched states, nodes and edges from a planner. It also serves as a good code example for anyone hoping to get started with OMPL.
Dave’s work with MoveIt and OMPL this summer at Willow Garage contribute to the overall progress of robotic planning and its adoption by roboticists everywhere.
For more information visit:
Today marks another significant milestone in Willow Garage's mission to create a personal robotics industry. Willow Garage is proud to announce the creation of its latest spin-out: hiDOF, Inc., a software consulting company. The name is a play on the fact that the founding team has extensive experience with high degree of freedom systems.
hiDOF will be applying robotics technology to commercial applications, and is founded by Willow Garage engineers who believe in the power of using open source software to provide increased value to customers. Over the last few years, hiDOF’s founders have authored and maintained many of the core ROS tools, and programmed the PR2 to do everything from recharging itself to fetching beer. Now, with hiDOF, they are excited to leverage these tools to solve real-world problems, while providing the community with battle-tested code.
The hiDOF team is available for a variety of consulting and contracting services. If you have a difficult automation problem that requires greater flexibility, hiDOF can help. hiDOF also provides extensive technology transfer services. They can harden an algorithm, optimize an approach, or create an amazing technology demonstration.
hiDOF is ready to take on difficult automation challenges that other's can't solve. hiDOF believes that industrial automation is on the cusp of a revolution in flexibility, robustness, and safety.
The hiDOF team leverages ROS to solve complex problems quickly. The founding team authored many of the core components of ROS, giving hiDOF a wealth of deep expertise and knowledge across the entire ROS ecosystem. They can build everything from drivers and controllers all the way through high-level capabilities like navigation and manipulation.
Harnessing the Cloud
hiDOF has experience building large, scalable cloud solutions.
Creating an Industry
Since Willow Garage was founded in 2006, there have now been seven spin-outs. Given that our goal is to create a new robotics industry, we think seven new companies in six years is a pretty good start. Those companies are:
·Industrial Perception Inc. - IPI is working on integrating perception technology with industrial robots.
·OpenCV - An open source computer vision and machine learning software library built to provide a common infrastructure for computer vision applications and to accelerate the use of machine perception in the commercial products.
·Open Perception Foundation – Their mission is to advance the development and adoption of open source software for 2D/3D processing of sensory data, for the benefit of the industrial and research communities.
·Open Source Robotics Foundation - OSRF is an independent non-profit formed to support the development, distribution, and adoption of open source software for use in robotics research, education, and product development.
·Suitable Technologies - Creating an innovative new remote presence product.
It is with great pride that we inform you that Willow Garage's Dr. Leila Takayama been named to MIT Technology Review's TR35 Listing of the World's Top Young Innovators for 2012. The TR35 recognizes the world's top innovators under the age of 35, spanning energy, medicine, computing, communications, nanotechnology, and other emerging fields. Proving that innovation and creativity go hand in hand, this award follows up Dr. Takayama's earlier recognition by Fast Company magazine as one of The 100 Most Creative People in Business 2012.
Dr. Takayama has been honored for her work in the field of human-robot interaction, and was selected as a member of the 2012 TR35 by a panel of expert judges and the editorial staff of Technology Review, who evaluated more than 250 nominations. She will join other TR35 honorees in discussing their achievements at the EmTech MIT 2012 conference, taking place at the MIT Media Lab in Cambridge, MA on October 24-26, 2012.
A Research Scientist at Willow Garage with a background in Cognitive Science, Psychology, and Human-Computer Interaction, her current focus is understanding human encounters with robots in terms of how they perceive, understand, feel about, and interact with robots. Among other things, she is working on teaching the robots some manners.
She serves on the steering committee for the Human-Robot Interaction conference and recently completed editing the inaugural special issue of the Journal of Human-Robot Interaction, which is an open access publication. She is also serving on the World Economic Forum Global Agenda Council on robotics and smart devices, which recently convened in Singapore.
In the words of Jason Pontin, editor-in-chief and publisher of Technology Review, "This year's TR35 recipients are applying technology to some our generation’s greatest challenges, and innovating to improve the way we live and work. We look forward to watching these young technology leaders grow and advance over the coming years."
Please join all of us at Willow Garage in congratulating Dr. Takayama on this prestigious award.