Willow Garage Blog

February 5, 2010

PR2 Beta Program

We anticipated strong interest in our PR2 Beta Program -- a PR2 at no cost does create quite a stir. Nonetheless, we're overwhelmed by the volume of responses we received: 120 Letters of Intent! We'll be busy in March reading through all of the full proposals. 

We're excited by the summaries we've read, and impressed by the breadth of proposed projects. The letters arrived from universities, companies, robotics clubs, and hackerspaces. The proposed programs cover the research areas and domains that we hoped to reach with the PR2, from motion planning to multi-robot coordination, and from education to eldercare. We appreciate the level of interest and commitment to open-source robotics software these letters represent.

We were surprised and impressed by the number of international letters. We received letters from twenty-seven countries, on five different continents. Although for logistical and support reasons we expect that most of the robots will go to North American institutions, the quality of the international presence has us convinced that this will be a global program.

It won't be long until March 1st when we have the full proposals. Thank you all for participating.

February 1, 2010

Texas Alpha Prototypes

As you can see from the photos above, our build of 25 Texas Alpha (TA) telepresence robots is well underway. The 25 Texases, a.k.a. "Texai", are now in the office, and we're busy bringing them online. The docking stations arrived on Thursday, but we're having trouble finding 25 outlets to plug them into!

Our Texas Alpha team spent long nights making this happen quickly, and it's fair to say that the rest of the office was stunned when they came in to work and saw the scene above. We now have 25 TAs, 5 PR2 Betas, 3 PR2 Alphas, and an original Texas. We're not quite at one robot per employee, but, with more PR2 Betas in production, we're getting there.

The big question is, "What are we going to do with 25 Texai?" We're working on that. We've already seen how one Texas robot could positively affect the relationship of one employee with the rest of the company -- now we'd like to see what effect many can have. The Texas Robot surprised us as an unplanned byproduct of our efforts with the PR2 and ROS, but we know a good robot when we see one.

We've already planned for some formal and informal uses. Some of them will be used for Human-Robot Interaction research. Others will be deployed at various sites and companies to study the mobility, networking, and social challenges that must be addressed in the design of robot telepresence platforms.

We're also going to use them ourselves. Although we only have one employee in Indiana, we have several working remotely from home and from the Willow Garage Ski House. We'll see if the Texai can teach PR2 some tricks on the slopes.

January 28, 2010

With our recent post highlighting the work of OpenCV's Victor Ehruhimov on the Texas Robot, it's worth bringing the community up-to-date on the the work that is going into OpenCV.

OpenCV is a computer vision library started as an open source project at Intel. In the last two years, Willow Garage has become the primary backer of this library, which is released under the BSD license, which makes it free for any use, commercial, research, or otherwise. Currently, OpenCV has an active user group of over 40,000 members and has been downloaded well over two million times.

Willow Garage is focused on expanding the capabilities of OpenCV for robot perception. We want OpenCV to be an important library for helping robots see. Before we could do this, we recognized that it was necessary to modernize the decade-old library. OpenCV has undergone a Renaissance, adding full new C++ (by Vadim Pisarevsky) and Python (by James Bowman) interfaces. It has also added new texture recognition features and Marius Muja and Professor David Lowe's Fast Approximate Nearest Neighbor machine learning library (FLANN). There is even a full calibration→rectification→stereo correspondence→depth map pipeline.  All of this work culminated with the release of OpenCV 2.0 in September 2009.

With this new, modern library, the OpenCV team is now moving forward on implementing new features as well as making the library more stable and tested than ever before. You can follow the increasing test code coverage, or, if you prefer features, you can follow the OpenCV developer Twitter account.

-- Gary Bradski

January 26, 2010

In the past month or so, work has progressed on the Texas robot. We've decided to build 25 "Texas Alphas", or "TA" for short, to use for ourselves as well as studies on telepresence. Over the past month, we've been working with our design partner, Function, to make this happen.

One of the important aspects of this project has been to ensure that the TAs were seen as modifiable -- allowing anyone with an allen wrench and some confidence to switch out parts. We want to see what users will do with the robot, given the source code and the physical system.

The build of the subassemblies has been fast and furious. As you can see from the slideshow, we have at least two of the TAs built and are replicating them quite rapidly. We might not have enough storage for all 25 of the TAs at Willow Garage, but we'll be sending them out the door soon to various sites to test their remote capabilities.

Dallas, Curt and our intern Tom Grimes (from Purdue), along with the other members of the Texas/WG/Function team, have been cranking the allen wrenches, and building parts left and right. The software is also starting to take shape and is building on top of the capabilities developed for the PR2 robot. We're looking forward to getting the TAs back in the office and taking them for their first test drive.

January 26, 2010

The Texas Robot continues to be a fun platform for experimenting with robot telepresence. One of the major difficulties with the original platform was charging. Although the Texas Robot could last an entire day on a single charge, the "pilot" always had to find someone to plug the robot in at the end of the day. Our hardware team did a great job solving this. They built a convenient docking station that's very easy to use -- you simply drive the robot backwards onto a platform, and a V-shaped bar helps guide the plug into place.

While this part of the operation is easy, we wondered if we could make it even more convenient. If the PR2 can plug itself in, why can't the Texas Robot dock itself? We want to improve the experience of robot telepresence, so that you can use robots like Texas as a platform for interacting with people, rather than spend time performing maintenance tasks. We haven't solved this problem entirely, but with the help of Victor Eruhimov and OpenCV, we got a step closer.

While visiting Willow Garage last December, OpenCV developer Victor Eruhimov combined OpenCV and ROS to develop a vision-based prototype of autonomous parking. This prototype uses the color camera on the Texas Robot to find the docking station, which has a grid of color circles on it. A color filter is applied to the camera image, and a search is done for the pattern of circles. Once the docking station is located, the Texas Robot can be driven into place -- the clever design of the docking station makes it just as easy for an autonomous robot to use as well. This approach still requires that the driver position Texas so that it can see the docking station, but hopefully we can address that with future improvements.

 

January 24, 2010

Sanford Dickert gives a lightning talk on the Texas Robot, ROS, and the PR2 Call for Proposals at SuperHappyDevHouse.

January 22, 2010

Milestone 3 Complete

Today, we finished our third milestone! Simply put, ROS has reached 1.0 status. We also recently unveiled the PR2 Beta robots and the PR2 Beta Program, which will distribute approximately 10 PR2 robots at no cost.

Of course, it's a lot more than that. Since work began on Milestone 3, there are now:

  • 203 ROS software tutorials
  • 29 ROS Stacks at 1.0 status, which contain a total of 186 ROS Packages
  • 21 Completed Use Cases, requiring well over one hundred user studies

Numbers aren't everything, though. Here are some of the libraries that are available free and open source (BSD): navigation, 3-D visualization, coordinate frames, robot modeling, laser and camera processing, logging and playback, and strong OpenCV integration.  Many additional libraries will be distributed with the PR2 so that robot recipients can start developing on the PR2 from day one: PR2 simulation, realtime controllers, diagnostics and debugging tools, and drivers.

There's also a brand-new ROS.org community site with a wiki and news blog. With your help, we completely redid the content of the wiki to provide better, more consistent, and more thorough documentation. We also moved our source code hosting to code.ros.org, which provides significantly faster connection speeds.

The ROS community played a huge role in Milestone 3. Whether it be the authors of the high-quality, open-source libraries that ROS is built on top of, our awesome interns from top robotics research programs, the numerous wiki contributors, our user study participants, the developers who submitted patches, or the many e-mailers on ros-users -- all of you demonstrated that open source and quality go hand in hand.

In fact, while we were busy with Milestone 3, the ROS community continued to expand the list of ROS libraries. There are now 15 organizations releasing open source ROS libraries and contributing documentation to ROS.org. There are over 850 ROS packages available for you to download and use, including libraries for the Aldebaran Nao, iRobot Create, and much, much more.

The completion of Milestone 3 feels like the end of a long journey, from building PR2 alpha prototypes, to getting them to open doors and plug themselves in, to turning PR2 and ROS into solid development platforms for robotics. In reality, it's a beginning -- ROS is now ready for new audiences, and soon, PR2s will be in the hands of top research institutions around the world. We look forward to working with the robotics community in taking the next steps.

January 22, 2010

ROS

ROS 1.0 has been released!

Development on ROS began a little over two years ago. There have been many changes since those early days, and what started as a little project with a couple of developers has blossomed into a vibrant community supporting a wide variety of robots, big and small, in academia and industry.

We hope that this 1.0 release will help the community even more and that you all will continue to participate and contribute.

ROS, by itself, isn't enough to get a robot going, so we're excited to also release many other libraries as 1.0, including:

For a list of changes in this release, please see the change list.

January 19, 2010

PR2, by Scott Morse

Last year, we commissioned Pixar/Red Window artist Scott Morse to do a painting of the PR2 Beta. Now that the PR2 Beta is unveiled, we can at long last share it with you. If you wander over to Scott's post on Alternative Press Expo, you can see paintings of other robots he's done, like "Robot" from Lost in Space and Astro Boy.

Congrats to Scott and the rest of the Pixar artists, who just received a Golden Globe for their work on Up!  

January 15, 2010

Call for Proposals

Today we are unveiling our PR2 Beta robot! We are also announcing to research institutions around the world that you can apply to have one at no cost.

For the past couple of years, our researchers, developers and interns have used prototypes of the PR2 to build exciting new capabilities for robotics. The PR2 program kickstarted development of ROS, an open source robotics platform. It also helped drive new capabilities in the OpenCV computer vision library. One year ago, we accomplished our first Milestone: autonomous navigation with the PR2 robot for 2π kilometers. Six months ago, we accomplished our second Milestone: opening doors, plugging in, and 26.2 miles of autonomous navigation. We are now completing our third Milestone, which solidifies the ROS and OpenCV software platforms that form the basis of the PR2 software system.

These past several months, you may have followed along on this site as our production floor was busy assembling the PR2 Beta piece by piece. Now that the PR2 Beta production robots are coming off the line, we're announcing our PR2 Beta Program, which will enable complete, production PR2 robots to leave the doors of Willow Garage for the first time. The PR2 Beta Program will make available approximately ten PR2 Beta robots at no cost.

We invite research institutions to respond to our Call for Proposals, describing the open source and scientific contributions that they can make with a PR2. The Call for Proposals contains additional details on how we will select the top proposals and distribute PR2s.

We believe that the PR2 Beta Program will accelerate robotics research and drive open source robotics development. We're excited to work with research organizations around the world in moving the open source robotics community forward.

You can find out more about the CFP, including downloadable CFP materials, on our PR2 Beta Program: CFP page.

PR2 PR2

High-resolution photos: