Brianna Wessling, Author at The Robot Report

Agility Robotics’ Jonathan Hurst to keynote Robotics Summit

Brianna Wessling — Wed, 12 Apr 2023 18:07:02 +0000

Agility Robotics has been working since it spun out of Oregon State University in 2015 to bring humanoid robots out of the lab and into the real world. The company has made great strides in making its robots fit for bulk material handling tasks like tote movement.

Earlier this year, the company unveiled the latest generation of its Digit robot, built specifically to carry out tasks in warehouses and distribution centers. Updates in the next generation include newly designed end effectors optimized for reaching high/low, pulling, picking up, and placing objects commonly found in e-commerce and shipping warehouses, like plastic totes. Digit also has a new head with LED animated eyes, which allow for improved human-robot interaction such as using simple expressions to convey information and intent.

In his keynote talk at the Robotics Summit & Expo titled “Developing Human-Centric Bipedal Robots,” Agility co-founder and Chief Technology Officer Jonathan W. Hurst will give an inside look at the process of developing bipedal robots that are useful in the workplace. The Robotics Summit will take place at the Boston Convention Center on May 10-11, 2023, and Hurst will give his talk at 10:45 AM on the show’s second day.

Hurst is also a Professor and co-founder of the Oregon State University Robotics Institute. He holds a B.S. in mechanical engineering and an M.S. and Ph.D. in robotics, all from Carnegie Mellon University. His university research focuses on understanding the fundamental science and engineering best practices for robotic-legged locomotion and physical interaction. Agility Robotics is bringing this new robotic mobility to market, solving customer problems, working towards a day when robots can go where people go, generate greater productivity across the economy, and improve the quality of life for all.

You can find the full agenda for the Robotics Summit here. The Robotics Summit & Expo is the premier event for commercial robotics developers. There will be nearly 70 industry-leading speakers sharing their development expertise on stage during the conference, with 150-plus exhibitors on the show floor showcasing their latest enabling technologies, products and services that help develop commercial robots. There also will be a career fair, networking opportunities and more.

The post Agility Robotics’ Jonathan Hurst to keynote Robotics Summit appeared first on The Robot Report.

Comau develops mobile manipulator

Brianna Wessling — Tue, 11 Apr 2023 20:55:37 +0000

Comau’s mobile manipulator uses a Racer-5 cobot and a 1500 autonomous guided vehicle (AGV). | Source: Comau

Comau has been developing a mobile manipulator that is being applied within three different EU projects.

The company’s Mobile Robotic Arm involves a robotic arm mounted on an autonomous mobile platform. The system is integrated with Comau’s Racer-5 collaborative robot (cobot), a six-axis articulated robotic arm that can work at speeds of up to 6 m/s when human operators aren’t present. The Racer-5 is mounted onto a 1500 autonomous guided vehicle (AGV).

The system can be integrated within Comau’s digital infrastructure and can provide visual feedback for pick and place operations, and more, with its integrated vision system. This includes a Comau MI.RA that is installed directly into the robotic arm.

The system’s AGV is equipped with two independent batteries that power the AGV and the robotic arm separately. The AGV can also be managed using different types of navigation modes and a standard Comau controller.

Comau’s first application for the Mobile Robotic Arm is with DIMOFAC, an EU initiative that aims to help companies implement a smart factory architecture. There, the platform is used for pick and place and warehouse automation tasks within a machining scenario.

The PeneloPe Project, another EU project, uses the platform for glue dispensing and non-destructive quality inspection in the public transport domain. The goal of the program is to develop a closed-loop, end-to-end digital manufacturing solution that facilitates bidirectional data flows across the manufacturing value chain.

Finally, Comau’s platform is being used as part of the ODIN project to support the manipulation of mechanical parts for automotive applications with the aim of demonstrating the technical and performance feasibility of collaborative robotics on the factory floor.

Earlier this year, Comau entered into a cooperative agreement with Siemens to offer their jointly engineered product the Sinumerik Run MyRobot / DirectControl. With this product, robot kinematics can be fully integrated into a CNC system, optimizing control of all robotic machining and handling tasks.

Comau is based in Turin, Italy and was founded in 1973. It recently launched a new robotics learning center with Ferrari. The e.DO Learning Center will use Comau’s robots to help students explore STEM subjects, coding and robotics. The facility is equipped with five of Comau’s e.DO 6-axis robots, complete with all necessary materials and accessories.

The post Comau develops mobile manipulator appeared first on The Robot Report.

Amazon’s ARMBench dataset helps train pick-and-place robots

Brianna Wessling — Tue, 11 Apr 2023 20:02:54 +0000

Amazon has released a dataset that contains images of more than 190,000 objects that it said can be used to train robots for pick-and-place tasks. Amazon claims this is the largest dataset of images captured in an industrial product-sorting setting.

The dataset, called ARMBench, can be used to train pick-and-place robots to better generalize new objects and contexts. The images were collected in an Amazon warehouse where a robotic arm retrieves a single item from a bin full of items and then transfers it to a tray on a conveyor belt. This task can be difficult because of the variety of objects in the bin and their various configurations and interactions.

Images in the dataset fall into three categories:

Pick images: top-down images of a bin filled with items before a robot starts picking
Transfer images: images captured from multiple viewpoints as the robot transfers an item to the tray
Place images: top-down images of the tray in which the selected item is placed

ARMBench contains images from three separate tasks, object segmentation, object identification and defect detection.

The object detection dataset, which helps robots identify the boundaries of different products in the same bin, contains more than 50,000 images. The images show anywhere from one to 50 manual object segmentations per image, with an average of about 10.5.

The object segmentation dataset helps robots determine which product image in a reference database corresponds to the highlighted product in an image. This dataset includes more than 235,000 labeled pick activities, with each pick activity including a pick image and three transfer images. This dataset also includes reference images and text descriptions of more than 190,000 products. Models can learn to match one of these reference products to an object highlighted in pick and transfer images.

From left to right: a pick image, a transfer image and place image from Amazon’s ARMBench dataset. | Source: Amazon

The defect detection dataset, which includes both images and videos, helps systems know when a robot has committed an error, like picking up multiple items rather than one or damaging an item during transfer. The dataset has more than 19,000 images captured during the transfer phase. It also includes more than 4,000 videos that document pick-and-place activities that resulted in damage to a product.

Videos are a key aspect of this dataset, as certain types of product damage are best diagnosed through video, as they can occur at any point in the transfer process. The defect detection dataset also contains images and videos for over 100,000 pick-and-place activities without defects.

Amazon plans to continue to expand the number of images and videos, and the range of products they depict, in ARMBench.

In November 2022, Amazon unveiled Sparrow, a robotic arm capable of picking individual products before they get packaged. Sparrow can pick 65% of the over 100 million different items that could be processed at an Amazon warehouse, according to the company.

Sparrow can pick a variety of items, like DVDs, socks and stuffed animals, but struggled with items that have loose or complex packaging. It seems likely the company drew on the research it did while developing Sparrow to build this dataset.

The post Amazon’s ARMBench dataset helps train pick-and-place robots appeared first on The Robot Report.

Covariant raises $75M for robotic picking technology

Brianna Wessling — Tue, 11 Apr 2023 00:21:22 +0000

Covariant raised another $75 million in its Series C funding round. The company announced the first part of its series C round, totaling $80 million, in 2021. It has now raised $222 million since its founding.

Radical Ventures and Index Ventures, both returning investors in the company, co-led the round. The most recent round also included participation from other returning investors Canada Pension Plan Investment Board and Amplify partners, and new investors Gates Frontier Holdings, AIX Ventures and Northgate Capital.

Since its founding in 2017, Covariant has focused on developing the Covariant Brain, which the company called a Universal AI platform. Pre-trained on millions of picks from Covariant robots in warehouses around the world, the Covariant Brain enables robots to autonomously pick many SKUs. Covariant plans to use the funding to ensure its platform will allow retail and logistics providers to deploy robotic picking quickly.

“The leading companies have turned to AI Robotics to automate their most manual operations in order to decrease labor costs, increase throughput, and control profitability,” said Covariant CEO Peter Chen. “The past year for Covariant has been incredible with 6x growth in 2022 – and we are just getting started. This infusion of new capital allows us to scale even faster, ensuring more retailers can automate more parts of their fulfillment networks to remove manual bottlenecks, handle fluctuating demand, and better prepare for ever-changing business needs.”

Since its last funding announcement in 2021, the company has applied Covaraint Brian to a broad set of piece-picking and case-picking applications, including order sortation, item induction, good-to-person order picking, knitting and depalletization. With the platform, connected robots learn as a fleet, enabling operational improvements to automatically propagate across customers’ networks.

“Many companies are trying to break into the AI robotics space, but Covariant has been making significant progress for years now,” said Mike Volpi, partner at Index Ventures. “I’m confident that their team, which represents the best minds in AI, and their approach of deploying a unified AI platform are shaping the future of automation, and look forward to the additional progress they’ll make in the years ahead.”

The post Covariant raises $75M for robotic picking technology appeared first on The Robot Report.

Cruise recalls 300 robotaxis in response to crash with bus

Brianna Wessling — Mon, 10 Apr 2023 13:21:24 +0000

A Cruise robotaxi failed to brake quickly enough behind a city bus in San Francisco. | Source: Cruise

Cruise issued a voluntary recall with the National Highway Transporation Safety Administration (NHTSA) in response to a minor collision where a Cruise autonomous vehicle (AV) hit the back of a San Francisco bus. The recall affects 300 AVs.

The Cruise AV involved in the crash failed to brake quickly enough after the city bus in front of it slowed, according to the company. While the vehicle did brake, it applied the brakes too late and rear-ended the bus at about 10 MPH, Cruise said.

After the collision, Cruise began an investigation and found the cause of the crash was an error related to predicting the movement of articulated vehicles, which are vehicles with two sections connected by a flexible joint allowing them to bend in the middle, like the bus in the accident.

According to Cruise, the robotaxi saw the front section of the bus and recognized that it was an articulated vehicle that could bend, so it predicted the bus would move as connected sections with the rear section following the predicted path of the front section. As the bus pulled out, Cruise said the AV reacted based on the predicted actions of the front end of the bus, which it could no longer see, rather than the actual actions of the rear section of the bus, making it slow to brake.

Once the company found the root cause of the accident, it started working on a software update that it said would improve performance near articulated vehicles. When the update was completed, tested and validated, Cruise’s operations team rolled the change out to the fleet, just two days after the incident occurred. Results from testing indicate the specific issue that caused the accident won’t recur after the update.

“Our data and simulations showed that it was exceptionally rare. At the time of the incident, our AVs had driven over 1 million miles in fully driverless mode. We had no other collisions related to this issue, and extensive simulation showed that similar incidents were extremely unlikely to occur at all, even under very similar conditions,” Cruise founder and CEO Kyle Vogt wrote in a blog. “The collision occurred due to a unique combination of specific parameters such as the specific position of the vehicles when the AV approached the bus (with both sections of the bus visible initially, and then only one section), the AV’s speed, and the timing of the bus’s deceleration (within only a few seconds of the front section becoming occluded).

“We will undoubtedly continue to discover ways in which we can improve, even if that involves changing software that is currently deployed in the field,” he continued. “We think any potential improvement to roadway safety is worthwhile, and we will approach it with the same level of rigor as we’ve demonstrated here. These continuous improvements are likely to make voluntary recalls commonplace. We believe this is one of the great benefits of autonomous vehicles compared to human drivers; our entire fleet of AVs is able to rapidly improve, and we are able to carefully monitor that progress over time.”

The post Cruise recalls 300 robotaxis in response to crash with bus appeared first on The Robot Report.

Gatik to start deliveries with Kroger in Texas

Brianna Wessling — Sun, 09 Apr 2023 10:06:38 +0000

Gatik recently announced a multi-year commercial collaboration with Kroger to transport customer orders within Kroger’s Dallas distribution network.

Starting sometime in Q2 of 2023, Gatik’s medium-duty autonomous box trucks will be transporting products from a Kroger Customer Fulfillment Center (CFC) in Dallas, Texas to multiple retail locations. Gatik’s autonomous trucks will operate with safety drivers in the vehicles for now, but the company plans to eventually take them out.

Gatik’s trucks feature a cold chain-capable 20′ foot box to transport ambient, refrigerated, frozen goods. The collaboration involves consistent, repeated delivery runs multiple times per day, seven days per week, across Kroger’s Dallas distribution network. Each trip, from a CFC to a retail location, typically involves around 60 miles of driving round trip, according to Gatik’s Head of Policy and Communications Richard Steiner.

The company has always been interested in automating the middle mile. Steiner joined the company in 2019, just two years after it was founded, and has helped it grow into a now 150-person team.

“What we’ve seen over the last few years, even prior to the pandemic, is e-commerce going through the roof,” Steiner said. “Consumers like you and me no longer want to wait three, four, or five days for goods, we want them within a one to two-hour pickup window.”

According to Steiner, this change in the way people shop has led to smaller distribution centers, more micro fulfillment centers and more customer fulfillment centers closer to where those customers live. This is where automating the middle mile, between these fulfillment centers and retail locations, can greatly increase the speed and number of orders fulfilled.

“A really, really critical point to note about what we’re doing there is we’re increasing the delivery frequency,” Steiner said. “So that means that Kroger’s customers have a greater range of same-day pickup times as well as greater flexibility with cut-off times to place their orders.”

Automating the middle mile also means getting autonomy into the hands of Gatik’s customers quickly, because the team only needs to operate its AVs on repeatable routes instead of anywhere in a city a person might want to go.

“Compared to the other applications of technology, either long haul or passenger transportation, [middle-mile transportation] is simpler,” Steiner said. “We are constraining the challenge of autonomy by focusing on fixed known repeatable point-to-point routes. So whereas the passenger transportation models require mapping out an exponentially larger and larger geo-fenced area to serve an increasing number of consumers . . . We focus on a limited number of pickup locations and drop off locations, which means that we know our routes more intimately than anyone else on the planet.”

While Gatik doesn’t have a specific timeline for when it will be able to pull out its safety drivers from its trucks in Texas, with each deployment, including its deployment with Walmart in Arkansas and with Loblaw in Ontario, the process keeps moving faster.

“With Walmart in Arkansas, we began commercial operations in June of 2019. We pulled the driver out in August of 2021, so about two years right?” Steiner said. “With Loblaw, we began commercial operations in January 2020 and pulled the safety driver out 19 months after that. So we went from 24, 25 months to 19.”

Gatik has three phases that it works through for deployments. The first involves millions of miles of simulated training, which is followed by the second phase, which involves private closed course track testing, first with safety drivers and then without. Finally, the Gatik team moves into its public testing phase.

With or without a safety driver, Gatik’s trucks begin generating revenue for its customers on day one.

“We’ve now done over half a million customers orders across our customer base in North America,” Steiner said. “Every single one of those deliveries has been revenue generating. So we’re not testing for testing’s sake. This is a real business. This is a revenue-generating business.”

The post Gatik to start deliveries with Kroger in Texas appeared first on The Robot Report.

MIT researchers create algorithm to stop drones from colliding midair

Brianna Wessling — Sat, 08 Apr 2023 14:00:32 +0000

The MIT team tested its collision avoidance system in a flight environment with six drones and in simulation. | Source: MIT

A research team from MIT created a trajectory-planning system called Robust MADER that can allow drones working together in the same airspace to pick safe paths forward without crashing into each other. The algorithm is an updated version of MADER, a 2020 project that worked well in simulation but didn’t hold up in real-world testing.

The original MADER system involved each agent broadcasting its trajectory so fellow drones know where it’s planning to go. In simulation, this worked without problems, with all drones considering each other’s trajectories when planning their own. When put to the test, the team found that it didn’t take into account delays in communication between drones, resulting in unexpected collisions.

“MADER worked great in simulations, but it hadn’t been tested in hardware. So, we built a bunch of drones and started flying them. The drones need to talk to each other to share trajectories, but once you start flying, you realize pretty quickly that there are always communication delays that introduce some failures,” Kota Kondo, an aeronautics and astronautics graduate student, said.

Robust MADER is able to generate collision-free trajectories for drones even when there is a delay in communications between agents. The system is an asynchronous, decentralized, multiagent trajectory planner, meaning each drone formulates its own trajectory and then checks with drones nearby to ensure it won’t run into any of them.

The drones optimize their new trajectories using an algorithm that incorporates the trajectories they received from nearby drones, and agents constantly optimize and broadcast new trajectories to avoid collisions.

To get around any delays in sharing trajectories, every drone has a delay-check period, where it spends a fixed amount of time repeatedly checking for communications from other agents to see if its new trajectory is safe. If it finds a possible collision, it abandons the new trajectory and keeps going on its current one. The length of this delay-check period depends on the distance between agents and other environmental factors that could hamper communications.

While the system does require all drones to agree on each new trajectory, they don’t all have to agree at the same time, making it a scalable system. It could be used in any situation where multiple drones are working together in the same airspace like spraying pesticides over crops.

The MIT team ran hundreds of simulations in which they artificially introduced communication delays, and found that MADER was 100% successful at avoiding collisions. When tested with six drones and two aerial obstacles in a flight environment, Robust MADER was able to avoid all collisions, while the old algorithm would have caused seven collisions.

Moving forward, the research team hopes to put Robust MADER to the test outdoors, where obstacles can affect communications. They also hope to outfit drones with visual sensors so they can detect other agents or obstacles, predict their movements and include that information in trajectory optimizations.

Kota Konda wrote the paper with Jesus Tordesillas, a postdoc; Parker C. Lusk, a graduate student; Reinaldo Figueroa, Juan Rached, and Joseph Merkel, MIT undergraduates; and senior author Jonathan P. How, the Richard C. Maclaurin Professor of Aeronautics and Astronautics, a principal investigator in the Laboratory for Information and Decision Systems (LIDS), and a member of the MIT-IBM Watson AI Lab. This work was supported by Boeing Research and Technology.

The post MIT researchers create algorithm to stop drones from colliding midair appeared first on The Robot Report.

Roboto AI raises $4.8M to build data tools for robotics developers

Brianna Wessling — Thu, 06 Apr 2023 19:28:32 +0000

A screenshot of the Roboto platform.

Roboto AI, a company working to create tools to help robotics developers go from a prototype to a reliable production system, emerged from stealth with $4.8 million in Seed funding. Unusual Ventures led the round, which also included the Allen Institute for Artificial Intelligence (AI2) and FUSE Ventures. Roboto AI is also partnering with researchers and professors at the ETH Zürich AI Center.

Robotics companies oftentimes have to develop all of their infrastructure, anything from custom hardware to data infrastructure in-house. This could cost startups crucial time and money that could be spent getting their systems into the world. Roboto AI hopes to make development easier by providing a platform that supports robotics data.

The company’s founders, Benji Barash (CEO) and Yves Albers-Schoenberg (CTO) have experience building this kind of infrastructure from their time at Amazon Robotics. The two used to spend entire days writing scripts to filter and transform sensor data so they could debug system failures, evaluate performance and create new algorithms.

Roboto AI is working to create a data platform that allows users to easily search across modalities using natural language. The company currently has a free demo available that uses data from nuScenes, a large-scale, autonomous driving dataset used by engineers and researchers, for those interested in testing an early version of Roboto. With the sandbox, users can not only use natural language to search for the data they need, but they can also perform searches on graphical time-series signals.

Roboto AI was founded in 2022 when it spun out of the Allen Institute for Artificial Intelligence. It is based in Seattle, Washington.

“Robotics is hard, but it shouldn’t be this hard. We want to catalyze progress in the robotics industry and see robots get to production faster by getting AI to do the dirty work for us,” the founders wrote in a blog. “We’re building Roboto to be an out-of-the-box solution to the data challenges engineers face daily and we’re excited to have the support of an incredible group of advisors and investors to make it happen. We’re building new AI-powered tools for anyone working with sensor or log data; think copilot for robotics.”

Roboto AI CTO Yves Albers-Schoenberg (left) and CEO Benji Barash. | Source: Roboto AI

The post Roboto AI raises $4.8M to build data tools for robotics developers appeared first on The Robot Report.

How MIT taught a quadruped to play soccer

Brianna Wessling — Thu, 06 Apr 2023 01:14:38 +0000

A research team at MIT’s Improbable Artificial Intelligence Lab, part of the Computer Science and Artificial Intelligence Laboratory (CSAIL), taught a Unitree Go1 quadruped to dribble a soccer ball on various terrains. DribbleBot can maneuver soccer balls on landscapes like sand, gravel, mud and snow, adapt its varied impact on the ball’s motion and get up and recover the ball after falling.

The team used simulation to teach the robot how to actuate its legs during dribbling. This allowed the robot to achieve hard-to-script skills for responding to diverse terrains much quicker than training in the real world. Because the team had to load its robot and other assets into the simulation and set physical parameters, they could simulate 4,000 versions of the quadruped in parallel in real-time, collecting data 4,000 times faster than using just one robot. You can read the team’s technical paper called “DribbleBot: Dynamic Legged Manipulation in the Wild” here (PDF).

DribbleBot started out not knowing how to dribble a ball at all. The team trained it by giving it a reward when it dribbles well, or negative reinforcement when it messes up. Using this method, the robot was able to figure out what sequence of forces it should apply with its legs.

“One aspect of this reinforcement learning approach is that we must design a good reward to facilitate the robot learning a successful dribbling behavior,” MIT Ph.D. student Gabe Margolis, who co-led the work along with Yandong Ji, research assistant in the Improbable AI Lab, said. “Once we’ve designed that reward, then it’s practice time for the robot. In real time, it’s a couple of days, and in the simulator, hundreds of days. Over time it learns to get better and better at manipulating the soccer ball to match the desired velocity.”

The team did teach the quadruped how to handle unfamiliar terrains and recover from falls using a recovery controller build into its system. However, dribbling on different terrains still presents many more complications than just walking.

The robot has to adapt its locomotion to apply forces to the ball to dribble, and the robot has to adjust to the way the ball interacts with the landscape. For example, soccer balls act differently on thick grass as opposed to pavement or snow. To combat this, the MIT team leveraged cameras on the robot’s head and body to give it vision.

While the robot can dribble on many terrains, its controller currently isn’t trained in simulated environments that include slopes or stairs. The quadruped can’t perceive the geometry of terrain, it just estimates its material contact properties, like friction, so slopes and stairs will be the next challenge for the team to tackle.

The MIT team is also interested in applying the lessons they learned while developing DribbleBot to other tasks that involve combined locomotion and object manipulation, like transporting objects from place to place using legs or arms. A team from Carnegie Mellon University (CMU) and UC Berkeley recently published their research about how to give quadrupeds the ability to use their legs to manipulate things, like opening doors and pressing buttons.

The team’s research is supported by the DARPA Machine Common Sense Program, the MIT-IBM Watson AI Lab, the National Science Foundation Institute of Artificial Intelligence and Fundamental Interactions, the U.S. Air Force Research Laboratory, and the U.S. Air Force Artificial Intelligence Accelerator.

The post How MIT taught a quadruped to play soccer appeared first on The Robot Report.

Robotics Summit: How to use simulation for developing robots

Brianna Wessling — Wed, 05 Apr 2023 17:34:06 +0000

Warehouse logistics and advanced manufacturing are increasingly using robotics as a critical part of their automation strategies. Robots can improve operational efficiency, improve safety, and help companies address the persistent labor shortages that are being observed across the globe. Developing these intelligent robotic systems, however, is a complex, challenging, and costly undertaking. Thankfully, advanced simulation tools are available to engineers that can speed the design, development, and testing processes.

Gerard Andrews, Senior Product Marketing Manager of Robotics at NVIDIA, will discuss how to use NVIDIA’s Isaac Sim for robotics development. His talk at the Robotics Summit & Expo called “Using Simulation to Design and Develop Autonomous Robots” will take place at the Boston Convention Center on May 11 at 11:30 AM.

This talk will describe the many ways NVIDIA Isaac Sim can be used to accelerate the development and deployment of robots, including advanced AI and computer vision. Specifically, attendees will learn how simulation can test robot applications in photo-realistic, physically accurate digital twin environments. In addition, the robots can be placed in increasingly complex simulations involving digital humans and fleets of robots to optimize operational KPIs. This session is designed as an introduction to photo-realistic 3D simulation for robots and is appropriate for all levels.

Andrews is focused on revolutionizing the way intelligent robots are developed, trained, tested and deployed by driving the adoption of the NVIDIA Isaac Robotics platform. Prior to joining NVIDIA, he was at Cadence where he was Product Marketing Director, responsible for product planning, marketing, and business development for licensable processor IP. He holds an MS in electrical engineering from the Georgia Institute of Technology and a BS in electrical engineering from Southern Methodist University.

The post Robotics Summit: How to use simulation for developing robots appeared first on The Robot Report.

Ocado wins UK patent lawsuit over AutoStore

Brianna Wessling — Fri, 31 Mar 2023 19:00:17 +0000

On the left, AutoStore’s ASRS, and on the right, Ocado’s ASRS. | Source: AutoStore, Ocado

Yesterday, the UK High Court ruled that AutoStore’s patents, which have been the subject of a patent infringement case against Ocado, were invalid, and that Ocado did not infringe upon them. Both AutoStore and Ocado operate automated storage and retrieval systems (ASRS) that operate on similar principles.

AutoStore filed the lawsuit in October 2020, when it asserted that Ocado infringed upon six of its patents. The European Patent Office invalidated two of these patents before judgment was made on the case, and two other patents were withdrawn by AutoStore before the hearing started.

Judge Hacon invalidated the remaining two patents because AutoStore had disclosed its technology publically in a business deal with the Central Bank of Russia before the company filed its patents. Halcon ruled that even if the patents were valid, the Ocado Smart Platform (OSP) did not infringe on them. The judge also ruled that OSP didn’t infringe upon the patents that AutoStore chose to withdraw from the case.

An Ocado spokesperson said, “As we have said consistently since the day the action was launched that we did not infringe any valid AutoStore patents. Once again a judge has proved we are right. And we have been proved right by courts both in the US and the UK. Autostore’s decision to sue us has been a complete waste of time – for us and them – and will now also be a further waste of money for them as we intend to seek a significant costs order against them.”

“This entire misguided exercise by AutoStore has simply served to show that it is Ocado that is the innovation factory with robust processes in place to protect and respect IP. Our fulfillment centers can freely operate in light of this judgment. And although AutoStore presented this litigation to the market as a one-way bet – either they would win or “the status quo would be maintained”, the actual outcome of the litigation is that a significant number of their patent assets are being invalidated, their patent portfolio has been reduced and their IP has been weakened. Actions continue against AutoStore in Germany and the US for infringement of Ocado IP rights. The risk of infringement is now with AutoStore.”

In December 2021, AutoStore lost a similar patent infringement lawsuit filed with the International Trade Commission (ITC). US ITC Judge Charles Bullock ruled three of AutoStore’s patents involved in the case were invalid, and that Ocado didn’t infringe upon the fourth patent in the trial.

The ASRS systems from both companies operate on similar storage and retrieval principles. Items are stored in bins stacked in a grid and retrieved by mobile robots from above the stack.

The post Ocado wins UK patent lawsuit over AutoStore appeared first on The Robot Report.

Researchers taught a quadruped to use its legs for manipulation

Brianna Wessling — Fri, 31 Mar 2023 00:39:18 +0000

Researchers from Carnegie Mellon University (CMU) and UC Berkeley want to give quadrupeds more capabilities similar to their biological counterparts. Just like real dogs can use their front legs for things other than walking and running, like digging and other manipulation tasks, the researchers think quadrupeds could someday do the same.

Currently, we see quadrupeds use their legs as just legs to navigate their surroundings. Some of them, like Boston Dynamics’ Spot, get around these limitations by adding a robotic arm to the quadruped’s back. This arm allows Spot to manipulate things, like opening doors and pressing buttons, while maintaining the flexibility that four legs give locomotion.

However, the researchers at CMU and UC Berkeley taught a Unitree Go1 quadruped, equipped with an Intel RealSense camera for perception, how to use its front legs to climb walls, press buttons, kick a soccer ball and perform other object interactions in the real world, on top of teaching it how to walk.

The team started this challenging task by decoupling the skill learning into two broad categories: locomotion, which involves movements like walking or climbing a wall, and manipulation, which involves using one leg to interact with objects while balancing on three legs. Decoupling these tasks help the quadruped to simultaneously move to stay balanced and manipulate objects with one leg.

By training in simulation, the team taught the quadruped these skills and transferred them to the real world with their proposed sim2real variant. This variant builds upon recent locomotion success.

All of these skills are combined into a robust long-term plan by teaching the quadruped a behavior tree that encodes a high-level task hierarchy from one clean expert demonstration. This allows the quadruped to move through the behavior tree and return to its last successful movement when it runs into problems with certain branches of the behavior tree.

For example, if a quadruped is tasked with pressing a button on a wall but fails to climb up the wall, it returns to the last task it did successfully, like approaching the wall, and starts there again.

The research team was made up of Xuxin Cheng, a Master’s student in robotics at CMU, Ashish Kumar, a graduate student at UC Berkeley, and Deepak Pathak, an assistant professor at CMU in Computer Science. You can read their technical paper “Legs as Manipulator: Pushing Quadrupedal Agility Beyond Locomotion” (PDF) to learn more. They said a limitation of their work is that they decoupled high-level decision making and low-level command tracking, but that a full end-to-end solution is “an exciting future direction.”

The post Researchers taught a quadruped to use its legs for manipulation appeared first on The Robot Report.

Watch Bill Gates take a ride in a Wayve AV

Brianna Wessling — Thu, 30 Mar 2023 23:08:02 +0000

Bill Gates recently had the opportunity to take a ride in London inside a Wayve autonomous vehicle (AV) and gave his thoughts on the future of driving in a new Gates Notes blog post.

While most AVs work by extensively mapping out the areas they drive in, Wayve uses deep learning techniques to allow its cars to drive anywhere humans can. To train its software, Wayve uses hundreds of millions of data samples of real-world and simulated driving.

Last year, Wayve announced it was working with Microsoft, which Gates co-founded, to leverage the supercomputing infrastructure needed to support the development of AI-based models for AVs on a global scale. Microsoft also participated in the company’s $200 million funding round in January 2022.

The Wayve AV was able to safely navigate the busy streets of downtown London with a safety driver present behind the wheel.

In his blog post, Gates seemed cautiously optimistic about the future of AVs. He predicted that it’s likely the AV industry will reach a tipping point between SAE level 2 and 3 vehicles, or, in other words, vehicles that can only provide assistance to drivers through autonomous features, and vehicles that take the control out of the drivers’ hands.

“Over the next decade, we’ll start to see more vehicles crossing this threshold. AVs are rapidly reaching the point where almost all of the technology required has been invented. Now, the focus is on refining algorithms and perfecting the engineering,” Gates wrote in his post. “There have been huge advances in recent years—especially in sensors, which scan the surrounding environment and tell the vehicle about things it needs to react to, like pedestrians crossing the street or another driver who swerves into your lane.”

Gates predicts that the first AVs that will see widespread adoption will be for long-haul trucking, then deliveries, and then autonomous taxis and rental cars will become common.

Widespread adoption of AVs, however, will come with other issues. For example, when an AV is involved in an accident, insurance companies will have to determine if the blame falls on the passenger or the company that programmed the car software. Gates predicts that these kinds of changes, along with regulatory changes, could take decades to fully come to fruition.

The post Watch Bill Gates take a ride in a Wayve AV appeared first on The Robot Report.

German robotics industry to grow 9% in 2023

Brianna Wessling — Wed, 29 Mar 2023 21:40:49 +0000

German Robotics and Automation global turnover. | Source: VDMA Robotics + Automation

German robotics and automation experts expect the industry’s gross revenue to grow by 9%, reaching 15.7 billion euros (over $17 billion) by the end of 2023, according to the VDMA Robotics + Automation Association.

“Demand for robotics and automation remains high and the transformation of many customer industries requires innovative automation solutions. The easing in supply chain disruptions is now putting the industry in a position to successively work off the enormously high order backlog,” Frank Konrad, Chairman of the VDMA R+A Association and CEO of Hahn Automation GmbH in Rheinböllen, Germany, said.

The VDMA R+A Association is a trade association that is made up of more than 370 member companies. These companies include suppliers of components and systems from the fields of robotics, integrated assembly systems and machine vision.

Germany was the fourth most automated country worldwide in 2020 and 2021, with the country reaching 397 industrial robots for every 10,000 employees in 2021, according to the International Federation of Robotics (IFR).

Within the automotive industry, which has the largest number of robots working in factories around the world, Germany has 1,500 robots for every 10,000 employees, according to the IFR. This makes it the country with the second-highest robot density in the automotive industry, coming just below South Korea.

The post German robotics industry to grow 9% in 2023 appeared first on The Robot Report.

Brianna Wessling, Author at The Robot Report

Agility Robotics’ Jonathan Hurst to keynote Robotics Summit

Comau develops mobile manipulator

Amazon’s ARMBench dataset helps train pick-and-place robots

Covariant raises $75M for robotic picking technology

Cruise recalls 300 robotaxis in response to crash with bus

Gatik to start deliveries with Kroger in Texas

MIT researchers create algorithm to stop drones from colliding midair

Roboto AI raises $4.8M to build data tools for robotics developers

How MIT taught a quadruped to play soccer

Robotics Summit: How to use simulation for developing robots

Top 10 robotics stories of March 2023

10. Advanced Construction Robotics launches rebar installing robot

9. Built Robotics develops autonomous solar piling robot

8. Plus One Robotics raises $50M Series C funding round

7. Robotics investments reach $521M in January

6. ABB spending $20M to expand U.S. robotics factory

5. Next-gen Digit humanoid wants to automate logistics tasks

4. Slip Robotics launches new trailer pallet unloading solution

3. Full set of design files released for PR2 robot

2. Editor’s Picks: best robots of ProMat 2023

1. John Deere acquires SparkAI’s human-in-the-loop tech

Ocado wins UK patent lawsuit over AutoStore

Researchers taught a quadruped to use its legs for manipulation

Watch Bill Gates take a ride in a Wayve AV

German robotics industry to grow 9% in 2023