Open Source
Assembly Line
GM Ramps Up Effort to Bring Customers Seamless Software Experiences Through Unified Automotive Standards
General Motors announced today that it is joining the Eclipse Foundation, one of the world’s largest open source software foundations. It has also contributed “uProtocol” as a starting point for greater standardization, enabling increased software productivity across the automotive industry that can lead to easy-to-use, software-enabled customer experiences. This protocol aims to speed up software development by streamlining the creation of software that is distributed across multiple devices within vehicles as well as across the cloud and mobile.
GM will participate in the Eclipse Foundation’s Software Defined Vehicle (SDV) Working Group, which is focused on accelerating innovation of automotive-grade software stacks using open source and open specifications developed by and for a growing community of engineers and member companies. Collaborators on GM’s Ultifi software platform including Microsoft and Red Hat, as well as multiple other automakers, participate in the group.
🦾 Amazon releases largest dataset for training 'pick and place' robots
In an effort to improve the performance of robots that pick, sort, and pack products in warehouses, Amazon has publicly released the largest dataset of images captured in an industrial product-sorting setting. Where the largest previous dataset of industrial images featured on the order of 100 objects, the Amazon dataset, called ARMBench, features more than 190,000 objects. As such, it could be used to train “pick and place” robots that are better able to generalize to new products and contexts.
The scenario in which the ARMBench images were collected involves a robotic arm that must retrieve a single item from a bin full of items and transfer it to a tray on a conveyor belt. The variety of objects and their configurations and interactions in the context of the robotic system make this a uniquely challenging task.
The state of open-source in 3D printing in 2023
The above and many other things we’ve been doing at Prusa Research for over ten years were only possible thanks to the great 3D printing community and open-source philosophy. However, the new printers and software releases have made me think again about the current state of open source in the 3D printing world. How sustainable it is, how our competitors deal with it, what it brings to the community, and what troubles us as developers. Consider this article as a call for discussion – as a kick-off that will (hopefully) open up a new perspective on the connection between open-source licensing, consumer hardware, and software development.
RT-1: Robotics Transformer for Real-World Control at Scale
Major recent advances in multiple subfields of machine learning (ML) research, such as computer vision and natural language processing, have been enabled by a shared common approach that leverages large, diverse datasets and expressive models that can absorb all of the data effectively. Although there have been various attempts to apply this approach to robotics, robots have not yet leveraged highly-capable models as well as other subfields.
Several factors contribute to this challenge. First, there’s the lack of large-scale and diverse robotic data, which limits a model’s ability to absorb a broad set of robotic experiences. Data collection is particularly expensive and challenging for robotics because dataset curation requires engineering-heavy autonomous operation, or demonstrations collected using human teleoperations. A second factor is the lack of expressive, scalable, and fast-enough-for-real-time-inference models that can learn from such datasets and generalize effectively.
To address these challenges, we propose the Robotics Transformer 1 (RT-1), a multi-task model that tokenizes robot inputs and outputs actions (e.g., camera images, task instructions, and motor commands) to enable efficient inference at runtime, which makes real-time control feasible. This model is trained on a large-scale, real-world robotics dataset of 130k episodes that cover 700+ tasks, collected using a fleet of 13 robots from Everyday Robots (EDR) over 17 months. We demonstrate that RT-1 can exhibit significantly improved zero-shot generalization to new tasks, environments and objects compared to prior techniques. Moreover, we carefully evaluate and ablate many of the design choices in the model and training set, analyzing the effects of tokenization, action representation, and dataset composition. Finally, we’re open-sourcing the RT-1 code, and hope it will provide a valuable resource for future research on scaling up robot learning.
How Boeing Uses Cloud Native
“Being able to leverage the best technologists out there in the rest of the world is of great value to us strategically,” Torres, chief engineer of open source and cloud native for Boeing, said. This strategy allows Boeing to “differentiate on what we do as our core business rather than having to reinvent the wheel all the time on all of the technology.”
Like many other large companies, Boeing has created an open source office to better work with the open source community. Although Boeing is primarily a consumer of open source software, it still wants to work with the community. “We want to make sure that we have a strategy around how we contribute back to the open source community, and then leverage those learnings for inner sourcing,” he said.