Skip to content ↓

This 3D printer can watch itself fabricate objects

Computer vision enables contact-free 3D printing, letting engineers print with high-performance materials they couldn’t use before.
Watch Video
Press Inquiries

Press Contact:

Abby Abazorius
Phone: 617-253-2709
MIT News Office

Media Download

Rendering shows a six-legged robot, standing against a black background, in the process of being 3D-printed. Near the back of the robot, floating black spheres are assembled and then cured by a blue UV light beaming down from above. On top, cameras point down to scan the action.
Download Image
Caption: This rendering shows a robot being built layer-by-layer using the new process. The black spheres represent the material that the printer uses. The material is then cured by UV light, represented in blue. At the top of the image are the cameras that scan the procedure and adjust accordingly.
Credits: Image: Moritz Hocher
In this rendering, a tray of objects is being printed, including a robotic hand. Red and blue components in each object connote the different materials that are used.
Download Image
Caption: The researchers used their printing system to create complex, robotic devices that combine soft and rigid materials. Since the printer has 16,000 nozzles, the system can control fine details of the device being fabricated. This rendering shows objects that have been halfway built by the printer.
Credits: Credit: Courtesy of the researchers
A cream-colored robotic hand sits upright against a black background. The hand consists of balloon-like structures in the fingers and rod-like structures with wires inside.
Download Image
Caption: Researchers produced a functional, tendon-driven robotic hand that has 19 independently actuatable tendons, soft fingers with sensor pads, and rigid, load-bearing bones.
Credits: Credit: Courtesy of the researchers
A robotic hand is being constructed by the printer. White spheres are in layers that are being cured by UV light beaming down from above. An inset shows the molecular makeup of the white spheres.
Download Image
Caption: A rendering shows the printing process of the robotic hand, with white spheres representing the material used by the printer.
Credits: Image: Moritz Hocher
A tray contains several 3D-printed objects: a robotic hand, 8 lattice cubes, a walking robot, and a heart.
Download Image
Caption: A photograph shows a variety of 3D-printed objects in white, displayed on a tray. The objects are: a robotic hand, cubes made of lattice structures, a biological heart, and a walking robot.
Credits: Credit: Courtesy of the researchers

*Terms of Use:

Images for download on the MIT News office website are made available to non-commercial entities, press and the general public under a Creative Commons Attribution Non-Commercial No Derivatives license. You may not alter the images provided, other than to crop them to size. A credit line must be used when reproducing images; if one is not provided below, credit the images to "MIT."

Close
Rendering shows a six-legged robot, standing against a black background, in the process of being 3D-printed. Near the back of the robot, floating black spheres are assembled and then cured by a blue UV light beaming down from above. On top, cameras point down to scan the action.
Caption:
This rendering shows a robot being built layer-by-layer using the new process. The black spheres represent the material that the printer uses. The material is then cured by UV light, represented in blue. At the top of the image are the cameras that scan the procedure and adjust accordingly.
Credits:
Image: Moritz Hocher
In this rendering, a tray of objects is being printed, including a robotic hand. Red and blue components in each object connote the different materials that are used.
Caption:
The researchers used their printing system to create complex, robotic devices that combine soft and rigid materials. Since the printer has 16,000 nozzles, the system can control fine details of the device being fabricated. This rendering shows objects that have been halfway built by the printer.
Credits:
Credit: Courtesy of the researchers
A cream-colored robotic hand sits upright against a black background. The hand consists of balloon-like structures in the fingers and rod-like structures with wires inside.
Caption:
Researchers produced a functional, tendon-driven robotic hand that has 19 independently actuatable tendons, soft fingers with sensor pads, and rigid, load-bearing bones.
Credits:
Credit: Courtesy of the researchers
A robotic hand is being constructed by the printer. White spheres are in layers that are being cured by UV light beaming down from above. An inset shows the molecular makeup of the white spheres.
Caption:
A rendering shows the printing process of the robotic hand, with white spheres representing the material used by the printer.
Credits:
Image: Moritz Hocher
A tray contains several 3D-printed objects: a robotic hand, 8 lattice cubes, a walking robot, and a heart.
Caption:
A photograph shows a variety of 3D-printed objects in white, displayed on a tray. The objects are: a robotic hand, cubes made of lattice structures, a biological heart, and a walking robot.
Credits:
Credit: Courtesy of the researchers

With 3D inkjet printing systems, engineers can fabricate hybrid structures that have soft and rigid components, like robotic grippers that are strong enough to grasp heavy objects but soft enough to interact safely with humans.

These multimaterial 3D printing systems utilize thousands of nozzles to deposit tiny droplets of resin, which are smoothed with a scraper or roller and cured with UV light. But the smoothing process could squish or smear resins that cure slowly, limiting the types of materials that can be used. 

Researchers from MIT, the MIT spinout Inkbit, and ETH Zurich have developed a new 3D inkjet printing system that works with a much wider range of materials. Their printer utilizes computer vision to automatically scan the 3D printing surface and adjust the amount of resin each nozzle deposits in real-time to ensure no areas have too much or too little material.

Since it does not require mechanical parts to smooth the resin, this contactless system works with materials that cure more slowly than the acrylates which are traditionally used in 3D printing. Some slower-curing material chemistries can offer improved performance over acrylates, such as greater elasticity, durability, or longevity.

In addition, the automatic system makes adjustments without stopping or slowing the printing process, making this production-grade printer about 660 times faster than a comparable 3D inkjet printing system.

The researchers used this printer to create complex, robotic devices that combine soft and rigid materials. For example, they made a completely 3D-printed robotic gripper shaped like a human hand and controlled by a set of reinforced, yet flexible, tendons.

“Our key insight here was to develop a machine-vision system and completely active feedback loop. This is almost like endowing a printer with a set of eyes and a brain, where the eyes observe what is being printed, and then the brain of the machine directs it as to what should be printed next,” says co-corresponding author Wojciech Matusik, a professor of electrical engineering and computer science at MIT who leads the Computational Design and Fabrication Group within the MIT Computer Science and Artificial Intelligence Laboratory (CSAIL).

He is joined on the paper by lead author Thomas Buchner, a doctoral student at ETH Zurich, co-corresponding author Robert Katzschmann PhD ’18, assistant professor of robotics who leads the Soft Robotics Laboratory at ETH Zurich; as well as others at ETH Zurich and Inkbit. The research appears today in Nature.

Contact free

This paper builds off a low-cost, multimaterial 3D printer known as MultiFab that the researchers introduced in 2015. By utilizing thousands of nozzles to deposit tiny droplets of resin that are UV-cured, MultiFab enabled high-resolution 3D printing with up to 10 materials at once.

With this new project, the researchers sought a contactless process that would expand the range of materials they could use to fabricate more complex devices.

They developed a technique, known as vision-controlled jetting, which utilizes four high-frame-rate cameras and two lasers that rapidly and continuously scan the print surface. The cameras capture images as thousands of nozzles deposit tiny droplets of resin.

The computer vision system converts the image into a high-resolution depth map, a computation that takes less than a second to perform. It compares the depth map to the CAD (computer-aided design) model of the part being fabricated, and adjusts the amount of resin being deposited to keep the object on target with the final structure.

The automated system can make adjustments to any individual nozzle. Since the printer has 16,000 nozzles, the system can control fine details of the device being fabricated.

“Geometrically, it can print almost anything you want made of multiple materials. There are almost no limitations in terms of what you can send to the printer, and what you get is truly functional and long-lasting,” says Katzschmann.

The level of control afforded by the system enables it to print very precisely with wax, which is used as a support material to create cavities or intricate networks of channels inside an object. The wax is printed below the structure as the device is fabricated. After it is complete, the object is heated so the wax melts and drains out, leaving open channels throughout the object.

Because it can automatically and rapidly adjust the amount of material being deposited by each of the nozzles in real time, the system doesn’t need to drag a mechanical part across the print surface to keep it level. This enables the printer to use materials that cure more gradually, and would be smeared by a scraper.

Superior materials

The researchers used the system to print with thiol-based materials, which are slower-curing than the traditional acrylic materials used in 3D printing. However, thiol-based materials are more elastic and don’t break as easily as acrylates. They also tend to be more stable over a wider range of temperatures and don’t degrade as quickly when exposed to sunlight.

“These are very important properties when you want to fabricate robots or systems that need to interact with a real-world environment,” says Katzschmann.

The researchers used thiol-based materials and wax to fabricate several complex devices that would otherwise be nearly impossible to make with existing 3D printing systems. For one, they produced a functional, tendon-driven robotic hand that has 19 independently actuatable tendons, soft fingers with sensor pads, and rigid, load-bearing bones.

“We also produced a six-legged walking robot that can sense objects and grasp them, which was possible due to the system’s ability to create airtight interfaces of soft and rigid materials, as well as complex channels inside the structure,” says Buchner.

The team also showcased the technology through a heart-like pump with integrated ventricles and artificial heart valves, as well as metamaterials that can be programmed to have non-linear material properties.

“This is just the start. There is an amazing number of new types of materials you can add to this technology. This allows us to bring in whole new material families that couldn’t be used in 3D printing before,” Matusik says.

The researchers are now looking at using the system to print with hydrogels, which are used in tissue-engineering applications, as well as silicon materials, epoxies, and special types of durable polymers.

They also want to explore new application areas, such as printing customizable medical devices, semiconductor polishing pads, and even more complex robots.

This research was funded, in part, by Credit Suisse, the Swiss National Science Foundation, the U.S. Defense Advanced Research Projects Agency, and the U.S. National Science Foundation.

Press Mentions

Tech Briefs

Javier Ramos '12, SM '14, co-founder of InkBit, and his colleagues have developed a, “3D inkjet printer that uses contact-free computer vision feedback to print hybrid objects with a broad range of new functional chemistries,” reports Ed Brown for Tech Briefs. “Our vision for Inkbit is to reshape how the world thinks about production, from design to execution and make our technology readily available,” says Ramos. “The big opportunity with 3D printing is how to disrupt the world of manufacturing — that’s what we're focused on.”

The Daily Beast

Researchers from MIT and elsewhere have developed a new 3D printing process that “allows users to create more elastic materials along with rigid ones using slow-curing polymers,” reports Tony Ho Tran for the Daily Beast. The researchers used the system to create a, “3D printed hand complete with bones, ligaments, and tendons. The new process also utilizes a laser sensor array developed by researchers at MIT that allows the printer to actually ‘see’ what it’s creating as it creates it.”

Related Links

Related Topics

Related Articles

More MIT News

Gene Keselman headshot

Faces of MIT: Gene Keselman

At MIT, Keselman is a lecturer, executive director, managing director, and innovator. Additionally, he is a colonel in the Air Force Reserves, board director, and startup leader.

Read full story