Abstract
Cell culturing is a basic experimental technique in cell biology and medical science. However, culturing high-quality cells with a high degree of reproducibility relies heavily on expert skills and tacit knowledge, and it is not straightforward to scale the production process due to the education bottleneck. Although many automated culture systems have been developed and a few have succeeded in mass production environments, very few robots are permissive of frequent protocol changes, which are often required in basic research environments. LabDroid is a general-purpose humanoid robot with two arms that performs experiments using the same tools as humans. Combining our newly developed AI software with LabDroid, we developed a variable scheduling system that continuously produces subcultures of cell lines without human intervention. The system periodically observes the cells on plates with a microscope, predicts the cell growth curve by processing cell images, and decides the best times for passage. We have succeeded in developing a system that maintains the cultures of two HEK293A cell plates with no human intervention for 192 h.
Introduction
Culturing cells and tissues is an indispensable part of basic cell biology research and clinical applications, such as cell-based drug screening and transplantation of retinal pigment epithelial cells differentiated from induced pluripotent stem cells 1 in regenerative medicine. Advancements in cell engineering technologies will undoubtedly cause the types and quantities of cells required to increase dramatically. Efficiently producing high-quality cells that become the raw materials for tissues and organs used in regenerative medicine is one of the most important issues for the standardization and dissemination of regenerative medicine. In cell culturing and manufacturing, the heterogeneity of cells and perturbation during manipulation are among the numerous uncertainties that remain. 2 Previous studies3,4 have emphasized the importance of considering such intricate characteristics to ensure the quality of the processed cells. An additional factor to consider is the transfer of tacit knowledge. Such transfer is often inefficient and problematic. It normally results in high education costs and usually serves as an obstacle to standardization and dissemination of regenerative medicine. This knowledge transfer problem poses a serious bottleneck in achieving a well-crafted cell production workflow outside of the lab to reach the scale of production that clinical applications require.
To overcome the scalability problems in cell production, various automated culture systems have been developed. Most automated culture systems fall into one of two categories: specialized and multipurpose. Specialized systems aim to scale the quantity of cells produced (capacity), and multipurpose systems aim to scale the types of cells that can be produced (capability). Specialized systems often have fixed configurations and usages and generally feature high-throughput and operational stability. Some examples of this type of machinery include sealed-vessel culture systems that have aseptic spaces for cell cultures that remain unopened during operation.5–8 Robotic arm-assisted systems that utilize articulated robots for autonomous operation are another example.9–15 One drawback of specialized systems is that the addition or modification of experimental instruments and procedures poses certain challenges. Because of this lack of flexibility, specialized automated culture systems are generally ill-suited for basic research as the addition of new experiments, the modification of protocols, and the addition of new laboratory equipment are frequently required. Another drawback is that these systems cannot handle many types of cells at once, thus not scaling well for diverse types of cells. Multipurpose systems, on the other hand, allow flexible changes in workflow and the procurement of additional equipment. In addition, these systems can handle multiple samples at once. This advantage makes these systems suitable for scalability problems of cell types. Automated liquid handling workstations,16,17 in use for decades in various applications downstream of cell culture processes such as high-throughput screening, represent one such example. Attempts have been made to extend their use into other areas, including maintenance passages of cell culture, phenotyping, genotyping, drug screening, and other cell biology experiments.18–21 Recent advancements in mechatronics have made possible the application of industrial-grade human-like dual-arm robots to the automation of various types of experiments in proteomics, drug screening for osteosarcoma, gas chromatography–mass spectrometry (GC-MS) analysis, and chromatin immunoprecipitation analysis.22–25 One significant advantage of utilizing humanoid robots for automating laboratory experiments is that such robots can use the same laboratory equipment as humans. This leads to some significant advantages over other systems. First, the seamless linkage between cell culturing and its downstream processes provides an acceleration of research and development. For example, Fleischer et al. have successfully combined a dual-arm robot with GC-MS that provides a seamless flow from sample preparation to sample transfer to the analyzer and autonomous analysis. 24 Second, they facilitate the transfer of tacit knowledge and skills, which is critically important for yielding high-quality results in certain procedures, especially in cell culture. 23
Cell culture experiments consist of an array of processes, including observation, measurement, and passage, and require various types of equipment. Cell culturing usually takes weeks to months, and the inaccuracies and workload that are inherent through the use of human operators often complicate the process. Conventional systems need complicated and expensive transportation systems to combine various types of equipment and to operate them independently for experiments of long durations, and many of these systems still entrust such transportation procedures to human operators. Cell culturing also involves decision-making and parameter adjustments such as passage timing and reagent addition based on the conditions and evaluation of cell growth. Small-lot multiproduction manufacturing in the industrial field—including assembling IT products such as cell phones, televisions, and computers—has features similar to those encountered in cell culture experiments: complex tasks involving multiple different machines. This area of automation often uses dual-arm robots as well.26,27
In this study, we developed an autonomous variable scheduling cell culture system based on LabDroid, a versatile dual-arm experimental robot, 23 combined with AI-aided fully automated cell growth evaluation and passage timing determination ( Fig. 1 ). We demonstrate the performance of the system in culturing human embryonic kidney (HEK293A) cells. This variable scheduling system enables us to maintain multiple cell plates without any human assistance.

Overall workflow of the developed system. In manual cell culture, cells are observed under a microscope as appropriate, and the cells are replated by performing a passage operation once a certain cell density is reached. To automate these operations, we developed a variable scheduling maintenance culture platform that observes cells every 12 h, predicts the time at which cells will grow to a specified cell density, and executes passage operations by combining LabDroid and software.
Materials and Methods
Definition of Terms
Movement: The smallest action unit for LabDroid to operate. The movement is specified by the joint angle of each arm. For the user, comprehending the movement of the robot from the joint angle values alone is hard. Command: A group of actions such as moving plates, transferring reagents, and aspirating media, among others. A command consists of one or more movements. Job: The instructions that a user gives LabDroid at one time. A job consists of one or more commands. For example, an observation job consists of opening the door of a CO2 incubator, holding the target plate, moving the plate, etc.
LabDroid Maholo Including Peripheral Equipment
LabDroid, along with peripheral equipment, was placed inside of a booth consisting of acrylic walls and a stainless steel frame with fan filter units (FFUs; CF-H040, KEYENCE, Osaka, Japan). Air supplied to the platform was cleaned with a top-mounted FFU with HEPA filters to maintain cleanliness. The LabDroid booth consisted of the following equipment: dual-arm robot (YASKAWA Electric Corp., Fukuoka, Japan), refrigerator (CN-25C, Mitsubishi Electric Engineering Co., Ltd., Tokyo, Japan), CO2 incubator (APC-30D, ASTEC Co., Ltd., Fukuoka, Japan), pipette tips (3512-05-HR/3511-05-HR/94410313/94410713/94052550, Thermo Fisher Scientific, Waltham, MA), micropipettes (4641110N/4641030N/4641230N/4641210N, Thermo Fisher Scientific), 50 mL tube rack (Robotic Biology Institute Inc., Tokyo, Japan), four 6-well plate rack (Robotic Biology Institute Inc.), dry bath (EC-40RA, AS ONE Corporation, Osaka, Japan), tip sensor (Robotic Biology Institute Inc.), aspirator (SP-30, Air Liquide, Milano, Italy), dust bin (EPD3S, Sekisui Techno Molding Co., Ltd., Tokyo, Japan), and microscope (EVOS FL Auto 2, Thermo Fisher Scientific).
ProtocolMaker (YASKAWA Electric Corp.), software fused for operating LabDroid, allows a user to construct LabDroid programs with a graphical user interface. The user may specify various settings, such as the origin and destination of tubes and plates, the amount, and the position, as well as the number of suction and dispensation counts for liquid transfer from tubes to plates, the suction and dispensation heights within a tube or plate, the inclination of a plate, and the speed of suction and dispensation.
There is a space to position tubes and plates in front of the LabDroid. and culture operations are performed by moving cell plates, reagents, and labware to the designated locations. LabDroid uses its various sensors to determine if a scheduled operation has been successful. It uses the laser distance sensors embedded in its arms (
Software: Batch Timing Manager
In this experiment, we divided the HEK293A cell line into two plates and cultured them in parallel. The first plate is named “cell plate 1” and the second plate is named “cell plate 2.” The batch timing manager (BTM) manages when and which cell plate to observe and the time of passage. A system initializes the scheduled observation time (SOT) and scheduled passage time (SPT) when the user starts the system. For the first cell plate, the SOT is set to 1 min after initialization and the SPT is set to 1 day after initialization. For the second cell plate, the SOT is set to 30 min after initialization and the SPT is set 1 day and 30 min after initialization. At the scheduled time, the BTM instructs LabDroid to observe or passage the target cell plate.
After the observation, the BTM calculates the density from new microscopy images using the cell density calculator (CDC) and saves the observation time and cell density values to a log file. If the log file has two or more density values for the target cell plate, BTM applies a growth curve predictor (GCP) to the log. Then, the time in which the predicted cell density value will exceed a predetermined value is calculated and set as the new SPT. The SOT is set to 12 h after the last observation or passage. When the schedule includes more than one job at the same time, observation takes precedence over passage, and cell plate 1 takes precedence over cell plate 2.
Software: Cell Density Calculator
We used tiled microscopy images (
where C is the cell density, Ac is the cell area that the program recognizes as being cells (
The method used for cell area detection is as described by MathWorks 28 except for our method using the Canny algorithm in place of the Sobel algorithm for edge detection. 29
Software: Growth Curve Predictor
The GCP predicts cell density by fitting the logistic differential equation. 30 We defined the logistic function as
where N0 is the initial cell count, Δt is the elapsed time from the initial cell count, r is the growth rate, and K is the maximum cell count.
where Nt is the observed density at time t, pt is the number of passages at time t, pc is the current number of observations, ot is the number of observations at time t, oc is the current number of observations,
Software: Robot Job Manager
The robot job manager (RJM) assembles appropriate jobs from the job library according to the remaining amounts of reagents and/or labware for LabDroid to perform the appropriate operation.
The RJM manages the positions of tubes and plates using a tree data structure, referred to as the supply management model (SMM). The system obtains the initial positions of reagent tubes and plates from the user as a form of SMM. The user then places tubes and plates on the robot workspace (LabDroid booth; see Fig. 2 ).

LabDroid Maholo including peripheral equipment. A bird’s-eye view of the LabDroid booth: (1) dual-arm robot, (2) refrigerator, (3) CO2 incubator, (4) micropipettes, (5) dust bin, (6) aspirator, (7) tip sensor, (8) 50 mL tube subrack, (9) pipette tips, (10) 50 mL tube main rack, (11) six-well plate rack, (12) dry bath, and (13) microscope.
The RJM assembles jobs sent to LabDroid using batch design, the job library, and the SMM. The user prepares the batch design and job library, and they remain unchanged during control. A batch design is an ordered list of jobs for observation or passage, and the job library is a list of jobs. Some jobs in a batch design may have unspecified details, such as having no source position for the new plate. However, all jobs in the job library have detailed instructions. When sending jobs for observation or passage, the program uses the SMM to first search for executable jobs from the job library. It then replaces some jobs in the batch design with executable jobs in the job library. After this replacement, all jobs in the batch design become executable. This executable job list is referred to as an assembled batch.
When ordering LabDroid to run an observation job, the RJM first finds the position of the cell plate to be observed from the SMM. Next, the RJM makes and sends the assembled batch to LabDroid. When ordering LabDroid to run a passage job, the RJM first determines the position of the cell plate to be passaged from the SMM. Then, it finds the new plate and remaining reagents needed for passage. Afterward, the program calculates the amount of plates and reagent to be used in the passage and reflects this amount in the SMM. Finally, the RJM makes and sends the assembled batch to LabDroid.
Software: Dashboard
The Dashboard is an HTML-based monitoring system to allow humans to observe the progress of a process. The system displays the following information: (1) LabDroid status (running or halted)—LabDroid status is presented as running when less than 30 min has elapsed since the latest run time and halted otherwise; (2) scheduled time—the SOT and SPT of each line; (3) observed cell density and growth curve—plot of calculated cell density and fitted lines estimated after the latest passage; and (4) job order list—the names of the jobs sent to LabDroid, their time stamps, and execution validity (whether LabDroid successfully concluded the process or not).
Preparation of Reagents and Labware
We imported all other reagents and labware into the LabDroid booth as shown in
Cell Culture Experiments
We obtained HEK293A cells from Thermo Fisher Scientific (R70507) and maintained them in DMEM (043-30085, FUJIFILM Wako Pure Chemical), supplemented with 10% fetal bovine serum (FBS; 555-21245, Biosera, Nuaillé, France), 100 U/mL penicillin-streptomycin (15140-122, Thermo Fisher Scientific), and 2 mM
Prior to cell culturing with a robot, we prepared cells manually. We seeded cells at the A2 well position in six-well plates, washed them with PBS (10010023, Thermo Fisher Scientific), detached them with 0.05% trypsin (25300054, Thermo Fisher Scientific) by pipetting after 2 min at room temperature, and replated at 1 × 105 and 2 × 105 cells/well. We then transferred the cells to the CO2 incubator in the LabDroid booth unit and created robot job library files (
Results and Discussion
LabDroid-Based Autonomous Cell Culture System for Cell Passage
Cell culturing under artificial conditions requires attaching the cells to the flat bottom of a plastic tissue culture dish or the culture dish filled with a liquid medium containing nutrients. When cells proliferate and cell density exceeds a certain level, cells must be passaged onto a new culture dish by detaching adherent cells using enzymes, collecting, and diluting. To maintain healthy cells, the continuation of culturing and passage to maintain the cell density within an appropriate range is necessary.
We developed a variable scheduling robot-AI system that automatically observes growing cells on plates every 12 h with a microscope, predicts the time at which the cell density exceeds the designated level based on the observation, and passages the cells at the optimal timing. The system can culture two cell plates at the same time ( Fig. 1 ). The user must set the following initial parameters: (1) initial value of the passage time for the first cell plate, (2) initial value of the passage time for the second cell plate, (3) initial value of the observation time of the first cell plate, (4) initial value of the observation time of the second cell plate, (5) minimum observation interval, (6) minimum gap between joints, and (7) cell density for timing of passage. The user loads reagents and cell plates before starting the operation.
Software Development and Integration
The system consists of a LabDroid robot, a robot job library, and five computer programs. LabDroid is a versatile dual-arm robot for life science experiments with very high positional accuracy.
23
We placed a refrigerator, a CO2 incubator, and a microscope in addition to other peripherals, such as tube racks, in the LabDroid booth (
Fig. 2
). The protocol editor software called ProtocolMaker was used to define elementary robot commands such as adding reagents, cell detachment, and transfer of cell suspension (
The software system consists of five components: (1) a BTM, (2) a CDC, (3) a GCP, (4) an RJM, and (5) a graphical dashboard (
Fig. 3
). The BTM runs continuously for the duration of the experiment and manages which cell plate to observe or transfer based on a line table file (

System components. Relationships between components. Black frames represent components, and gray boxes represent files. The density log file is a log of calculated cell density, and the execution log file is a log of jobs sent to LabDroid. The line table file, SMM, and components are described in Materials and Methods.
The Developed System Automatically Cultured HEK293A Cells
We then used the developed system to maintain a culture of the HEK293A cell line, and selected this cell line for three reasons: (1) its single-cell-layer formation simplifies the image processing required to calculate the cell area, (2) its high adhesion to the bottom of the culture plate alleviates the difficulties in implementation of cell handling via robotic hands, and (3) its fast growth rate eliminates the need to create a media exchange job, as the cells would need to be passaged by the time a media exchange would be necessary.
First, we defined the various operating parameters of LabDroid in the passage process, such as the speed of reagent addition, the angle of the plate during aspiration, and the number of pipetting cycles during cell detachment in accordance with the HEK293A cells (
We imported two plates with a different number of seeded cells, the reagents required, and consumables into the robot booth, and started the system with the passage target set to 80% cell density. The system operated for 192 consecutive hours, during which the system executed a total of eight passage processes and 39 cell observation processes. Upon completing its operation, the system had executed a total of 95 jobs without yielding any system-derived errors (

HEK293A cell culture by developed system. HEK293A cells were seeded into six-well plates and cultured by the developed system, which was set to 80% (
We then changed the passage target to 60% cell density and repeated the same experiment. The system operated for 159 consecutive hours without human intervention or critical system error, conducting a total of seven passage processes and 33 cell observation processes. In total, the system executed 82 jobs and performed 45 of these between 6:00 p.m. and 6:00 a.m. (
Outlook
In conclusion, our system succeeded in the autonomous passage of two mammalian cell plates containing a different number of seeded cells simultaneously, with variable target passage cell density values. One limitation of our system is that it changes the single-variable parameter, the timing of passage, solely on the observation and prediction of the cell density. The system has potential for further applications. For example, human experts culture cells not only by estimating cell densities but also by considering some other important factors, such as the 3D cell structure, temporal development, environmental factors, and pH of the media, as well as distinguishing between living and dead cells. The current system assesses only the quantity of growing cells to determine passage timing, but it can perform other procedures, such as discarding cells, expanding cultures, changing media, and freezing and thawing cells based on the quality of the cells along with the quantity. Such extensions have an important potential to culture a wider range of cell types or for adoption in more advanced cell culturing operations, such as differentiation induction.
Supplemental Material
sj-pdf-1-jla-10.1177_2472630320972109 – Supplemental material for A Variable Scheduling Maintenance Culture Platform for Mammalian Cells
Supplemental material, sj-pdf-1-jla-10.1177_2472630320972109 for A Variable Scheduling Maintenance Culture Platform for Mammalian Cells by Koji Ochiai, Naohiro Motozawa, Motoki Terada, Takaaki Horinouchi, Tomohiro Masuda, Taku Kudo, Motohisa Kamei, Akitaka Tsujikawa, Kenji Matsukuma, Tohru Natsume, Genki N. Kanda, Masayo Takahashi and Koichi Takahashi in SLAS Technology
Footnotes
Acknowledgements
We thank T. Mitsuyama, H. Kiyonari, S. Wada, T. Sakurada, and Y. Ozawa for useful discussions; E. Takagi and H. Hirabayashi for research support; H. Uchida for illustrations; and J. Freeman for carefully proofreading the manuscript. We also thank all the lab members at RIKEN BDR, in particular, N. Sakai, G. A. Sunagawa, N. Koide, and K. Itaya, for their kind help in preparing the materials, supporting experiments, and useful discussions.
Supplemental material is available online with this article.
Declaration of Conflicting Interests
The authors declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: T.K., M.K., K.M., T.N., and G.N.K. are employees, executives, or stakeholders of Robotic Biology Institute Inc., which may benefit financially from increased scientific use of LabDroid Maholo. All other authors declare no competing interests.
Funding
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by a project subsidized by the New Energy and Industrial Technology Development Organization (NEDO, to M. Takahashi), the JST-Mirai Program (JPMJMI18G4, to K.T.), an internal grant from the RIKEN Center for Biosystems Dynamics Research (to M. Takahashi and K.T.), the RIKEN Engineering Network (to M. Takahashi), and the RIKEN Junior Research Associate program (to K.O. and N.M.).
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
