This research introduces an innovative Augmented Reality (AR) workflow for Human-Robot Interaction (HRI) in timber construction. The approach leverages human dexterity and adaptability alongside the strength and precision of robotic arms to assemble timber structures connected by wood-wood connections. While research in the field of automated construction generally focuses on singular interactions, such as robot agents carrying components and human agents attaching them, this paper explores multiple degrees of interaction involving cooperation or collaboration between agents. A new algorithmic framework is developed to automate the generation of holographic instructions and allocate assembly tasks to human and robot agents according to their abilities. The application to a full-scale demonstrator reveals that certain elements necessitate collaboration for assembly, while others can exclusively be assembled manually or robotically. Ultimately, the research also highlights the benefits of AR in assisting manual assembly, simulating robot trajectories, and increasing safety during collaborative tasks.
BademosiFTayehRIssaR. Skills assessment for robotics in construction education. Int J Intell Syst2018; 7(1): 47–68.
2.
García de SotoBAgustí-JuanIJossS, et al.Implications of Construction 4.0 to the workforce and organizational structures. Int. J. Constr. Manag2019; 22(1): 205–217. DOI: 10.1080/15623599.2019.1616414.
3.
MitterbergerDDörflerKSandyT, et al.Augmented bricklaying. Constr Robot2020; 4: 151–161. DOI: 10.1007/s41693-020-00035-8.
4.
TaylorFW. The principles of scientific management. New York, London: Harper & Brothers, 1911.
5.
BravermanH. Labor and monopoly capital: the degradation of work in the twentieth century. New York: NYU Press, 1998.
6.
CarpoM. Beyond digital: design and automation at the end of modernity. Cambridge: MIT Press, 2023.
7.
KoppTBaumgartnerMKinkelS. Success factors for introducing industrial human-robot interaction in practice: an empirically driven framework. Int J Adv Manuf Technol2021; 112(3–4): 685–704. DOI: 10.1007/s00170-020-06398-0.
8.
SongYKoeckRLuoS. Review and analysis of augmented reality (AR) literature for digital fabrication in architecture. Autom ConStruct2021; 128: 103762. DOI: 10.1016/j.autcon.2021.103762.
9.
DianatfarMLatokartanoJLanzM. Review on existing VR/AR solutions in human-robot collaboration. Procedia CIRP2021; 97: 407–411. DOI: 10.1016/j.procir.2020.05.259.
10.
RogeauNTiberghienVLatteurP, et al.Robotic insertion of timber joints using visual detection of fiducial markers. In: Proceedings of the 37th ISARC. Japan: Kitakyushu, 2020, pp. 491–498. DOI: 10.22260/ISARC2020/0068.
11.
RogeauNGamerroJLatteurP, et al.Design considerations for robotically assembled through-tenon timber joints. Constr Robot2022; 6(3–4): 293–304. DOI: 10.1007/s41693-022-00080-5.
12.
LeungPYVApolinarskaAATanadiniD, et al.Automatic assembly of jointed timber structure using distributed robotic clamps. In: PROJECTIONS – Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design, Hong-Kong, China, 29 March–1 April 2021. DOI: 10.52842/conf.caadria.2021.1.583.
13.
ApolinarskaAAPacherMLiH, et al.Robotic assembly of timber joints using reinforcement learning. Autom ConStruct2021; 125: 103569. DOI: 10.1016/j.autcon.2021.103569.
14.
ThomaAAdelAHelmreichM, et al.Robotic fabrication of bespoke timber frame modules. In: Robotic Fabrication in Architecture, Art and Design 2018, Zurich, Switzerland, 12–14 September 2018, pp. 447–458. DOI: 10.1007/978-3-319-92294-2_34.
15.
SkevakiEKladeftiraMPittiglioAN, et al.Assembly of spaceframes in hybrid teams: adaptive digital fabrication workflows for human-robot collaboration. In: Accelerated Design - Proceedings of the 29th CAADRIA Conference, Singapore, 20–26 April 2024, Volume 3, pp.291–300.
16.
HanIXParaschoS. Improv-structure: exploring improvisation in collective human-robot construction. In: Trends on Construction in the Digital Era – Proceedings of ISIC 2022, Guimarães, Portugal, September 2022, doi; DOI: 10.1007/978-3-031-20241-4_16.
17.
MitterbergerDAtanasovaLDörflerK, et al.Tie a knot: human–robot cooperative workflow for assembling wooden structures using rope joints. Constr Robot2022; 6(3-4): 277–292. DOI: 10.1007/s41693-022-00083-2.
18.
HughesROsterlundTLarsenNM. Integrated design-for-manufacturing and AR-aided-assembly workflows for lightweight reciprocal frame timber structures. Constr Robot2021; 5(2): 147–157. DOI: 10.1007/s41693-020-00048-3.
19.
MorseCMartinez-ParachiniERichardsonP, et al.Interactive design to fabrication, immersive visualization and automation in construction. Constr Robot2020; 4(3-4): 163–173. DOI: 10.1007/s41693-020-00039-4.
20.
KyawAHSpencerLLokL. Human–machine collaboration using gesture recognition in mixed reality and robotic fabrication. Archit Intell2024; 3(11): 11. DOI: 10.1007/s44223-024-00053-4.
21.
KyjanekOBaharBAVaseyL, et al.Implementation of an augmented reality AR workflow for human robot collaboration in timber prefabrication. In: Proceedings of the 36th ISARC. Canada: Banff, 2019, pp. 1223–1230. DOI: 10.22260/ISARC2019/0164.
VARID. Virtual & augmented reality for inclusive design, 2022. https://varid.co.uk/
24.
HietanenAPietersRLanzM, et al.AR-based interaction for human-robot collaborative manufacturing. Robot Comput Integrated Manuf2020; 63: 101891. DOI: 10.1016/j.rcim.2019.101891.
25.
CarrieroGCalzoneNSileoM, et al.Human-robot collaboration: an augmented reality toolkit for Bi-directional interaction. Appl Sci2023; 13(20): 11295. DOI: 10.3390/app132011295.
26.
TsamisGChantziarasGGiakoumisD, et al.Intuitive and safe interaction in multi-user human robot collaboration environments through augmented reality displays. In: Proceedings of the 30th IEEE International Conference on Robot & Human Interactive Communication. Vancouver, Canada: IEEE, 2021, pp. 520–526. DOI: 10.1109/RO-MAN50785.2021.9515474.
27.
BurdenAGCaldwellGAGuertlerMR. Towards human-robot collaboration in construction: current cobot trends and forecasts. Constr Robot2022; 6(3): 209–220. DOI: 10.1007/s41693-022-00085-0.
28.
CostaGMPetryMRMoreiraAP. Augmented reality for human–robot collaboration and cooperation in industrial applications: a systematic literature review. Sensors2022; 22(7): 2725. DOI: 10.3390/s22072725.
29.
RogeauNLatteurPWeinandY. An integrated design tool for timber plate structures to generate joints geometry, fabrication toolpath, and robot trajectories. Autom ConStruct2021; 130: 103875. DOI: 10.1016/j.autcon.2021.103875.
30.
Health and Safety Executive. Manual handling operations regulations 1992. 4th ed.London: Health and Safety Executive, 2016, p. 54.
31.
FleischmannPCasasGLyrenmannM. Compas RRC: online control for ABB robots over a simple-to-use Python interface. Automation in Construction, 2020; 144: 104599. DOI: 10.5281/zenodo.4639418.
32.
Rezaei RadABurtonHVWeinandY. Macroscopic model for spatial timber plate structures with integral mechanical attachments. J Struct Eng2020; 146(10): 04020200. DOI: 10.1061/(ASCE)ST.1943-541X.0002726.
33.
Rezaei RadABurtonHRogeauN, et al.A framework to automate the design of digitally-fabricated timber plate structures. Comput Struct2021; 244: 106456. DOI: 10.1016/j.compstruc.2020.106456.
ISO 10218–1. Robots and robotic devices – safety requirements for industrial robots. Part. 2011; 1: 11.
36.
ŠlajpahSRakinićKNikolovskaK, et al.Effect of speed, speed differences, and motion type on perceived safety of collaborative robots. In: 20th International Conference on Advanced Robotics. New Delhi: ICAR, 2021, pp. 1036–1041. DOI: 10.1109/ICAR53236.2021.9659479.
37.
KyawAHXuAHJahnG, et al.Augmented reality for high precision fabrication of glued laminated timber beams. Autom ConStruct2023; 152: 104912–104922. DOI: 10.1016/j.autcon.2023.104912.
38.
BrosqueCGalballyEKhatibO, et al.Human-robot collaboration in construction: opportunities and challenges. In: 2020 International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA). Piscataway: IEEE, 2020, pp. 1–8. DOI: 10.1109/HORA49412.2020.9152888.
