Next Article in Journal
Influence of Wind Power on Modeling of Bidding Strategy in a Promising Power Market with a Modified Gravitational Search Algorithm
Next Article in Special Issue
Skeleton Tracking Accuracy and Precision Evaluation of Kinect V1, Kinect V2, and the Azure Kinect
Previous Article in Journal
Crack Propagation in the Tibia Bone within Total Knee Replacement Using the eXtended Finite Element Method
Previous Article in Special Issue
Coordinating Entrainment Phenomena: Robot Conversation Strategy for Object Recognition
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Human-Inspired Control Strategy for Improving Seamless Robot-To-Human Handovers

by
Paramin Neranon
* and
Tanapong Sutiphotinun
Department of Mechanical and Mechatronics Engineering, Faculty of Engineering, Prince of Songkla University, Songkhla 90112, Thailand
*
Author to whom correspondence should be addressed.
Appl. Sci. 2021, 11(10), 4437; https://doi.org/10.3390/app11104437
Submission received: 20 April 2021 / Revised: 8 May 2021 / Accepted: 10 May 2021 / Published: 13 May 2021
(This article belongs to the Special Issue Social Robotics and Human-Robot Interaction (HRI))

Abstract

:
One of the challenging aspects of robotics research is to successfully establish a human-like behavioural control strategy for human–robot handover, since a robotic controller is further complicated by the dynamic nature of the human response. This paper consequently highlights the development of an appropriate set of behaviour-based control for robot-to-human object handover by first understanding an equivalent human–human handover. The optimized hybrid position and impedance control was implemented to ensure good stability, adaptability and comfort of the robot in the object handover tasks. Moreover, a questionnaire technique was employed to gather information from the participants concerning their evaluations of the developed control system. The results demonstrate that the quantitative measurement of performance of the human-inspired control strategy can be considered acceptable for seamless human–robot handovers. This also provided significant satisfaction with the overall control performance in the robotic control system, in which the robot can dexterously pass the object to the receiver in a timely and natural manner without the risk of harm or injury by the robot. Furthermore, the survey responses were in agreement with the parallel test outcomes, demonstrating significant satisfaction with the overall performance of the robot–human interaction, as measured by an average rating of 4.20 on a five-point scale.

1. Introduction

Recently, robots have been widely developed over the last decades to meet the requirements of improving human–robot interaction (HRI). HRI is a field of study to understand, design and evaluate robotic systems, while interacting with humans [1]. The interaction involves several communication forms and can be mainly categorized into two types: remote interaction (i.e., search and rescue [2,3,4], military and police [5,6], space exploration [7,8,9], etc.) and proximate interaction (i.e., assistive robotics and educational robotics [10,11,12,13,14], home or industry [15,16], etc.).
In this research, the field of social robotics and human–robot interaction are highlighted, in which robots are being developed to serve in human assistive capacities. One of the main challenges in close proximity interaction is to efficiently establish a framework for seamless human–robot handovers (HRH). This will allow a human to act jointly with a robot safely and reliably. The researchers [17] claimed that understanding of behavioural control strategies of human–human interaction (HHI) is fundamental to design an effective HRI system. In addition, Neranon et al. [18] also addressed that understanding the principle of human haptic interaction, when two humans work together in a joint effort to complete a shared task, is crucial in designing an effective HRI system.
This section emphasizes the background of handover-based research, since human–human handovers (HHH) are the ultimate benchmark for seamless handovers. A giver is defined as an agent who holds an object and passes it to another. In the physical interaction, a receiver is a particular position that receives the object by starting pulling it. Afterwards, the receiver takes responsibility for the object throughout the transferring process [19,20]. Much of the relevant HHI research, which has steadily increased to enhance the understanding of HHI behaviour, has been reviewed. Previous studies have examined issues regarding investigating the control characteristics of two humans in a physical handover task, for examples, analysing (1) the influence of velocity [21,22] and trajectory [23,24] on the handover movements, (2) grip forces and load forces in the object exchange [25], (3) grasp points [26,27] and locations [28,29] and finally, (4) configuration [30,31] of the exchanged object. These can be used as conceptual frameworks for designing control systems for cooperative robots to work with other partners by imitating human-based behaviour control strategies.
Sutiphotinun et al. [32] investigated the human behavioural responses in HHH tasks under various conditions. The paradigm findings show human dynamic characteristics, i.e., interactive force analysis, suitable transfer locations between the givers and receivers and the handover sequences. The handover is distinctively categorized into sending-transferring-receiving phases, where the giver agent primarily decides to release the object. This will be useful for developing a robotic behaviour-based approach in seamless HRH in future. Saki Kato et.al [33] analysed how humans (givers and receivers) determine the locations of object transfer during handovers for a good understanding of the mechanisms of human social behaviour. The study also presented a linear model with the influential factors affecting the handover locations. It consists of participant heights, genders and social dominance of the two partners and the distance between both humans.
Chien et al. [34] proposed adaptive coordination strategies for physical HRH. It was based on the identification of HHH strategies regarding how people adapt their handover actions to the workload of their partners. The newly developed approach involving two baselines, namely, (1) proactive and (2) reactive coordination techniques, enabled similarly fluid and effective HRH tasks. Sisbot et al. [35] proposed a robotic navigation planner and a manipulation planning framework by first understanding the human dynamic characteristics of the haptic interaction. This facilitated the robot to autonomously select the best handover location based on context (i.e., accessibility, posture, a field of view and human’s safety etc.). This offered safe, legible and socially acceptable paths for HRH tasks. Some researchers [36,37,38] examined a robotic mechanism guideline to allow the robot to grasp an object based on human-like reaching gestures before handing it over to a human partner. It involved the object’s shape and function and the minimization of the risk of an injury occurring during the HRI execution.
Jae-Bong et al. [39] developed a general-purpose software framework for a Human support robot (HSR) service robot. It directly communicated with a human using complex speech commands. This allowed the robot to move smoothly in a confined space and also manipulate various household objects and autonomously pass them to a human. As extensively reviewed, the existing research on the development of HRH has almost underlined the investigation on behavioural strategies and the establishment of a framework for a robotic behaviour-based approach. This allowed the robot to approach a person, reach over an object and hand over it with human-like configurations and motions.
However, there has been little discussion on the crucial challenges of the development of seamless HRI, since a robotic control system is further complicated by the dynamic nature of the human environment. Thus, it necessitates a very careful design and implementation of optimized behavioural control strategies to significantly improve the success rate of effective object handover tasks. This also protects a human partner from the risk of harm or injury by a robot in the cooperative tasks. To solve the limitations as mentioned, therefore, this paper presents the design of a human-inspired control strategy for improving seamless robot–human handovers using the hybrid PID position control and impedance control algorithm. This system will enhance the accuracy of positioning and force regulating abilities in the HRH system and also increase the smoothness of human–robot physical interaction.
This paper details an optimized robotic control implementation for HRH by first understanding haptic dynamic interaction in HHH tasks in terms of interactive force, suitable transfer locations between the givers and receivers and the handover sequences. This knowledge is then used to design a robotic behaviour-based approach, which is the crucial aspect of the development of effective HRH. It is followed by how to develop optimized hybrid position/force control involving PID position control and force impedance control. The robotic control incorporates feedback signals from the HSR-3D-depth sensor, encoders (joint estimators) and multi-axis force/torque sensor attached to the robot wrist joint, respectively. The dynamic mechanical model of the physical HRH was additionally explained. Afterwards, the final sections express the control system evaluations, experimental results of the robotic HRH tasks and finally, conclusion.

2. Design of the Robotic Human-Inspired Control Strategy for HRH

2.1. Background of Human-Human Handover Strategy

It is crucial to understand the kinematics and dynamics of HHH behaviour to design a conceptual guideline for a robotic human-like controller for robust, behaviour-based, HRH. Consequently, a set of HHH tests was initially conducted as fully detailed in our previous journal article [32]. It can be summarized that the experimental results of HHH intensively addressed (1) investigation of the human handover strategies of the givers and receivers (2) examination of the interactive forces and the transfer locations between the couple and (3) clarification of the mathematical model of the giver’s arm, which leads to a better understanding how the giver regulates the bilateral force before releasing the object to be transferred to the receiver.
The tests give the behavioural explanation of HHH in which the HHH process can be interpreted as three distinct phases consisting of (1) sending, (2) transferring and (3) receiving. In the sending session, the giver starts grasping and holding an object and moves to the receiver, who is in the field of the giver’s view. Once the handler recognizes a receiver and his/her position, the giver subsequently computes and estimates a suitable object transfer point based on human-relevant parameters. In the meantime, the giver is then moving to the transfer point facing the receiver before naturally handling the object. The handover locations y   (height from the ground) is formulated as Equation (1), where x 1 and x 2 are the giver’s and receiver’s heights, respectively. Contrastingly, the transfer distance (in the x-axis) along the facing direction was approximately 0.85 m.
y = 8.23 + 0.243 x 1 9.592 x 2 1.626 x 1 2 + 1.441 x 2 2 + 3.189 x 1 x 2
In the transferring phase, the giver’s decision is based on the amount of threshold (interactive) force ( f t s h ), which was significantly proportional to the object mass. The relationship between the f t s h as a function of object mass ( ϑ m ) can be exposed in Equation (2).
f t s h = 85 ϑ m 3 + 100.75 ϑ m 2 35.78 ϑ m + 6.75
The handover time was approximately 0.46 s. Moreover, to gain more understanding of how the giver regulates the interactive force, the transfer function ( T G ) of the giver’s hand can be expressed as the following equation:
T G = 2.63 × 10 4 S + 5211 S 2 20.25 S + 51.76
These findings disclose the human characteristics of the haptic handover interaction and for the aim of obtaining a conceptual guideline for a robotic human-like control strategy in HRH.

2.2. Toyota HSR Platform

An HSR home service as depicts in Figure 1a has been launched by the Toyota Corp. the robot can be controlled intuitively using voice commands or a touchscreen graphical user interface. The core technologies of the HSR comprise speech recognition, object recognition, autonomous navigation and localization, motion planning, task planning, etc. These are adequate to develop HRH in this research. It is realizing that the safety issue is an essential aspect of a robot to collaborate with humans in a safe and natural manner. Obstacle avoidance and a force relaxation mechanism were employed to protect humans from any mistakes or accidents. As the robot has to accommodate a wide variety of household activities, then its cylindrical telescoping body was originally fabricated. It was equipped with a differential pseudo-omnidirectional wheel and a central yaw joint which allow the robot to handle most manipulation tasks with smooth changes in direction [39].
To construct a robot map and map-based self-localization, the robot base has equipped with two types of sensors, i.e., a LIDAR sensor and an inertial measurement unit (IMU). The HSR manipulator arms are made up of a shoulder pitch joint and roll-pitch-roll wrist joints. The robot end-effector has a two-finger parallel gripper (driven by a single motor), which was furnished by a wrist multi-axis force/torque sensor and hand camera. The fingertips were designed to be compliant with the shape of the objects, as it is covered by elastic materials. The robot arm is attached to the body with a three-stage prismatic waist joint, which enables the height of the robot’s shoulder to a telescope. The robot’s head has been attached by an ASUS Xtion RGBD camera, two RGB cameras, a microphone array and a small display monitor [39,40,41].
The robot has two onboard computers. The main computer is preserved for Toyota’s proprietary code to execute sensor and motor interfaces, motion planning and control and the web-based remote user interface etc. Nevertheless, both computers do not have much computing power for the development of advanced software algorithms. Then, it requires an external computer that can directly communicate with the HSR software platform using Robot Operating System (ROS). The robot software architecture can be categorized into two layers: (1) real-time control and (2) intelligence layers. The first layer executes real-time processing for motor control using motor drivers and servo amplifiers. The second layer deals with analysing or systematically extracting big data such as RGB images and point clouds, in which Linux (Ubuntu) is adopted to run the OS and ROS [39,40,41]. The HRS software architecture is illustrated in Figure 1b.

2.3. The Conceptual Framework for Human-Robot Handover

The conceptual outline for HRH presents in Figure 2. Based on the human-like behavioural guideline, it can be summarized that the robot initially takes an order given by a receiver; for example, grasping a bottle of water, etc. Then, the robot moves to the object location and extracts the desired object (i.e., using YOLO). The computational system creates a grasping point of the object based on the centre of gravity. Afterwards, the robot plans the hybrid base/arm trajectory using the hybrid inverse kinematics explained in Section 2.4. Once the robot gripper reaches the object, it starts grabbing it with a proper grasping force measured by force sensors attached to the robot fingertips. The robot moves back to the receiver and simultaneously recognize the receiver and his/her location using the head_pose_estimation package detailed in Section 2.5. Subsequently, the robot moves to a transfer location computed using Equation (1). The transferring phase is activated once the receiver manipulates the hand and grasps the object. In the meantime, the service robot has to regulate the bilateral force before releasing the object to be transferred to the receiver. This computational process incorporates the required maximum interactive force formulated in Equation (2). Then, the final phase involves the receiver taking responsibility for the object and the robot retrieving the arm and returning to the home position.
This paper focuses on the design and development of the robot human-like dynamic control, particularly in the transferring session. This will enable similarly fluid and effective object handover tasks with the receiver. Therefore, for all HRH tests, it can be assumed that the robot correctly holds the required object and stays at a home position already. It is ready to promptly handling the object to a human at a defined transfer location.

2.4. Kinematic Model of the HSR

This section briefly explains the kinematic model of the HSR, which relates to forward and inverse kinematics. In the case of the forward kinematics, the location and pose of the robot end-effector are controlled by the given links and joints of the HSR robot. The Denavit–Hartenberg parameters evaluation is used to achieve the kinematic chain of the robot rigid bodies. Based on the studies by researchers [39,40,41], the mechanical schematic diagram of a dual-wheel caster-drive robot base and the robot’s joint configuration is shown in Figure 3a. The following notation is used in this analysis: the radius of each wheel ( r ), the angle of the pivot axis ( θ H ), the wheel tread ( W ), the displacement between the centre axis and the axle centre ( H ), the inverse kinematics ( f ), the reference value of the tip pose ( T e ), the degree of freedom of the base ( θ 2 ), the torso lift height ( l 3 ), the shoulder pitch angle ( θ 4 ), the length of arm ( l 52 ), the length of the wrist( l 82 ) and finally, the joint angles of the arm ( θ 5 , θ 6 , θ 7 ). These are defined in Figure 3b.
The robotic dynamic model is essential for describing the HSR robot’s position, orientation and motions of the wheels. It can be used for analysing and synthesizing the overall dynamic behaviour of the robot. The robot itself has three degrees of freedom on the x-y plane and can perform forward–reverse movement and left–right movements. As reviewed [39,40,41], the kinematic equations and relations between robot velocity and various geometry specifications are expressed by the Transformation matrices from linear velocity on the global frame to linear on the robot frame as the following.
[ ω R ω L ω H ] = [ r 2 c o s θ H r H W s i n θ H r 2 c o s θ H + r H W s i n θ H 0 r 2 s i n θ H r H W c o s θ H r 2 s i n θ H r H W c o s θ H 0 r W r W 1 ] 1 [ x ˙ y ˙ θ ˙ ] .
By assuming that translational and rotational transforms on x-y-z axes are represented as T t ( x , y , z ) ,   R x ,   R y , R z and R z , respectively, forward kinematics of the HSR arm ( T H S R ) can be written as:
T H S R = R z ( θ 2 ) T e ( 0 , 0 , l 3 ) R y ( θ 4 ) T e ( 0 , 0 , l 52 ) R z ( θ 5 ) R y ( θ 6 ) R z ( θ 7 ) T e ( 0 , 0 , l 82 ) .
According to the kinematic of the HSR arm, the base yaw angle ( θ 2 ) can be calculated using the relative wrist position (x, y and z) as:
[ x   y   z   1 ] T = f T e ( 0 , 0 , l 82 ) [ 0   0   0   1 ] T
θ 2 = a t a n 2 ( y , x )
Analysing torso lift height ( l 3 ) and shoulder pitch angle ( θ 4 ) gives:
[ l 3 θ 4 ] = [ z l 52 2 x 2 y 2 a r c s i n ( x 2 + y 2 l 52 ) ]   or   [ l 3 θ 4 ] = [ z l 52 2 x 2 y 2 π a r c s i n ( x 2 + y 2 l 52 ) ] .
Investigating the joint angles of the arm ( θ 5 , θ 6 , θ 7 ) based on the matrix T R offers:
T R = T e ( 0 , 0 , l 52 ) R y ( θ 4 ) T e ( 0 , 0 , l 3 ) R z ( θ 2 ) f T e ( 0 , 0 , l 82 ) ,
[ θ 5 θ 6 θ 7 ] = [ a t a n 2 ( R 23 , R 13 ) a r c c o s ( R 33 ) a t a n 2 ( R 32 , R 31 ) ]
However, to allow the HSR to interact naturally with a human and to facilitate the dexterous transfer of objects promptly, hybrid inverse kinematics proposed by Yamamoto et al. [41] was implemented. It involves the inverse kinematics for the eight-DOF HSR including the robot base with three DOF and the arm with five DOF. The hybrid inverse kinematics ( f ) for the HSR can be formulated using the robot tip pose ( T e ) as in the following equation:
( θ 0 , θ 1 , θ 3 , θ 5 , θ 6 , θ 7 ) = f ( T e , θ 2 , θ 4 )
Given θ = ( θ 0 , θ 1 , θ 2 , θ 3 , θ 5 , θ 6 , θ 7 ) and the desired reference joint angles ( θ r e f ) of θ and then the evaluation function ( V ) can be identified as:
V ( θ 2 , θ 4 , T e , W , θ r e f ) = | | W ( θ r e f θ ) | |
The evaluation function ( V ) can be minimized using θ 2 and θ 4 and expressed as:
arg V m i n ( θ 2 , θ 4 , T e , W , θ r e f ) . θ 2 , θ 4

2.5. Coordinate Registration in the HRH System

This section proposes all coordinate registration for the HRH system. It consists of the robot base frame (robot reference frame) [R], the robot end-effector frame [A], object (held by the robot) frame [T], RGBD camera frame [C], human frame [H] and handover location frame [L]. All relative frames in the HRH system are drawn in Figure 4. It is to be noted that all the reference frames are in Cartesian coordinates. According to the human frame [H] can be located by a tracking control based on the head_pose_estimation package [42] as mentioned previously. A human head is identified based on a personalized template by the spherical kernel using a supervised learning algorithm, namely a discriminative random regression forests (DRRF) technique. The human nose tip vector is a crucial aspect that can describe the changes of the head pose neatly. Subsequently, the nose tip frame is appropriately used as the human reference frame [H]. Then, it can be noted that the handover location frame [L] is associated with the human (nose tip) frame [H].
The frame relationship between the object held by the robot and the human hand is the chief requirement implemented to successfully control the robot movements in the HRH tasks. The Transformation matrix has been investigated to identify the posture of the object [T] held by the HSR end-effector [A] relative to the robot reference frame [R]. It can be implied that the robot should manipulate the held object to the receiver naturally at the handover location (incorporating Equation (1)). The Transformation matrix of the handover location frame [L] relative to the robot base frame [R] can be determined based on (1) the [L] referenced by the [C] and (2) the [L] referenced via [R]. Hence, their relationship can be written as Equation (14).
T T R = T A R · T T A = T C R · T H C · T L H · T T L
where T j i denotes the coordinate transformation from the j frame relative to the i frame. The T T R can be solved using the robot forward kinematics equations. The T H C can be measured by the tracking system. The T C R can be adopted from the robot configuration and T L H can be calculated using Equation (1) conducted by the HHH experiments. Finally, the T T L can be computed using the following equation:
T T L = ( T L H ) 1 · ( T H C ) 1 · ( T C R ) 1 · T A R · T T A
The transformation matrix of the [L] frame relative to the [R] can be expressed by Equation (16).
T L R = T A R · T T A · ( T T L ) 1
The relationship is subsequently implemented on the real-time hybrid PID position and impedance control of the robot compliant motions in HRH.

2.6. Robotic Hybrid Position/Force Control Strategy for the HRH Tasks

Robot force control is a fundamental requirement in the achievement of the control of the robot’s real-time path in any physical HRI task. It has been developed in the past three decades, using for example force, torque and visual feedback to operate robots to suitably participate in unstructured environments. Raibert and Craig [43] introduced a new method for robot force control based on two control loops, consisting of combined position and force control systems, namely hybrid position/force control. One of the crucial advantages of using the hybrid control is that the position and force information is analysed synchronously and independently. These two outputs are combined in the final stage before being converted to drive the robot actuators using joint torque control [44].
In this research, hybrid PID position/impedance control was implemented. This is due to the fact that PID position control is the most widely used and reliable method for controlling a robot manipulator position. Additionally, a method for the automatic tuning of PID controllers in a closed loop can be estimated using a transfer function model. However, the PID controller may not suitable for force control because the derivative term ( K d ) is too sensitive to noise. This could induce a destabilizing impact on the robot force control system [45]. Interestingly, Rahman et al. [46] proposed the mathematical models of the human hand while interacting with a HHH task. The human applied force is formulated by the human arm impedance which is made up of mass, stiffness and damping factor, respectively. Consequently, to imitate the real-world human force dynamics, impedance control, which efficiently controls both the motion of the robot and its contact forces, was selected in the robotic force control loop.
Figure 5 illustrates the hybrid PID position/impedance control scheme, which was designed based on the study by Vukobratovic et al. [47]. It is made up of two control loops each of which has an individual information sensor system, i.e., (1) multi-axis force/torque sensor used to detect the force applied to the HSR robot end effector and (2) the rotary encoders used to measure the robot joint positions. X R and F R represent the references of the position and force control schemes, which can be generated using handover experimental results, as explained in Equations (1) and (2). The outcomes from the position ( X P ) and force control ( X F ) loops are fused together as a set of incremental displacements ( X u ), namely, the hybrid position/force control, as exhibited in Equation (17). The parameters X E and F E are the errors of the position in Cartesian coordinate and force control algorithms, respectively. The matrix S represents the compliance selection matrix used to specify the number of DOF in the robotic control system, where A and B represent the robotic position and force controllers, respectively.
X u = X P + X F = A [ ( S × X E ) ] + B [ ( ( 1 S ) × F e ) ]
The positions of the robot in joint space ( q u ) can be computed based on an inverse Jacobian matrix as expressed in the following equation.
q u = J ( q ) 1 X u
The position feedback of the robot in Cartesian space ( X ) is adopted the forward kinematic function based on the position feedback of the robot joint space detected by the encoders ( q s ) as formulated in Equation (19).
X = f ( q s )
According to the robot control design, a PID controller was implemented on the robot position control. An incremental discrete-time PID control algorithm with a sampling period ( τ ) and the discrete-time interval k was implemented. The robotic position control scheme is written as:
X P ( k ) = X P ( k 1 ) + ( S ) [ k p ( X E ( k ) X E ( k 1 ) ) + k i ( X E ( k ) ) + k d ( X E ( k ) 2 X E ( k 1 ) + X E ( k 2 ) ) ]
Additionally, the robot has to interact with a human in HRH, in which the muscles of the human arm can be mechanically represented in a mass-spring and damper system [46]. To facilitate the robotic impedance behaviour, the impedance control approach is therefore executed, which is not only used to track a motion trajectory alone but rather to regulate the mechanical impedance ( Z m ) of the robot. The impedance control can be exposed as:
F E = M d ( X ¨ F X ¨ ) + B d ( X ˙ F X ˙ ) + K d ( X F X )
The real-time trajectory of the robot end-effector can be controlled by acceleration as the following equation; however, the acceleration output incorporates a double integral function before being transmitted to the robot.
X ¨ F = X ¨ + M d 1 [ F E B d ( X ˙ X ˙ F ) K d ( X X F ) ]
where M d , B d and K d represent a designed inertia matrix, damping matrix and stiffness matrix, respectively, which incorporate with F E .

2.7. Dynamic Mechanical Model of the Physical Human-Robot Handover

This section summarized a mathematical dynamic model of the HRH system. Presumably, the overall interaction can be represented as sub-equivalent-lumped-mass systems as depicted in Figure 6. The HSR can be modelled by the rigid body model ( m R ) associated with effective viscous damping ( b R ) to ground and driven by force F R created by the hybrid control algorithm. The robot hand (gripper), which holds the rigid object mass m O , has the impedance parameters as m h , k h and b h , respectively. The force sensor attached to the hand wrist can be mechanically presented as a spring ( k s ) and dashpot ( b s ) system. The impedance parameter notation of the human hand comprises the hand mass ( m H * ), the viscous damping ( b H ) and stiffness ( k H ), respectively. In addition, the displacements of the masses ( m R , m h and m H ) are, respectively, defined as   x R , x h and x H , in which it can be assumed as: m H = m O + m H * . The state-space equations based modelling representing the overall HRH system can be formulated as:
d d t [ x R x ˙ R x h x ˙ h x H x ˙ H ] = [ 0 1 0 0 0 0 k s m R ( b R + b s ) m R k s m R b s m R 0 0 0 0 0 1 0 0 k s m h b s m h ( k h + k s ) m h ( b h + b s ) m h k h m h b h m h 0 0 0 0 0 1 0 0 k h m H b h m H ( k h + k H ) m H ( b h + b H ) m H ] [ x R x ˙ R x h x ˙ h x H x ˙ H ] + [ 0 0 0 0 0 0 1 m R 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ] [ F 0 0 0 0 0 ]   and   y = [ 1 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 1 0 ] [ x R x ˙ R x h x ˙ h x H x ˙ H ] + [ 0 ] F
After taking the Laplace transforms of the state space equations above, the transfer matrices are then given by:
G 1 ( s ) = x R ( S ) F R ( S ) = A D ,   G 2 ( s ) = x h ( S ) F R ( S ) = B D   ,   G 3 ( s ) = x H ( S ) F R ( S ) = C D
where
A = ( k h k s + k h k H + k s k H + b h k s S + b s k h S + b h k H S + b H k h S + b s k H S + b H k s S + b h b s S 2 + b h b H S 2 + b s b H S 2 + b h m h S 3 + b h m h S 3 + b h m H S 3 + b H m h S 3 + b s m H S 3 + k h m h S 2 + k h m H S 2 + k H m h S 2 + k s m H S 2 + m h m H S 4 ) B = ( ( k s + S b s ) ( k h + k H + b h S + b H S + m H S 2 ) ) C = ( ( k h + S b h ) ( k s + S b s ) ) D = ( k h k s k H + b h b R b s S 3 + b h b R b H S 3 + b h b s b H S 3 + b R b s b H S 3 + b h b R k s S 2 + b R b s k h S 2 + b h b R k H S 2 + b R b H k h S 2 + b h b s k H S 2 + b h b H k s S 2 + b s b H k h S 2 + b R b s k H S 2 + b R b H k s S 2 + b h b R m h S 4 + b h b s m h S 4 + b h b s m R S 4 + b h b R m H S 4 + b h b H m R S 4 + b R b H m h S 4 + b h b s m H w S 4 + b s b H m h S 4 + b R b s m H S 4 + b s b H m R S 4 + b R k h m h S 3 + b h k s m h S 3 + b s k h m h S 3 + b h k s m R S 3 + b s k h m R S 3 + b h k H m R S 3 + b R k h m H S 3 + b R k H m h S 3 + b w k g m r S 3 + b g k s m w S 3 + b s k g m w S 3 + b s k w m g S 3 + b w k s m g S 3 + b r k s m w S 3 + b s k H m R S 3 + b H k s m R S 3 + b h m h m R S 5 + b h m R m H S 5 + b R m h m H S 5 + b H m h m R S 5 + b s m h m H S 5 + b s m R m H S 5 + k h k s m h S 2 + k h k s m R S 2 + k h k H m R S 2 + k h k s m H S 2 + k s k H m h S 2 + k s k H m R S 2 + k h m h m R S 4 + k h m R m H S 4 + k H m h m R S 4 + k s m h m H S 4 + k s m R m H S 4 + m h m R m H S 6 + b R k h k s S + b R k h k H S + b h k s k H S + b s k h k H S + b H k h k s S + b R k s k H S

2.8. Safety in HHH

One of the principal challenges in the development of the HRH task is a safety issue since any failure might become very critical for a human co-worker. Several studies have investigated relative approaches to safety and reliability issues in HRI, i.e., human factors, risk assessment, hazard analysis and technologies for HRI safety, etc. Matthias et al. [48] presented an assessment of the associated risks for possible incidental contact events between a collaborative robot and a human worker based on the guidance published in ISO/TS 15066. The ISO/TS 15066 provides standards of safety and operation for the complex protection schemes required for robots. Many researchers [49,50,51] proposed conceptual designs to improve safety issues in HRI, such as applying appropriate emergency stops which can be activated as soon as any error occurs, or implementing a validation phase based on control software to facilitate an effective real-time control system etc.
In the robotic system, a safeguarded zone was introduced to conduct a safety strategy that can prevent unauthorised humans from entering the test area. The speed of the HSR movement allowed in the HRI tests was limited and the robot working area was also optimized to minimize the risk of an injury. A timeout, which indicates the period of time allowed for executing a specified task, was assigned for the serial and TCP/IP communication. Safety upper-limit force (flim) was defined. Based on the HHH study [32], the flim was recommended to initially set at 10 N indicating the amount of magnitude of maximum force is taken into account when the handler decides to release the object to be transferred naturally. If the exerted (interactive) force is greater than the limited force, the robot will be immediately terminated. Moreover, the stand-alone emergency stop buttons can be manually activated by a human operator when accidents are detected.

3. Results and Discussion

The HHH cooperation has provided a better understanding of what is required in the development of an appropriate set of human-like behaviour for the robot control strategy. This can facilitate the dextrous HRH tasks in a safe and effective way. In this research, hybrid PID position and impedance control has been developed and implemented to improve the stability of the robot position and force control. Nevertheless, the key challenge is to suitably design the optimized PID and impedance control algorithms of the HSR, which interacts with the complicated dynamic nature of the human in the object handovers. Subsequently, this section details the evaluation of the performance of the robot control system to facilitate the robot to transfer the object to the human receiver in a safe, timely and natural manner.

3.1. Optimization of the Robotic PID Position Control

To successfully adopt an appropriate PID controller, the control gains ( k p , k i and   k d ) can be estimated using the Ziegler–Nichols tuning method incorporated with the robot transfer function of the proposed dynamic model in Section 2.7. However, it is complicated to estimate each model parameter in the dynamic equations and then the MATLAB system identification was consequently applied. One of the effective parametric models identifying system transfer functions which are recommended by Ruslan et al. [52] is the Autoregressive Moving Average eXogenous (ARMAX). The ARMAX is one of the most robust techniques and is normally used to study complex dynamical systems in time-series analysis.
The Z–transform is reasonable for analysis of practical model identification, which presents the relationship between the eigenvalues and the poles of the ARMAX-based estimated model. The model [53] can be formulated as follows:
y ( t ) + a 1 y ( t 1 ) + + a n a y ( t n a ) = b 1 u ( t 1 ) + + b n b u ( t n b ) + e ( t ) + c 1 e ( t 1 ) + + c n c e ( t n c )    
where the observed input and output are represented as u ( k ) and y ( k ) . The noise signal moderated into the system is e ( k ) .
The Matlab Identification Toolbox was implemented to appropriately estimate the model unknown ARMAX parameters by selecting a set of a polynomial of n a , n b and n c to minimize the forecasting errors and to obtain an effective model. A set of preliminary experiments involving a robot position control system has been conducted. The time-series information required in the system identification is made up of (1) robot position target, namely the ARMAX input and (2) the measured robot position, namely the ARMAX output. Presumably, the range of the robot forward translation movement is approximately 1 meter. Additionally, to present the system-parameter estimation technique under consideration adequately, the model validation finally verifies a proposed identified model. The discrete-time ARMAX model was identified and its results are given in Equation (26). The set of minimized polynomial functions is made up of n a : 2 , n b : 2 and n c : 2 , respectively.
A ( z ) = 1 + a 1 z 1 + + a n a z n a = 1 1.993   z 1 0.9934 z 2 B ( z ) = b 0 + b 1 z 1 + + b n b z n b = 0.0001068 z 1 9.555 e 05 z 2 C ( z ) = 1 + c 1 z 1 + + a n a z n c = 1 0.9241 z 1 0.02802 z 2
It is to be noted that the MATLAB discrete-time to continuous-time model conversion was then applied to determine the robotic transfer function into a continuous-time transfer function ( H S R T F ) as formulated in Equation (27).
H S R T F = 1.036 e 05 s 2 + 0.002733 s + 0.03113 s 2 + 1.666 s + 0.7003
Model validation was carried out in the final stage of the model identification process to verify the simulated model. Several model validation techniques were then employed and the results express as follows: (1) percentage of best fit ( R 2 ) was approximately 100%, (2) mean squared error (MSE) was 1.069 × 10−10 and finally, (3) final prediction error (FPE) was 1.077 × 10−10, respectively. Using the predicted model indicates that the actual and estimated data have high similarity in terms of the system responses. Then, it is considered acceptable for the HSR representation model.
After executing Ziegler Nicholas PID tuning in Matlab by providing the numerator and denominator coefficients of the HSR mathematical model in the Laplace domain, it gives gain parameters the critical gain k c and ultimate period τ c . Consequently, it can compute the gain values of k p , k i and   k d . Nevertheless, the tuning technique still needs an operator’s experience for fine-tuning until the system specification is achieved. This offers optimized PID gains as k p , k i and   k d of 0.24, 0.13 and 0.02, respectively. To evaluate the closed-loop stability of the robot system, Figure 7 illustrates the test results and frequency response analysis, whereas the robot moved forwards to the 1 m target. It can be summarized that a set of the optimized PID gains demonstrates significant satisfaction with the overall control performance in the robotic control system and this is subsequently used in the robot hybrid control approach.

3.2. Evaluation of the Robotic Impedance Control Based on the HRH

This section proposes how to achieve the appropriate impedance force control based on the performance evaluations of the robotic dynamic response in the human-to-robot handovers. According to the test procedure, a set of 20 participants has undertaken three repetition sets of each handover test under the required variable conditions. They are defined as a receiver agent and have to grasp the object using one hand and twisting the object is not allowed. The object was fabricated as a bottle-shaped object with 60 mm diameter, 270 mm length and a total mass of 1.25 N. The HRH experimental apparatus is shown in Figure 8. The HSR is required to grasp an object and move facing to the object handover location, while the human performs standstill in comfortable positions on opposite sides of the robot. Once the object is manipulated to the transfer location the human is then allowed to grab the object and start naturally pulling the object before taking the responsibility for the object finally. In the meantime, interactive force ( F i n t ) profiles against time ( t ) presenting how the robot giver regulates the bilateral force before releasing the object to be transferred to the receiver was measured in real-time.
The circumstances affecting the robot dynamic behaviour compose of spring stiffness ( K d ) and damping factor ( B d ) , whereas M d was strictly specified as a constant parameter of 0.25 Kg. Initially, a set of preliminary tests was undertaken to establish the relationship between the interactive force and handover time under various spring stiffness ( K d ) and damping factor ( B d ) values. The goals of the experiments are to understand how the influential factors affect the interactive forces in the HRH system and to determine the ranges of B d and K d used in the substantive HRH. The test outcomes were demonstrated in Table 1. According to human active comfort, the impedance control system should have lower stiffness and damping coefficient values. Conflictingly, in terms of active safety, it should have lower stiffness but a higher damping coefficient. Based on the recommendations of the preliminary study, as the humans generally felt comfortable in the natural physical HRH, B d should be set as 50 and 75 ( NmS / rad ) and the range of K d should be varied from 0 to 400 ( Nm / rad ) , respectively.
The substantive HRH experiments were successfully carried out by the 20 selected subjects. A comparison of the average interactive force and handover time under the several conditions based on the HRH tasks is given in Table 2. After careful observation with regard to the HRH test results, it was complicated to select the set of optimized impedance parameters as its nature necessitates human judgments. After asking the participants, two desirable choices of the impedance parameters were selected based on the recommendations, which consist of Set 1:   B d ( 50 ) ,   K d   ( 200 ) and M d ( 0.25 ) and Set 2: B d ( 75 ) , K d ( 50 ) and M d ( 0.25 ) , as highlighted in Table 2. A questionnaire technique was subsequently employed to gather information from the human participants. Rating scale questions were introduced and specified with the five-point rating scale from 1 (very dissatisfied) to 5 (very satisfied). The two questions were used to ask the participants after participating in the HHH and HRH based on both impedance parameter sets as follows:
(1)
How do you compare the qualitative performance of the HHH to that of the HRH using the parameter Set 1?
(2)
How do you compare the qualitative performance of the HHH to that of the HRH using the parameter Set 2?
Figure 9 depicts the responses of the participants comparing the overall stability of the robot–human handovers using the different sets of the impedance parameters. It can be observed that 11 participants (55 %) and three participants (15%), respectively, were significantly satisfied and very satisfied with the overall stability of the robot handover system using the first parameter set. The second set shows 12 (60%) and 6 (30%) subjects were satisfied and very satisfied. There is only one person (5%) very dissatisfied with the parameter set 1, while another leads participants to experience the robot handover without any dissatisfaction. To compare the mean measurements of the two set undertaken from the same sample group, the paired samples t-test was statistically utilized. The following hypotheses H0 and H1 were tested as:
H 0 : μ S e t 2 = μ S e t 1 , which means the median difference between pairs of observations is zero so that there is no significant difference in the population distributions.
H 0 : μ S e t 2 > μ S e t 1 , which means the median difference between pairs of observations is not equal to zero and the population rating from set 2 is greater than that of set 1.
The results of the statistical analysis based on the paired t-test present that ratings of the robot performance based on the parameter set 1 and 2 were 3.80 and 4.20, respectively, with corresponding standard deviations of 0.768 and 0.616, as summarized in Table 3. This represents the test subjects were more appreciative of the performance of the robot behavioural control using the second parameter set rather than the first set. The value of the paired-sample test was −3.559 (2-tails significance = 0.002). It can be described that the hypothesis H0 has to be statistically rejected and the alternative hypothesis H1 accepted. This means that there is a significant difference in the population distributions from the participants. Additionally, the population rating from set 2 is greater than that of set 1, in which the participants were more comfortable with the robot’s stability using the impedance parameters made up of K d   ( 50 ) , B d ( 75 ) and M d ( 0.25 ) , more than those of the first set.
Finally, the results of the robotic dynamic response based on the hybrid PID position and impedance control in the robot-to-human handovers were carried out and then compared with the outcomes of the HHH. Figure 10 shows an example of a comparison between the interactive force profiles against time from the HHH and HRH tests. It can be concluded that the quantitative measurement of the performance of robot behavioural control can be considered acceptable for object handover interaction with a human receiver. It provided effective performance during the natural cooperative tasks, where the robot was able to successfully pass the object to the human in a safe, reliable and timely manner. However, after careful analysis with regard to the HRH results, the robot has to perform a slightly longer handover period than that of the HHI, even though the maximum forces from both cases are similar. This is because the robot control algorithm was initially designed to ensure its safe and natural operational characteristics specifically while physically releasing the object to the receiver. Then, this might result longer object handover process.
Consequently, it can be concluded that understanding kinematically and dynamically how two humans physically collaborate while naturally performing object handover tasks offers the effective performance and reliability of the robot-to-human handover procedure and acceptable HRI implementation. This was in agreement with the parallel test outcomes, demonstrating significant satisfaction with the overall performance of the HRH system, as measured by an average rating of 4.20 on a five-point scale.

4. Conclusions

This paper contributes to the implementation of a human-like behavioural control strategy for seamless HRH. The robotic conceptual framework was established by understanding the principle of human haptic interaction when two humans work together in a joint effort to complete an object handover task. The performance of the robot–human handover system has been evaluated based on the interactive fore profiles, handover time and how comfortable the participants felt in participating in the HRH tasks. The results provide effective performance during the HRH, where the HSR robot was able to successfully pass the object to the human effectively. The safety systems proposed are working successfully and thus avoiding the likelihood of unsafe HRH actions being taken. Moreover, the feedback responses from the human subjects participating in the HRI also agreed with the parallel test results that gave more satisfaction with a higher average rating scale.
Therefore, it can be concluded that the robot based on the developed behavioural control algorithm is capable of tracking the object transfer location, manipulating the object and handling it to the receiver in a safe, reliable and dexterous manner. This developed robotic system can enhance the accuracy of positioning and force regulating abilities in the HRH system and also increase the smoothness of physical HRI. The outcomes of this research can successfully play a beneficial role in the daily lives of people in future.

Author Contributions

Conceptualization, P.N.; methodology, P.N. and T.S.; software, T.S.; validation, P.N. and T.S.; formal analysis, P.N. and T.S.; investigation, P.N. and T.S.; resources, P.N.; data curation, P.N. and T.S.; writing—original draft preparation, P.N.; writing—review and editing, P.N.; visualization, P.N.; supervision, P.N.; project administration, P.N.; funding acquisition, P.N. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Goodrich, M.; Schultz, A. Human-Robot Interaction: A Survey. Found. Trends Hum. Comput. Interact. 2007, 1, 203–275. [Google Scholar] [CrossRef]
  2. Shafkat Tanjim, M.S.; Rafi, S.A.; Oishi, A.N.; Barua, S.; Dey, H.C.; Babu, M.R. Image Processing Intelligence Analysis for Robo-Res 1.0: A Part of Humanoid Rescue-Robot. In Proceedings of the 2020 IEEE Region 10 Symposium (TENSYMP), Dhaka, Bangladesh, 5–7 June 2020; pp. 1229–1232. [Google Scholar]
  3. Zhao, J.; Gao, J.; Zhao, F.; Liu, Y. A Search-and-Rescue Robot System for Remotely Sensing the Underground Coal Mine Environment. Sensors 2017, 17, 2426. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Cardona, G.A.; Calderon, J.M. Robot Swarm Navigation and Victim Detection Using Rendezvous Consensus in Search and Rescue Operations. Appl. Sci. 2019, 9, 1702. [Google Scholar] [CrossRef] [Green Version]
  5. e Silva, L.C.; Daher, S.F.D.; Santiago, K.T.M.; Costa, A.P.C.S. Selection of an Integrated Security Area for locating a State Military Police Station based on MCDM/A method. In Proceedings of the 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), Bari, Italy, 6–9 October 2019; pp. 1530–1534. [Google Scholar]
  6. Boisboissel, G. Is it sensible to grant autonomous decision-making to military robots of the future? In Proceedings of the 2017 International Conference on Military Technologies (ICMT), Brno, Czech Republic, 31 May–2 June 2017; pp. 738–742. [Google Scholar]
  7. Rosli, R.; Abdullah, M.; Siregar, N.C.; Hamid, N.S.A.; Abdullah, S.; Beng, G.K.; Halim, L.; Daud, N.M.; Bahari, S.A.; Majid, R.A.; et al. Exploring Space Science through the UKM-SIDn Outreach Program. In Proceedings of the 2019 International Conference on Space Science and Communication (IconSpace), Johor Bahru, Malaysia, 28–30 July 2019; pp. 253–256. [Google Scholar]
  8. Xing, Z.; Zhao, Y.; Zhu, S. Path Planning Method Design and Dynamic Model Simplification of Free-Flying Space Robot. In Proceedings of the 2020 15th IEEE Conference on Industrial Electronics and Applications (ICIEA), Kristiansand, Norway, 9–13 November 2020; pp. 1501–1505. [Google Scholar]
  9. Islam, M.R.; Chowdhury, F.H.; Rezwan, S.; Ishaque, M.J.; Akanda, J.U.; Tuhel, A.S.; Riddhe, B.B. Novel design and performance analysis of a Mars exploration robot: Mars rover mongol pothik. In Proceedings of the 2017 Third International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN), Kolkata, India, 3–5 November 2017; pp. 132–136. [Google Scholar]
  10. Javaid, M.; Estivill-Castro, V. Explanations from a Robotic Partner Build Trust on the Robot’s Decisions for Collaborative Human-Humanoid Interaction. Robotics 2021, 10, 51. [Google Scholar] [CrossRef]
  11. Katsanis, I.A.; Moulianitis, V.C. An Architecture for Safe Child–Robot Interactions in Autism Interventions. Robotics 2021, 10, 20. [Google Scholar] [CrossRef]
  12. Mi, J.; Takahashi, Y. Whole-Body Joint Angle Estimation for Real-Time Humanoid Robot Imitation Based on Gaussian Process Dynamical Model and Particle Filter. Appl. Sci. 2020, 10, 5. [Google Scholar] [CrossRef] [Green Version]
  13. Jung, S.E.; Won, E.-S. Systematic Review of Research Trends in Robotics Education for Young Children. Sustainability 2018, 10, 905. [Google Scholar] [CrossRef] [Green Version]
  14. Aa Diyas, Y.; Brakk, D.; Aimambetov, Y.; Sandygulova, A. Evaluating peer versus teacher robot within educational scenario of programming learning. In Proceedings of the 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Christchurch, New Zealand, 7–10 March 2016; pp. 425–426. [Google Scholar]
  15. Stuhlenmiller, F.; Weyand, S.; Jungblut, J.; Schebek, L.; Clever, D.; Rinderknecht, S. Impact of Cycle Time and Payload of an Industrial Robot on Resource Efficiency. Robotics 2021, 10, 33. [Google Scholar] [CrossRef]
  16. Tao, Y.; Chen, C.; Wang, T.; Chen, Y.; Xiong, H.; Ren, F.; Zou, Y. A Re-Entry Path Planning Method for Service Robots Based on Dynamic Inver-Over Evolutionary Algorithm. Appl. Sci. 2020, 10, 305. [Google Scholar] [CrossRef] [Green Version]
  17. Kupcsik, A.; Hsu, D.; Lee, W.S. Learning Dynamic Robot-to-Human Object Handover from Human Feedback. In Robotics Research; Bicchi, A., Burgard, W., Eds.; Springer Proceedings in Advanced Robotics; Springer: Berlin/Heidelberg, Germany, 2018; Volume 2, pp. 161–176. [Google Scholar]
  18. Neranon, P. Implicit force control approach for Safe physical Robot-to-Human object handover. Indones. J. Electr. Eng. Comput. Sci. 2020, 17, 615–628. [Google Scholar] [CrossRef] [Green Version]
  19. He, W.; Sidobre, D. Improving human-robot object exchange by online force classification. J. Hum. Robot Interact. 2015, 4, 75–94. [Google Scholar] [CrossRef]
  20. Strabala, K.; Lee, M.K.; Dragan, A.; Forlizzi, J.; Srinivasa, S.S.; Cakmak, M.; Micelli, V. Toward Seamless Human–Robot Handovers. J. Hum. Robot Interact. 2013, 2, 112–132. [Google Scholar] [CrossRef] [Green Version]
  21. Emmelmann, M. Influence of velocity on the handover delay associated with a radio-signal-measurement-based handover decision. In Proceedings of the VTC-2005-Fall. 2005 IEEE 62nd Vehicular Technology Conference, Dallas, TX, USA, 28–30 September 2005; pp. 2282–2286. [Google Scholar]
  22. Neranon, P. Human-to-Robot Object Handover using a Behavioural Position-based Force Control Approach. In Proceedings of the First International Symposium on Instrumentation, Control, Artificial Intelligence, and Robotics (ICA-SYMP), Bangkok, Thailand, 16–18 January 2019; pp. 5–8. [Google Scholar] [CrossRef]
  23. Huber, M.; Radrich, H.; Wendt, C.; Rickert, M.; Knoll, A.; Brandt, T. Evaluation of a novel biologically inspired trajectory generator in human-robot interaction. In Proceedings of the RO-MAN 2009—The 18th IEEE International Symposium on Robot and Human Interactive Communication, Toyama, Japan, 27 September–2 October 2009; pp. 639–644. [Google Scholar]
  24. Kajikawa, S.; Okino, T.; Ohba, K.; Inooka, H. Motion planning for hand-over between human and robot. In Proceedings of the 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems, Pittsburgh, PA, USA, 5–9 August 1995; pp. 193–199. [Google Scholar]
  25. Chan, W.P.; Parker, C.A.; Van der Loos, H.F.; Croft, E.A. Grip forces and load forces in handovers: Implications for designing human-robot handover controllers. In Proceedings of the 7th Annual ACM/IEEE International Conference on Human-Robot Interaction, Boston, MA, USA, 2–5 March 2012; pp. 9–16. [Google Scholar]
  26. Baier, T.; Zhang, J. Reusability-based semantics for grasp evaluation in context of service robotics. Robotics and Biomimetics. In Proceedings of the 2006 IEEE International Conference on Robotics and Biomimetics (ROBIO’06), Kunming, China, 17–20 December 2006; pp. 703–708. [Google Scholar]
  27. Nemlekar, H.; Dutia, D.; Li, Z. Object Transfer Point Estimation for Fluent Human-Robot Handovers. In Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada, 20–24 May 2019; pp. 2627–2633. [Google Scholar] [CrossRef]
  28. Lemic, F.; Behboodi, A.; Famaey, J.; Mathar, R. Location-Based Discovery and Vertical Handover in Heterogeneous Low-Power Wide-Area Networks. IEEE Internet Things J. 2019, 6, 10150–10165. [Google Scholar] [CrossRef]
  29. Cakmak, M.; Srinivasa, S.; Lee, M.K.; Forlizzi, J.; Kiesler, S. Human preferences for robot-human hand-over configulations. In Proceedings of the 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), San Francisco, CA, USA, 25–30 September 2011; pp. 1986–1993. [Google Scholar]
  30. Chan, W.P.; Pan, M.K.; Croft, E.A.; Inaba, M. Characterization of handover orientations used by humans for efficient robot to human handovers. In Proceedings of the 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany, 28 September–2 October 2015; pp. 1–6. [Google Scholar]
  31. Aleotti, J.; Micelli, V.; Caselli, S. An affordance sensitive system for robot to human object handover. Int. J. Soc. Robot. 2014, 6, 653–666. [Google Scholar] [CrossRef]
  32. Sutiphotinun, T.; Neranon, P.; Vessakosol, P.; Romyen, A.; Hiransoog, C.; Sookgaew, J. A Human-Inspired Control Strategy: A Framework for Seamless Human-Robot Handovers. J. Mech. Eng. Res. Dev. 2020, 43, 235–245. [Google Scholar]
  33. Kato, S.; Yamanobe, N.; Venture, G.; Yoshida, E.; Ganesh, G. The where of handovers by humans: Effect of partner characteristics, distance and visual feedback. PLoS ONE 2019, 14, e0217129. [Google Scholar] [CrossRef]
  34. Chien, M.H.; Maya, C.; Bilge, M. Adaptive Coordination Strategies for Human-Robot Handovers. In Proceedings of the Robotics: Science and Systems, Rome, Italy, 13–17 July 2015; pp. 1–10. [Google Scholar]
  35. Sisbot, E.A.; Alami, R. A human-aware manipulation planner. IEEE Trans. Robot. 2012, 28, 1045–1057. [Google Scholar] [CrossRef]
  36. Glasauer, S.; Huber, M.; Basili, P.; Knoll, A.; Brandt, T. Interacting in time and space: Investigating human–human and human–robot joint action. In Proceedings of the 19th International Symposium in Robot and Human Interactive Communication, Viareggio, Italy, 13–15 September 2010; pp. 252–257. [Google Scholar] [CrossRef]
  37. Kim, J.; Park, J.; Hwang, Y.K.; Lee, M. Advanced Grasp Planning for Handover Operation Between Human and Robot: Three Handover Methods in Esteem Etiquettes Using Dual Arms and Hands of Home-Service Robot. In Proceedings of the 2nd International Conference on Autonomous Robots and Agents, Palmerston North, New Zealand, 12–14 December 2004; pp. 34–39. [Google Scholar]
  38. Huber, M.; Rickert, M.; Knoll, A.; Brandt, T.; Glasauer, S. Human-robot interaction in handing-over tasks. Robot and Human Interactive Communication, 2008. RO-MAN 2008. In Proceedings of the 17th IEEE International Symposium, Munich, Germany, 1–3 August 2008; pp. 107–112. [Google Scholar]
  39. Jae-Bong, Y.; Taewoong, K.; Dongwoon, S.; Seung-Joon, Y. Unified Software Platform for Intelligent Home Service Robots. Appl. Sci. 2020, 10, 5874. [Google Scholar] [CrossRef]
  40. Denavit, J.; Hartenberg, R.S. A kinematic notation for lower-pair mechanisms based on matrices. J. Appl. Mech. 1955, 22, 215–221. [Google Scholar]
  41. Yamamoto, T.; Terada, K.; Ochiai, A. Development of Human Support Robot as the research platform of a domestic mobile manipulator. Robomech. J. 2019, 6. [Google Scholar] [CrossRef]
  42. Jaroonsorn, P.; Neranon, P.; Smithmaitrie, P.; Dechwayukul, C. Robot-assisted transcranial magnetic stimulation using hybrid position/force control. Adv. Robot. 2020, 34, 1559–1570. [Google Scholar] [CrossRef]
  43. Raibert, M.H.; Craig, J.J. Hybrid Position/Force Control of Manipulators. J. Dyn. Syst. Meas. Control 1981, 103, 126–133. [Google Scholar] [CrossRef]
  44. Volpe, R.; Khosla, P. A theoretical and experimental investigation of explicit force control strategies for manipulators. IEEE Trans. Autom. Control 1993, 38, 1634–1650. [Google Scholar] [CrossRef]
  45. Neranon, P.; Bicker, R. Force/position control of a robot manipulator for human-robot interaction. Therm. Sci. Int. Sci. J. 2016, 20, 537–548. [Google Scholar] [CrossRef] [Green Version]
  46. Rahman, M.M.; Ikeura, R.; Mizutani, K. Investigation of the impedance characteristic of human arm for development of robots to cooperate with humans’. JSME Int. J. Ser. C 2002, 45, 510–518. [Google Scholar] [CrossRef] [Green Version]
  47. Vukobratovic, M.; Surdilovic, D.; Ekalo, Y. Dynamics and Robust Control of Robot-environment Interaction. In New Frontiers in Robotics; World Scientific Publishing Co. Pte. Ltd.: Singapore, 2008; Volume 2. [Google Scholar]
  48. Matthias, B.; Reisinger, T. Example Application of ISO/TS 15066 to a Collaborative Assembly Scenario. In Proceedings of the 47th International Symposium on Robotics: ISR 2016, Munich, Germany, 21–22 June 2016; pp. 1–5. [Google Scholar]
  49. Vasic, M.; Billard, A. Safety Issues in Human-Robot Interactions. In Proceedings of the 2013 IEEE International Conference on Robotics and Automation, Karlsruhe, Germany, 6–10 May 2013; pp. 197–204. [Google Scholar] [CrossRef] [Green Version]
  50. Duchemin, G.; Poignet, P.; Dombre, E.; Peirrot, F. Medically safe and sound [human-friendly robot dependability]. IEEE Robot. Autom. Mag. 2004, 11, 46–55. [Google Scholar] [CrossRef]
  51. Kulic, D.; Croft, E.A. Real-time safety for human–robot interaction. Robot. Auton. Syst. 2006, 54, 1–12. [Google Scholar] [CrossRef]
  52. Ruslan, F.A.; Haron, K.A.; Samad, M.; Adnan, R. Multiple Input Single Output (MISO) ARX and ARMAX model of flood prediction system: Case study Pahang. In Proceedings of the 2017 IEEE 13th International Colloquium on Signal Processing & Its Applications: CSPA, Penang, Malaysia, 10–12 March 2017; pp. 179–184. [Google Scholar] [CrossRef]
  53. Rabbani, F. Model Identification and Validation for a Heating System using MATLAB System Identification Toolbox. In Proceedings of the 1st International Conference on Sensing for Industry, Control, Communications, & Security Technologies (ICSICCST 2013), Karachi, Pakistan, 24–26 June 2013. [Google Scholar]
Figure 1. (a) The hardware equipment of the HRS and (b) HRS software architecture (connecting to an external PC).
Figure 1. (a) The hardware equipment of the HRS and (b) HRS software architecture (connecting to an external PC).
Applsci 11 04437 g001
Figure 2. Robot handover framework based on the human–human handover.
Figure 2. Robot handover framework based on the human–human handover.
Applsci 11 04437 g002
Figure 3. (a) The dual-wheel caster-drive robot base and (b) the robot join configuration.
Figure 3. (a) The dual-wheel caster-drive robot base and (b) the robot join configuration.
Applsci 11 04437 g003
Figure 4. Reference frames of the HRH system.
Figure 4. Reference frames of the HRH system.
Applsci 11 04437 g004
Figure 5. Hybrid PID position/impedance force control designed for the HSR in the HRH tasks.
Figure 5. Hybrid PID position/impedance force control designed for the HSR in the HRH tasks.
Applsci 11 04437 g005
Figure 6. Mechanical schematic of the HRH based on a second-order-lumped-mass model.
Figure 6. Mechanical schematic of the HRH based on a second-order-lumped-mass model.
Applsci 11 04437 g006
Figure 7. (a) Robot displacement profile in the HRH test and (b) Bode magnitude and phase plot.
Figure 7. (a) Robot displacement profile in the HRH test and (b) Bode magnitude and phase plot.
Applsci 11 04437 g007
Figure 8. Experimental setup of the robot-to-human object handover system.
Figure 8. Experimental setup of the robot-to-human object handover system.
Applsci 11 04437 g008
Figure 9. Survey responses for the human–robot handover tasks.
Figure 9. Survey responses for the human–robot handover tasks.
Applsci 11 04437 g009
Figure 10. Interactive force profiles against the time of (a) the HHH test and (b) the HRH test.
Figure 10. Interactive force profiles against the time of (a) the HHH test and (b) the HRH test.
Applsci 11 04437 g010
Table 1. Comparisons of the average interactive force ( F i n t ) and time ( t ) parameters, while individually varying the damping factor ( B d ) and spring stiffness ( K d ), respectively.
Table 1. Comparisons of the average interactive force ( F i n t ) and time ( t ) parameters, while individually varying the damping factor ( B d ) and spring stiffness ( K d ), respectively.
Varied   Damping   Factor   ( B d ) Varied   Spring   Stiffness   ( K d )
B d   ( NmS / rad ) K d   ( Nm / rad ) F i n t   ( N ) t (s) B d   ( NmS / rad ) K d   ( Nm / rad ) F i n t   ( N ) t (s)
250 (N/A)1.192.140 (N/A)500.973.03
500 (N/A)1.162.220 (N/A)1001.002.99
750 (N/A)1.122.320 (N/A)1501.042.92
1000 (N/A)1.092.410 (N/A)2001.072.90
1250 (N/A)1.052.490 (N/A)3001.162.84
1500 (N/A)1.002.610 (N/A)4001.202.80
Table 2. Comparisons of the average interactive force ( F i n t ) and time ( t ) parameters, while varying both damping factor ( B d ) and spring stiffness ( K d ).
Table 2. Comparisons of the average interactive force ( F i n t ) and time ( t ) parameters, while varying both damping factor ( B d ) and spring stiffness ( K d ).
Varied   Damping   Factor   ( B d ) Varied   Spring   Stiffness   ( K d )
B d   ( NmS / rad ) K d   ( Nm / rad ) F i n t   ( N ) t (s) B d   ( NmS / rad ) K d   ( Nm / rad ) F i n t   ( N ) t (s)
5000.961.857501.211.62
50501.242.0275501.311.86
501001.191.73751001.112.06
502001.311.36752001.322.14
503001.251.51753001.411.93
504001.111.42754001.301.37
Table 3. T-test results of the comparison between the parameter set 1 and 2.
Table 3. T-test results of the comparison between the parameter set 1 and 2.
Paired Samples Statistics
MeanNSDSD Error Mean
Pair 1Impedence13.80200.7680.172
Impedence24.20200.6160.138
Paired Samples Correlations
NCorrelationSig.
Pair 1Impedence1 & Impedence2200.7570.000
Paired Samples Test
Paired DifferencestdfSig.
(2-tailed)
MeanSDSD Error Mean95% Confidence of the Difference
LowerUpper
Pair 1Impedence1 & Impedence2−0.4000.5030.112−0.635−0.165−3.559190.002
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Neranon, P.; Sutiphotinun, T. A Human-Inspired Control Strategy for Improving Seamless Robot-To-Human Handovers. Appl. Sci. 2021, 11, 4437. https://doi.org/10.3390/app11104437

AMA Style

Neranon P, Sutiphotinun T. A Human-Inspired Control Strategy for Improving Seamless Robot-To-Human Handovers. Applied Sciences. 2021; 11(10):4437. https://doi.org/10.3390/app11104437

Chicago/Turabian Style

Neranon, Paramin, and Tanapong Sutiphotinun. 2021. "A Human-Inspired Control Strategy for Improving Seamless Robot-To-Human Handovers" Applied Sciences 11, no. 10: 4437. https://doi.org/10.3390/app11104437

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop