Next Article in Journal
Development, Characterization, and Evaluation as Food Active Packaging of Low-Density-Polyethylene-Based Films Incorporated with Rich in Thymol Halloysite Nanohybrid for Fresh “Scaloppini” Type Pork Meat Fillets Preservation
Next Article in Special Issue
Molecular Simulations of Low-Shrinkage Dental Resins Containing Methacryl-Based Polyhedral Oligomeric Silsesquioxane (POSS)
Previous Article in Journal
Fiber Reinforced Polymer Debonding Failure Identification Using Smart Materials in Strengthened T-Shaped Reinforced Concrete Beams
Previous Article in Special Issue
Magnetic Hydrogel Composite for Wastewater Treatment
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Designing Bioinspired Composite Structures via Genetic Algorithm and Conditional Variational Autoencoder

1
Department of Mechanical Engineering, National Taiwan University, Taipei 10617, Taiwan
2
Department of Mechanical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA
3
Graduate School of Advanced Technology, National Taiwan University, Taipei 10617, Taiwan
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Polymers 2023, 15(2), 281; https://doi.org/10.3390/polym15020281
Submission received: 16 December 2022 / Revised: 30 December 2022 / Accepted: 3 January 2023 / Published: 5 January 2023
(This article belongs to the Special Issue Smart and Functional Polymer Composites)

Abstract

:
Designing composite materials with tailored stiffness and toughness is challenging due to the massive number of possible material and geometry combinations. Although various studies have applied machine learning techniques and optimization methods to tackle this problem, we still lack a complete understanding of the material effects at different positions and a systematic experimental procedure to validate the results. Here we study a two-dimensional (2D) binary composite system with an edge crack and grid-like structure using a Genetic Algorithm (GA) and Conditional Variational Autoencoder (CVAE), which can design a composite with desired stiffness and toughness. The fitness of each design is evaluated using the negative mean square error of their predicted stiffness and toughness and the target values. We use finite element simulations to generate a machine-learning dataset and perform tensile tests on 3D-printed specimens to validate our results. We show that adding soft material behind the crack tip, instead of ahead of the tip, tremendously increases the overall toughness of the composite. We also show that while GA generates composite designs with slightly better accuracy (both methods perform well, with errors below 20%), CVAE takes considerably less time (~1/7500) to generate designs. Our findings may provide insights into the effect of adding soft material at different locations of a composite system and may also provide guidelines for conducting experiments and Explainable Artificial Intelligence (XAI) to validate the results.

Graphical Abstract

1. Introduction

Animals and plants have evolved load-bearing and protective structures with different mechanical properties to maximize their survival. For example, nacre of mollusk shell is very stiff, strong, and tough [1]. Hard plant shells, such as walnut and pistachio, also exhibit high stiffness, strength, and toughness, albeit via different mechanisms from nacre [2]. Bird eggshells have high stiffness but low toughness, whereas some reptile eggshells are tough but flexible [3,4,5]. Tree trunks or woods have orthotropic material properties that are much stiffer and stronger in the longitudinal direction [6,7]. Those diverse mechanical properties primarily originate through combinations of stiff minerals and soft organic proteins self-assembled in specific multiscale hierarchical architecture from molecular, nano-, micro-, meso-, to macroscales [8]. Inspired by those natural materials, artificial composite structures, mimicking an organism’s compositions and microstructures, have attracted much attention in diverse areas over the past decades [9,10,11,12,13].
Composite structures have been widely used in engineering applications because distinctive mechanical properties and versatile functionalities can be achieved by tuning the composition and arrangement of just two or more base materials [14]. For example, Canale et al. presented a method to optimize the stacking sequence of a composite fan blade [15]; Herencia et al. presented a method to optimize a composite wing [16]. However, conventional methods for manufacturing composites have been limited to layup processes that create laminate composites by stacking layers of plies and resins [17,18]. Due to the tremendous advance of 3D printing technology, it is now possible to manufacture composites with more complex structures and higher design flexibility [19]. For instance, several research groups created bioinspired composites with complex architectures similar to nacre [20], diatom [21], and bone [13], among others.
Because of the ample design space opened up by 3D printing, how to design the structures and choose the materials to meet the mechanical requirements efficiently and effectively becomes a new issue. Conventional optimization methods such as genetic algorithms (GAs) [22,23,24], greedy optimization [25], and many others have been used for topology optimization. GAs are search-based algorithms based on Darwin’s concepts of natural selection in biological evolution [26] and have been successfully applied for global search and parameter optimization in a wide range of engineering and scientific fields [27,28,29]. In GAs, better designs (“offspring”) are evolved over generations through repetitive “selection, crossover, and mutation”—the undirected mechanism of natural selection.
However, when it comes to a system with a massive number of design parameters, these conventional techniques are often too time-consuming, not to mention the brute-force methods. For instance, there are around 2.08 × 10170 legal positions in the game of Go, which has a 19 × 19 grid size with three possibilities at each point [30]. For such massive systems, machine learning (ML) appears to be a suitable solution and has been proposed in the literature, the well-known one being AlphaGo by Alphabet Inc.’s Google DeepMind [31]. ML can build up a hard-to-discern numerical relationship between input and output from large and complex data through learning from past experiences. Therefore, many researchers replace conventional simulation methods with ML to accelerate the development process of various tasks, such as predicting the properties of chemical molecules [32,33] and composites [24,34,35,36,37,38,39]. Furthermore, more recent studies have demonstrated ML’s exceptional capability in solving inverse design problems. That is, through the ML model such as Generative Adversarial Network (GAN) [40,41,42] and Conditional Variational Autoencoder (CVAE) [43,44,45], chemical molecular or composites structure can be obtained using the desired requirement as the input of ML model.
Although ML has shown high accuracy in solving inverse design problems, it remains a challenge to interpret the model predictions correctly and to extract the design guidelines—which design features are essential and contribute more to the desired properties? Various methods, sometimes called Explainable AI (XAI), have been proposed to address this issue [46,47,48,49,50]. Among them, Lundberg and Lee [50] presented a novel unified approach for interpreting predictions, SHAP (SHapley Additive exPlanations), by assigning each feature an importance value for a given prediction. This method shows good computation performance and is consistent with human intuition.
Despite these efforts, a comprehensive study on the optimization of both stiffness and toughness in the inverse design of bioinspired hard-soft composite structures that combines GA, CVAE, finite element method (FEM) simulations, experimental validation, and design guidelines via XAI is yet to be explored. In this work, we adopt a 16 × 16 2D hard-soft binary composite system with a crack in the middle of the edge under Mode I fracture loading [12] and compare the design efficiency of a traditional optimization technique, GA, and an ML-based optimization technique, CVAE, by two design targets: stiffness and toughness. Although much more simplified than the actual natural materials, 2D hard-soft binary composite can still provide valuable insights into the essence of bioinspired composite structures and is an ideal platform for the main objectives of this work: (1) completion of the whole process, including FEM simulation, ML-based inverse design, and experimental validation, (2) comparison of the inverse design ability between a traditional genetic algorithm and an ML model, (3) establishment of the design guidelines for different combinations of stiffness and toughness through Explainable AI techniques.

2. Materials and Methods

2.1. Composite Design Space, Fabrication, and Finite Element Analysis

Figure 1 shows the overall flow chart of this study. We aim to design and optimize the properties of a 2D composite composed of 16 × 16 soft and stiff cells; the optimization is performed on a fixed thickness. The material of each cell must be either soft or stiff, and the volume fraction of soft material is fixed at 12.5%. The boundary between the stiff and soft cells is strong and will not separate during the loading. The composite has an edge crack 25% of the specimen width oriented in the x-direction. The composite is symmetric about the x-axis (Figure 2). The resulting design space has possible designs of over 9.33 × 1019 combinations, which is unrealistic in terms of applying brute force algorithms to find optimal designs.
We chose two of the most important properties of load-bearing structures—stiffness and toughness—as our design targets. Stiffness is the slope of the linear part of the load-displacement curve, representing the composite’s ability to resist deformation under an applied load. Toughness is the area under the load-displacement curve representing the energy the composite can absorb before its crack propagates. According to the energy release rate failure criterion, a crack extends, i.e., fracturing, when the available energy release rate, G, for crack propagation is sufficient to overcome the material’s resistance to fracture Gc, i.e., GGc [51]. The energy release rate, G, is the energy dissipation with a newly created fracture surface area and is defined as the rate of change in potential energy with a crack area. Thus, G may be regarded as the “driving force” for fracture; Gc is the fracture energy (critical energy release rate) and is a material property independent of the applied loads and the specimen geometry. In this study, since the material ahead of the crack tip is either soft or stiff (Figure 2), the corresponding Gc value is used for a particular design pattern. Accordingly, we introduced a fracture criterion, the ratio of the energy release rate and the critical energy release rate G/Gc, to compare the tendency of crack propagation among different patterns [52,53].
The FEM simulation was implemented by the finite element software ANSYS APDL 2020 R2 and linear hypothesis was used to gain the design targets, fracture criterion, and stiffness. The dimension of the simulation model was the same as the experiment specimens, as shown in Figure 3d. The designed pattern was in the middle of the specimen with a dimension of 13 mm × 13 mm and a 1/4 width length crack on one side edge in the middle. The element type was four-node plane182 with real constant, thickness t = 2 mm, and using mapped meshing, the element size at the design area was 0.1625 mm, and the mesh at the crack tip was refined fourfold to an element size of 0.040625 mm to represent the concentrated stress field better; the element size outside the design area is 1 mm. The upper and lower boundary displacements were pre-scribed in the y-direction with ±5 mm and constrained in the x-direction. Because the simulation of the energy release rate is quite simple and fast and can show how far it is for the crack to start propagating. Therefore, we assume that the fracture criterion can be used to predict the designed pattern’s toughness. Of course, the assumption must be validated by experiment.
We calculated the energy release rate by the strain energy difference before and after the crack extends 0.040625 mm, one crack tip element length. The formula is as follows [54]
G = U 2 U 1 d a
where U1 and U2 are the strain energy before and after the crack extension, and da is the crack extending length (for two-dimensional problems). The units of G are J/m2.
The stiffness is calculated by K = F/δ, where F is the sum of reaction forces of boundary nodes with applied displacement and δ is the difference of average displacements of upper and lower boundaries of the design area.
To validate the modeling results, we prepared the specimens using PolyJet multi-material 3D printing technique [55] (PolyJet, Stratasys). It works like an inkjet printer, but instead of jetting drops of ink, PolyJet 3D printers jet tiny droplets of liquid plastic on a substrate. A UV light instantly cures the plastic, solidifying it, so complex parts take shape layer by layer. This study’s stiff and soft materials were customized by mixing Vero (a stiff, white resin) and Agilus30 (a photosensitive PolyJet polymer black in color). The resultant stiff and soft materials were respectively FLX9870-70a with Young’s modulus E = 0.951 MPa and Gc = 249 J/m2 and FLX9870-40a with Young’s modulus E = 0.455 MPa and Gc = 414 J/m2. E and Gc are assumed isotropic within each cell, and Gc is for Mode I only. Those values for single materials were measured in this study using the same experimental setup to ensure consistent results with the composite ones. Our experiments show that PolyJet generally produces strong interface bonding between two different materials, whereas the commonly used extrusion-based 3D printing, i.e., FDM, produces a weak interface and can significantly affect the mechanical performance of multi-material printed structures [56]. Thus, FDM is unsuitable as its specimens almost always fail at the stiff-soft boundary instead of material fracture.

2.2. Experimental Section

Figure 3 shows the experimental setup for measuring Young’s modulus and the critical energy release rate of single materials and validating that the toughness and stiffness of composite materials are the primary purposes of tensile tests. The tensile tests were performed at room temperature by a tensile machine (Criterion 42.503 Test System, MTS, MN, USA) in displacement-controlled mode with a cross-head speed of 5 mm/min. In addition, a 0.1-mm pre-stretch was applied to eliminate the bending stress or pre-stress in the specimens.
Figure 3. (a) Experimental setup for the tensile test with DIC. (b) Sample displacement field calculated using DIC. (c) picture of a sample specimen. (d) Dimension of the specimens. The red box is the design area. Unit: mm.
Figure 3. (a) Experimental setup for the tensile test with DIC. (b) Sample displacement field calculated using DIC. (c) picture of a sample specimen. (d) Dimension of the specimens. The red box is the design area. Unit: mm.
Polymers 15 00281 g003
Crack-free specimens were prepared, according to ASTM D638, for the measurement of single materials’ Young’s moduli. The load data was obtained from the tensile test machine’s readings, and the strain field was measured by a digital image correlation (DIC) system [57]. To measure the strain field with a DIC system, we first sprayed random black and white speckles on the measured area of specimens. Then, during the tensile test, we used a camera (α7R IV, Sony, Japan) with microlens (FE 90 mm F2.7 G Macro OSS, Sony, Japan) to obtain images of the measured area at the center of specimens. The video was taken at 24 fps at 1080p to balance memory storage and resolution. Finally, an open-source 2D Digital Image Correlation (Ncorr v1.2, Georgia Institute of Technology, GA, USA) analysis software program was used to track the relative displacements with the random speckles on the specimen surface [58].
Specimens according to ASTM D638 with a 25% width length crack on the one side edge of the middle (Figure 3d) were used to measure the critical energy release rate Gc. We recorded the load from the machine’s readings when the crack started to propagate. This critical load was applied in the FEM model to calculate the strain energy release rate G according to Equation (1). Because the crack had already started to extend at that moment, the energy release rate calculated by FEM was equal to the critical energy release rate Gc.
A similar procedure of specimen preparation and experiments was applied to measure the stiffness and the energy release rate of the designed composite patterns. In addition, we also directly measured the toughness (J/m3) by calculating the area under the load-displacement curve before fracture. Finally, we will compare G/Gc and experimental toughness and verify if G/Gc is a good predictor of toughness.
Three samples were tested for each case, resulting in a total of 48 samples, including 12 for measuring the soft and stiff materials’ E and Gc.

2.3. Conditional Variational Autoencoder (CVAE)

We use CVAE as our composite design generator. Unlike the original VAE, CVAE can produce designs with specific properties by directly incorporating the desired properties into the encoder and decoder. The objective function of the CVAE is as follows
E log P X z , c D K L Q z X , c P z c
where P and Q are probability distributions, X and z are the data and latent spaces, and c is a condition vector. The first term is the reconstruction error, which measures the autoencoder’s input and output data similarity. The second term is the Kullback-Leibler divergence which regularizes the distribution of latent space and makes it as close as a standard normal distribution [59]. Stiffness and toughness were represented as condition vector c, which imposed upon the CVAE to generate a composite design with the target properties.
The CVAE architecture in our work is represented in Figure 4 and briefly described below. The encoder and decoder were each modeled by two layers of a feed-forward network. The hidden units for the encoder are 128 and 64 and 64 and 128 for the decoder. ReLU was used as an activation function for all layers except for the output layer in the decoder. Sigmoid was used for the output layer in the decoder to constrain its output between 0 and 1. During training, to be able to calculate gradients and update the weights of the model, we allowed the elements of the output design to vary from 100% (as the soft material) to 0% (as the stiff material). As for testing, we ranked the value of each element of the output design from high to low and transformed the top 12.5% of elements and the rest to 1 and zero, respectively, to restrain the output designs in our design space.
We initialized the weights randomly and trained all network weights from scratch. The adaptive moment estimation (Adam) method, with a learning rate of 0.005 and a batch size of 512, is used to train the network for 30 epochs. An exponential learning rate decay scheduler scales down the learning rate by 0.99 every epoch. We implemented the model with Pytorch, and it took roughly 3 min to train the CVAE on a computer with an AMD Ryzen 9 3950X 16-core processor and an Nvidia GeForce GTX 1660 SUPER GPU.

2.4. Genetic Algorithm (GA)

Here we adopt the classic procedure of GA (Figure 5) and use a neural network as an approximate model to predict the population’s mechanical properties, stiffness, and toughness.
The genetic algorithm starts with an initial population of 1024 randomly generated individuals. Since our design space is symmetric about the x-axis, we define an individual using only the top half of the design element, i.e., an array whose length is 128 and consists of 87.5% of 0, which denotes soft material, and 12.5% of 1, which denotes stiff material.
Next, we use a neural network to predict the mechanical properties of each individual. The neural network inputs the generated design and outputs the design’s stiffness and toughness. The model’s architecture is represented in Figure 6 and is briefly described below. It is modeled by 2 layers of a feed-forward network with hidden units of 64 and 32, respectively. ReLU is used as an activation function for all layers except the output layer. We use MSE loss as the cost function, an Adam optimizer with a learning rate of 0.001, and an exponential learning rate scheduler with a decay rate of 0.99 every epoch. We use 90% of the dataset to train the neural network with a mini-batch of 512 for 30 epochs.
Next, the fitness of each design is evaluated using the negative mean square error of their predicted mechanical properties and the target properties as follows. The closer the properties are to the target, the higher the fitness is assigned to the design. To ensure both stiffness and toughness have the same scale of effect on the fitness, we standardized the stiffness and the toughness using the dataset’s mean and standard deviation before calculating the mean square error.
f i t n e s s = 1 2 ( ( K K ^ ) 2 + ( G / G c G ^ / G c ) 2 )
Then, a selection rate of 50% was set to eliminate half of the population based on the assigned fitness. The remaining population then produces the next-generation designs with a crossover rate of 40%. A mutation probability of 10% is also implemented where random elements of soft material transform into stiff material. Mutation can maintain the genetic diversity of the population and helps GA escape local minima. To maintain the output design in our design space, we customized the crossover and mutation process to ensure their output design still has the exact ratio of 12.5% of soft material.

3. Results and Discussion

3.1. Dataset Analysis

We produced 120,000 randomly designed patterns as the dataset for machine learning (Table 1). The stiffness of the random patterns ranges from 1210 N/m to 1444 N/m. The average is about 1337 N/m, close to the stiff material’s stiffness, 1467 N/m. Adding 12.5% of soft material into stiff material does not decrease the stiffness of composite materials too much (−8.9%). On the other hand, the fracture criterion G/Gc varies significantly from about 0.33 to 1.12, which means the toughness of composite materials is highly tunable with just 12.5% soft material. Note that the Gc value depends on the material ahead of the crack tip (crack propagation direction), i.e., Gc = 249 J/m2 for the stiff material and 414 J/m2 for the soft material. Figure 7 shows the distribution of the fracture criterion and stiffness of the random patterns. We observe an intriguing distribution of the data points in two clusters, which will be discussed later.

3.2. Experimental Results

We chose six patterns from the random dataset to verify the relationship between fracture criterion and toughness (Figure 8). According to the value of the fracture criterion, the patterns were separated into three levels: high, middle, and low. Each level had two patterns with similar fracture criteria G/Gc, but the material ahead of the crack tip was soft for one pattern and stiff for the other. The objective is threefold: First, to verify the accuracy of FEM simulations using stiffness. Second, to verify whether the material ahead of the tip is indeed critical, as commonly believed. Third, to verify whether G/Gc correlates with toughness, as defined by the area under the load-displacement curve at fracture.
Table 2 shows that the simulated stiffness values agree reasonably well with those obtained from experiments (about a 10% difference). Table 3 shows the comparison of fracture criterion and toughness. An investigation of the results highlights the following observations: First, the experimental toughness variation is noticeable, a common disadvantage of 3D printing techniques. Second, the patterns with similar G/Gc indeed have similar toughness values, confirming that G/Gc can predict toughness—the higher G/Gc, the lower the experimental toughness. As the fracture criterion G/Gc shows how much deformation the pattern can sustain before the crack starts to propagate, under the condition of similar stiffness, the pattern’s toughness can be predicted by the fracture criterion. A smaller G/Gc means the pattern can undergo larger cross-head displacement and absorb more energy before the crack propagates. Third, we observe no apparent correlation between the toughness and type of material ahead of the crack tip. We will evaluate the exact contribution of the material distribution on the toughness by XAI in Section 3.4.

3.3. CVAE versus GA

Here we quantitatively compare the performance of CVAE and GA based on accuracy and computation cost. We linearly interpolate 10,000 points within K (1100–1500 N/m) and G/Gc (0.2–1.2) as target properties (Figure 9) for CVAE and GA to design. For each set of target properties, the decoder of CVAE takes in a latent vector randomly sampled from Gaussian noise and the target properties, and then outputs its prediction. As for GA, we set the maximum iteration to 50 and output the design with the best fitness. After the predictions by CVAE and GA, we simulate their designs in FEM to calculate their stiffness and toughness as ground truth. The error of each design is calculated by averaging the error of stiffness and the error of toughness. Figure 10b,d is the scatter plot of the resulting properties distribution of composites designed by CVAE and GA. Although the target properties are uniformly distributed, the results of CVAE and GA are still confined to the range of the original FEM dataset. This is expected as the original dataset is generated randomly and should represent the overall distribution of the composite design space; we can conclude that the inability of CVAE and GA is due to the non-existence of such design outside of the original dataset, as shown in Figure 7. As for the design accuracy, both CVAE and GA perform very well inside the plausible properties range, with errors well below 20% (Figure 10a,c). Moreover, Figure 9b,d shows that the resulting designs by GA distribute somewhat more evenly than CVAE. This suggests that GA slightly outperforms CVAE within the original dataset range and can more accurately design a composite with desired properties. Additionally, two specific design examples of different combinations of stiffness and toughness are provided in Figure 11 to help better understand the evaluation process.
Regarding the time performance, however, CVAE outperforms GA; GA took roughly 3 s to iterate and output a composite design and, thus, about 8 h for all the 10,000 target properties, whereas CVAE completed all 10,000 target properties in under 4 s which was about 7500 times faster. The reason is that CVAE only inferences the neural network model once for every set of target properties, and it can carry the computation in parallel in processing hundreds of target properties at once depending on the size of RAM on the GPU. As for GA, for a single target property, GA needs to infer the neural network and compute the fitness of 1024 individual designs every iteration.

3.4. Discussion with Explainable AI (XAI) and Fracture Mechanics

In this section, we investigate the black box of the machine learning algorithm and attempt to interpret the logic behind how the model comprehends the composite material. We use SHAP Values (Shapley Additive Explanation) [50] to analyze the properties predicting neural networks in GA to see how each element in the composite contributes to the final stiffness and toughness. SHAP value breaks down a prediction by a model and shows the contribution of each feature to the final prediction. Here we adopted the SHAP package by Lundberg and Lee and used the DeepExplainer module to analyze our neural network. We randomly sampled 1000 design patterns as the background of DeepExplainer and averaged the SHAP value of each element across another 1000 designs.
We observe from the rank figure (Figure 12a) that elements around the crack tip contribute the most to the overall stiffness of the composite, whereas elements at the far left and far right side contribute the least to the overall stiffness. Specifically, from the value figure in Figure 12c, the effect of the two elements ahead of the crack tip dominates the rest of the other elements. In other words, the two elements ahead of the crack tip determine the stiffness of the composite design, while other elements can only make minor adjustments.
As for toughness, the trend is very different from the stiffness case. The most dominant elements are located just behind the crack tip (Figure 12b,d), with an influence value of 0.5, whereas other elements’ values are all close to 0. Moreover, while the two elements ahead of the crack tip dominate the overall stiffness, they almost do not affect the toughness of the composite design studied here.
To confirm the contribution of the element behind the crack tip, we split our dataset based on the material behind the crack tip and plotted the stiffness and toughness distribution (Figure 13). We observed that the two clusters from the original distribution in Figure 7 are separated by this method, and the average toughness values are very different within these two clusters, and consistent with the results discussed in Figure 12b,d.
How do we explain the underlying physics of XAI’s somewhat counter-intuitive result in toughness? It is commonly believed that the designed pattern was tougher if the soft (tougher) material was placed just ahead of the crack tip (which requires more energy to break), but the result did not support this intuition. To understand how this happened, we compared the energy release rates of three scenarios: all stiff material around the crack tip, soft material ahead of the crack tip, and soft material behind the crack tip. With all the stiff material around the crack tip, the energy release rate is 184 J/m2. However, the energy release rate increases to 332 J/m2 if the pattern has soft material just ahead of the crack tip, indicating that the soft material placed ahead of the crack tip doubles the crack propagation tendency. Correspondingly, if the resistance to crack propagation (i.e., the fracture toughness) of the soft material is not two-fold that of the stiff material, placing the soft material ahead of the crack tip cannot make the pattern tougher as intuitively expected.
Furthermore, according to the experimental results, the critical energy release rates (fracture energy) of stiff and soft materials used in this study are 249 J/m2 and 414 J/m2, respectively. Therefore, the fracture energy of soft material is only ~70% higher than that of stiff material, which means that soft material placed ahead of the crack tip does not help the toughness of the pattern. On the other hand, if soft material is placed behind the crack tip, the energy release rate decreases to 98 J/m2, a reduction of 47% compared to the case of stiff material around the crack tip. Therefore, to make the pattern tougher by reducing the energy release rate, soft material (of higher Gc) should be preferably placed behind the crack tip instead of ahead of the crack tip unless the soft material’s Gc is orders of magnitude larger than the stiff material’s Gc.

4. Conclusions

We conducted experiments, FEM, GA, and machine learning analyses on the inverse design problems of bioinspired composite structures using a hard-soft 2D binary model system. First, we simulated the uniaxial tension of 120,000 design patterns with a linear 2D FEM model and calculated their respective stiffness and toughness as a dataset for machine learning. We performed tensile tests on specimens fabricated with PolyJet technology and found great consistency with the results of FEM and XAI. Next, we used GA and CVAE to design composite structures for target stiffness and toughness. We then analyzed the logic behind the machine learning’s predictions and used fracture mechanics and shapely value to provide some insights. We discovered that while GA performed slightly better in accuracy, CVAE can design a composite with a much faster speed with little loss of accuracy. In addition, we showed that adding soft material behind the crack tip tremendously increased the overall toughness of the composite through the reduction of the energy release rate. Our findings may provide insights into the effects of adding soft material at different locations of a composite system. They may also provide guidelines on conducting experiments to validate the results and on interpreting them using fracture mechanics and XAI. Future work may consider composite structures involving more complex materials arrangements, crack distributions, different fracture modes, and 3D problems.

Author Contributions

Conceptualization, Y.-H.C., Y.-H.L. and J.-Y.J.; data curation, Y.-H.C. and Y.-H.L.; formal analysis, Y.-H.C. and Y.-H.L.; investigation, Y.-H.C. and Y.-H.L.; methodology, Y.-H.C., Y.-H.L. and J.-Y.J.; resources, J.-Y.J.; software, Y.-H.C. and Y.-H.L.; validation, Y.-H.C. and Y.-H.L.; visualization, Y.-H.C. and Y.-H.L.; writing—original draft preparation, Y.-H.C. and Y.-H.L.; writing—review and editing, J.-Y.J.; supervision, J.-Y.J.; project administration, J.-Y.J.; funding acquisition, J.-Y.J. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Ministry of Science and Technology (MOST) of Taiwan, grant number 109-2223-E-002-003-MY3 and National Taiwan University.

Institutional Review Board Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. Jackson, A.P.P.; Vincent, J.F.V.F.V.; Turner, R.M.M. The Mechanical Design of Nacre. Proc. R. Soc. B 1988, 234, 415–440. [Google Scholar] [CrossRef]
  2. Huss, J.C.; Antreich, S.J.; Bachmayr, J.; Xiao, N.; Eder, M.; Konnerth, J.; Gierlinger, N. Topological Interlocking and Geometric Stiffening as Complementary Strategies for Strong Plant Shells. Adv. Mater. 2020, 32, e2004519. [Google Scholar] [CrossRef] [PubMed]
  3. Chang, Y.; Chen, P.-Y.Y. Hierarchical Structure and Mechanical Properties of Snake (Naja Atra) and Turtle (Ocadia Sinensis) Eggshells. Acta Biomater. 2016, 31, 33–49. [Google Scholar] [CrossRef] [PubMed]
  4. Chiang, P.-L.; Tseng, Y.-C.; Wu, H.-J.; Tsao, S.-H.; Wu, S.-P.; Wang, W.-C.; Hsieh, H.-I.; Juang, J.-Y. Elastic Moduli of Avian Eggshell. Biology 2021, 10, 989. [Google Scholar] [CrossRef] [PubMed]
  5. Juang, J.Y.; Chen, P.Y.; Yang, D.C.; Wu, S.P.; Yen, A.; Hsieh, H.I. The Avian Egg Exhibits General Allometric Invariances in Mechanical Design. Sci. Rep. 2017, 7, 14205. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Huang, Y.-S.; Chiang, P.-L.; Kao, Y.-C.; Hsu, F.-L.; Juang, J.-Y. Cracking Failure of Curved Hollow Tree Trunks. R. Soc. Open Sci. 2020, 7, 200203. [Google Scholar] [CrossRef] [Green Version]
  7. Huang, Y.S.; Hsu, F.L.; Lee, C.M.; Juang, J.Y. Failure Mechanism of Hollow Tree Trunks Due to Cross-Sectional Flattening. R. Soc. Open Sci. 2017, 4, 160972. [Google Scholar] [CrossRef] [Green Version]
  8. Fratzl, P.; Weinkamer, R. Nature’s Hierarchical Materials. Prog. Mater Sci. 2007, 52, 1263–1334. [Google Scholar] [CrossRef] [Green Version]
  9. Munch, E.; Launey, M.E.; Alsem, D.H.; Saiz, E.; Tomsia, A.P.; Ritchie, R.O. Tough, Bio-Inspired Hybrid Materials. Science 2008, 322, 1516–1520. [Google Scholar] [CrossRef] [Green Version]
  10. Yin, Z.; Hannard, F.; Barthelat, F. Impact-Resistant Nacre-Like Transparent Materials. Science 2019, 364, 1260–1263. [Google Scholar] [CrossRef]
  11. Yu, C.-H.; Tseng, B.-Y.; Yang, Z.; Tung, C.-C.; Zhao, E.; Ren, Z.-F.; Yu, S.-S.; Chen, P.-Y.; Chen, C.-S.; Buehler, M.J. Hierarchical Multiresolution Design of Bioinspired Structural Composites Using Progressive Reinforcement Learning. Adv. Theory Simul. 2022, 5, 2200459. [Google Scholar] [CrossRef]
  12. Gu, G.X.; Chen, C.T.; Buehler, M.J. De Novo Composite Design Based on Machine Learning Algorithm. Extrem. Mech. Lett. 2018, 18, 19–28. [Google Scholar] [CrossRef]
  13. Libonati, F.; Gu, G.X.; Qin, Z.; Vergani, L.; Buehler, M.J. Bone-Inspired Materials by Design: Toughness Amplification Observed Using 3d Printing and Testing. Adv. Eng. Mater. 2016, 18, 1354–1363. [Google Scholar] [CrossRef] [Green Version]
  14. Chawla, K.K. Composite Materials: Science and Engineering, 3rd ed.; Springer Science+Business Media: New York, NY, USA, 2012; p. 542. [Google Scholar]
  15. Canale, G.; Andrews, S.; Rubino, F.; Maligno, A.; Citarella, R.; Weaver, P.M. Realistic Stacking Sequence Optimisation of an Aero-Engine Fan Blade-Like Structure Subjected to Frequency, Deformation and Manufacturing Constraints. Open Mech. Eng. J. 2018, 12, 151–163. [Google Scholar] [CrossRef]
  16. Herencia, J.E.; Weaver, P.M.; Friswell, M.I. Optimization of Long Anisotropic Laminated Fiber Composite Panels with T-Shaped Stiffeners. AIAA J. 2007, 45, 2497–2509. [Google Scholar] [CrossRef] [Green Version]
  17. Barbero, E.J. Introduction to Composite Materials Design, 3rd ed.; CRC Press, Taylor & Francis Group: Boca Raton, FL, USA, 2018; p. 535. [Google Scholar]
  18. Mallick, P.K. Fiber-Reinforced Composites: Materials, Manufacturing, and Design, 3rd ed.; CRC Press: Boca Raton, FL, USA, 2008; p. 619. [Google Scholar]
  19. Gibson, I.; Rosen, D.W.; Stucker, B. Additive Manufacturing Technologies: 3d Printing, Rapid Prototyping and Direct Digital Manufacturing, 2nd ed.; Springer: New York, NY, USA; London, UK, 2015; p. 498. [Google Scholar]
  20. Studart, A.R. Additive Manufacturing of Biologically-Inspired Materials. Chem. Soc. Rev. 2016, 45, 359–376. [Google Scholar] [CrossRef]
  21. Ghimire, A.; Tsai, Y.-Y.; Chen, P.-Y.; Chang, S.-W. Tunable Interface Hardening: Designing Tough Bio-Inspired Composites through 3d Printing, Testing, and Computational Validation. Compos. Part B Eng. 2021, 215, 108754. [Google Scholar] [CrossRef]
  22. Hajela, P.; Lee, E.; Lin, C.-Y. Genetic Algorithms in Structural Topology Optimization. In Topology Design of Structures; Springer: Berlin/Heidelberg, Germany, 1993; pp. 117–133. [Google Scholar]
  23. Hamel, C.M.; Roach, D.J.; Long, K.N.; Demoly, F.; Dunn, M.L.; Qi, H.J. Machine-Learning Based Design of Active Composite Structures for 4d Printing. Smart Mater. Struct. 2019, 28, 065005. [Google Scholar] [CrossRef]
  24. Yu, C.-H.; Qin, Z.; Buehler, M.J. Artificial Intelligence Design Algorithm for Nanocomposites Optimized for Shear Crack Resistance. Nano Futures 2019, 3, 035001. [Google Scholar] [CrossRef]
  25. Gu, G.X.; Dimas, L.; Qin, Z.; Buehler, M.J. Optimization of Composite Fracture Properties: Method, Validation, and Applications. J. Appl. Mech. 2016, 83, 071006. [Google Scholar] [CrossRef]
  26. Holland, J.H. Genetic Algorithm. Sci. Am. 1992, 267, 66–72. [Google Scholar] [CrossRef]
  27. Mathias, J.-D.; Balandraud, X.; Grediac, M. Applying a Genetic Algorithm to the Optimization of Composite Patches. Comput. Struct. 2006, 84, 823–834. [Google Scholar] [CrossRef]
  28. Soremekun, G.; Gürdal, Z.; Haftka, R.T.; Watson, L.T. Composite Laminate Design Optimization by Genetic Algorithm with Generalized Elitist Selection. Comput. Struct. 2001, 79, 131–143. [Google Scholar] [CrossRef]
  29. Jenkins, W.M. Towards Structural Optimization Via the Genetic Algorithm. Comput. Struct. 1991, 40, 1321–1327. [Google Scholar] [CrossRef]
  30. Tromp, J. The Number of Legal Go Positions. In Proceedings of International Conference on Computers and Games; Springer: Cham, Switzerland, 2016; pp. 183–190. [Google Scholar]
  31. Silver, D.; Huang, A.; Maddison, C.J.; Guez, A.; Sifre, L.; van den Driessche, G.; Schrittwieser, J.; Antonoglou, I.; Panneershelvam, V.; Lanctot, M.; et al. Mastering the Game of Go with Deep Neural Networks and Tree Search. Nature 2016, 529, 484–489. [Google Scholar] [CrossRef]
  32. Pilania, G.; Wang, C.; Jiang, X.; Rajasekaran, S.; Ramprasad, R. Accelerating Materials Property Predictions Using Machine Learning. Sci. Rep. 2013, 3, 2810. [Google Scholar] [CrossRef] [Green Version]
  33. Ahneman, D.T.; Estrada, J.G.; Lin, S.; Dreher, S.D.; Doyle, A.G. Predicting Reaction Performance in C-N Cross-Coupling Using Machine Learning. Science 2018, 360, 186–190. [Google Scholar] [CrossRef] [Green Version]
  34. Chen, C.-T.; Gu, G.X. Machine Learning for Composite Materials. MRS Commun. 2019, 9, 556–566. [Google Scholar] [CrossRef] [Green Version]
  35. Ye, S.; Li, B.; Li, Q.; Zhao, H.-P.; Feng, X.-Q. Deep Neural Network Method for Predicting the Mechanical Properties of Composites. Appl. Phys. Lett. 2019, 115, 161901. [Google Scholar] [CrossRef]
  36. Daghigh, V.; Lacy, T.E., Jr.; Daghigh, H.; Gu, G.; Baghaei, K.T.; Horstemeyer, M.F.; Pittman, C.U., Jr. Machine Learning Predictions on Fracture Toughness of Multiscale Bio-Nano-Composites. J. Reinf. Plast. Compos. 2020, 39, 587–598. [Google Scholar] [CrossRef]
  37. Yang, Z.; Yu, C.-H.; Buehler, M.J. Deep Learning Model to Predict Complex Stress and Strain Fields in Hierarchical Composites. Sci. Adv. 2021, 7, eabd7416. [Google Scholar] [CrossRef]
  38. Yang, C.; Kim, Y.; Ryu, S.; Gu, G.X. Prediction of Composite Microstructure Stress-Strain Curves Using Convolutional Neural Networks. Mater. Des. 2020, 189, 108509. [Google Scholar] [CrossRef]
  39. Chang, H.-S.; Huang, J.-H.; Tsai, J.-L. Predicting Mechanical Properties of Unidirectional Composites Using Machine Learning. Multiscale Sci. Eng. 2022, 4, 202–210. [Google Scholar] [CrossRef]
  40. Tan, R.K.; Zhang, N.L.; Ye, W. A Deep Learning–Based Method for the Design of Microstructural Materials. Struct. Multidiscip. Optim. 2020, 61, 1417–1438. [Google Scholar] [CrossRef]
  41. Kim, B.; Lee, S.; Kim, J. Inverse Design of Porous Materials Using Artificial Neural Networks. Sci. Adv. 2020, 6, eaax9324. [Google Scholar] [CrossRef] [Green Version]
  42. Ni, B.; Gao, H. A Deep Learning Approach to the Inverse Problem of Modulus Identification in Elasticity. MRS Bull. 2020, 46, 19–25. [Google Scholar] [CrossRef]
  43. Lim, J.; Ryu, S.; Kim, J.W.; Kim, W.Y. Molecular Generative Model Based on Conditional Variational Autoencoder for De Novo Molecular Design. J. Cheminf. 2018, 10, 31. [Google Scholar] [CrossRef] [Green Version]
  44. Kang, S.; Cho, K. Conditional Molecular Design with Deep Generative Models. J. Chem Inf. Model. 2019, 59, 43–52. [Google Scholar] [CrossRef] [Green Version]
  45. Skalic, M.; Jiménez, J.; Sabbadin, D.; De Fabritiis, G. Shape-Based Generative Modeling for De Novo Drug Design. J. Chem Inf. Model. 2019, 59, 1205–1214. [Google Scholar] [CrossRef]
  46. Shrikumar, A.; Greenside, P.; Kundaje, A. Learning Important Features through Propagating Activation Differences. In Proceedings of Proceedings of the 34th International Conference on Machine Learning, Proceedings of Machine Learning Research, Sydney, Australia, 6–11 August 2017; pp. 3145–3153. [Google Scholar]
  47. Ribeiro, M.T.; Singh, S.; Guestrin, C. “Why Should I Trust You?” Explaining the Predictions of Any Classifier. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; pp. 1135–1144. [Google Scholar]
  48. Datta, A.; Sen, S.; Zick, Y. Algorithmic Transparency Via Quantitative Input Influence: Theory and Experiments with Learning Systems. In Proceedings of the 2016 IEEE Symposium on Security and Privacy (SP), San Jose, CA, USA, 22–26 May 2016; pp. 598–617. [Google Scholar]
  49. Bach, S.; Binder, A.; Montavon, G.; Klauschen, F.; Müller, K.-R.; Samek, W. On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation. PLoS One 2015, 10, e0130140. [Google Scholar] [CrossRef]
  50. Lundberg, S.M.; Lee, S.-I. A Unified Approach to Interpreting Model Predictions. In Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA, 4–9 December 2017; pp. 4768–4777. [Google Scholar]
  51. Anderson, T.L. Fracture Mechanics: Fundamentals and Applications, 4th ed.; CRC Press/Taylor & Francis: Boca Raton, FL, USA, 2017; p. 661. [Google Scholar]
  52. Rohrer, B. How Do Convolutional Neural Networks Work? Available online: https://e2eml.school/how_convolutional_neural_networks_work.html (accessed on 15 December 2022).
  53. Lee, S.; Pharr, M. Sideways and Stable Crack Propagation in a Silicone Elastomer. Proc. Natl. Acad. Sci. USA 2019, 116, 201820424. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  54. Park, S.-J.; Seo, M.-K. Chapter 4—Solid-Solid Interfaces. In Interface Science and Technology; Park, S.-J., Seo, M.-K., Eds.; Elsevier: Amsterdam, The Netherlands, 2011; Volume 18, pp. 253–331. [Google Scholar]
  55. Andreu, A.; Su, P.-C.; Kim, J.-H.; Ng, C.S.; Kim, S.; Kim, I.; Lee, J.; Noh, J.; Subramanian, A.S.; Yoon, Y.-J. 4d Printing Materials for Vat Photopolymerization. Addit. Manuf. 2021, 44, 102024. [Google Scholar] [CrossRef]
  56. Lopes, L.R.; Silva, A.F.; Carneiro, O.S. Multi-Material 3d Printing: The Relevance of Materials Affinity on the Boundary Interface Performance. Addit. Manuf. 2018, 23, 45–52. [Google Scholar] [CrossRef]
  57. Xu, Y.-X.; Juang, J.-Y. Measurement of Nonlinear Poisson’s Ratio of Thermoplastic Polyurethanes under Cyclic Softening Using 2d Digital Image Correlation. Polymers 2021, 13, 1498. [Google Scholar] [CrossRef] [PubMed]
  58. Blaber, J.; Adair, B.; Antoniou, A. Ncorr: Open-Source 2d Digital Image Correlation Matlab Software. Exp. Mech. 2015, 55, 1105–1122. [Google Scholar] [CrossRef]
  59. Kullback, S.; Leibler, R.A. On Information and Sufficiency. Ann. Math. Stat. 1951, 22, 79–86. [Google Scholar] [CrossRef]
Figure 1. Overall flow chart.
Figure 1. Overall flow chart.
Polymers 15 00281 g001
Figure 2. Schematic of the composite design. The dimension of the design space is 13 mm × 13 mm. The displacement-controlled tensile test is conducted in the y-direction. The red box indicates the two elements behind the crack tip.
Figure 2. Schematic of the composite design. The dimension of the design space is 13 mm × 13 mm. The displacement-controlled tensile test is conducted in the y-direction. The red box indicates the two elements behind the crack tip.
Polymers 15 00281 g002
Figure 4. The architecture of the neural network for the CVAE model. The numbers in the parentheses are the hidden units.
Figure 4. The architecture of the neural network for the CVAE model. The numbers in the parentheses are the hidden units.
Polymers 15 00281 g004
Figure 5. Flow chart for genetic algorithm.
Figure 5. Flow chart for genetic algorithm.
Polymers 15 00281 g005
Figure 6. The neural network’s architecture for predicting the mechanical properties of composite material. The numbers in the parentheses are the hidden units.
Figure 6. The neural network’s architecture for predicting the mechanical properties of composite material. The numbers in the parentheses are the hidden units.
Polymers 15 00281 g006
Figure 7. Scatter plot of FEM dataset. The unit of K is N/m.
Figure 7. Scatter plot of FEM dataset. The unit of K is N/m.
Polymers 15 00281 g007
Figure 8. 6 Design patterns for the experiment. The number denotes the pattern ID.
Figure 8. 6 Design patterns for the experiment. The number denotes the pattern ID.
Polymers 15 00281 g008
Figure 9. Scatter plot of target properties of stiffness and toughness. The unit of K is N/m.
Figure 9. Scatter plot of target properties of stiffness and toughness. The unit of K is N/m.
Polymers 15 00281 g009
Figure 10. Comparison of CVAE and GA. (a) Error contour plot of CVAE (b) Scatter plot of properties generated by CVAE. (c) Error contour plot of GA. (d) Scatter plot of properties generated by GA. The unit of K is N/m.
Figure 10. Comparison of CVAE and GA. (a) Error contour plot of CVAE (b) Scatter plot of properties generated by CVAE. (c) Error contour plot of GA. (d) Scatter plot of properties generated by GA. The unit of K is N/m.
Polymers 15 00281 g010
Figure 11. Two examples with different target stiffness and toughness values illustrating the design process and the results of GA and CVAE. The unit of K is N/m.
Figure 11. Two examples with different target stiffness and toughness values illustrating the design process and the results of GA and CVAE. The unit of K is N/m.
Polymers 15 00281 g011
Figure 12. Shapley value plot of each element. (a) K by rank. (b) G/Gc by rank. (c) K by value. (d) G/Gc by value. The unit of K is N/m.
Figure 12. Shapley value plot of each element. (a) K by rank. (b) G/Gc by rank. (c) K by value. (d) G/Gc by value. The unit of K is N/m.
Polymers 15 00281 g012
Figure 13. Scatter plots of the FEM dataset depending on the material behind the crack tip: (left panel): stiff material; (right panel): soft material. The unit of K is N/m.
Figure 13. Scatter plots of the FEM dataset depending on the material behind the crack tip: (left panel): stiff material; (right panel): soft material. The unit of K is N/m.
Polymers 15 00281 g013
Table 1. Dataset analysis of 120,000 data generated from finite element method. 25%, 50%, and 75% indicate the properties’ first, second, and third quartiles.
Table 1. Dataset analysis of 120,000 data generated from finite element method. 25%, 50%, and 75% indicate the properties’ first, second, and third quartiles.
K (N/m)G/GcG (J/m2)
mean13370.735229199.377518
std25.400.13064559.964850
min12100.32978082.115000
25%13240.728642181.958000
50%13400.763818190.629000
75%13530.804388202.360000
max14441.122954464.903000
Table 2. Comparison of simulated and experimental stiffness K (* soft material ahead of the crack tip).
Table 2. Comparison of simulated and experimental stiffness K (* soft material ahead of the crack tip).
No.K (FEM)
(N/m)
Experimental Stiffness, K (N/m)Error (%)
Specimen 1Specimen 2Specimen 3Average
6971329147816101396149511.1
10,668 *1301154615551424150813.7
57,881137516021423144014888.6
49,130 *130813171365143113714.6
15,9351277147815241362145512.2
99,251 *124813471457132413769.3
Table 3. Comparison of simulated fracture criterion G/Gc and experimental toughness of 6 design patterns (* soft material ahead of the crack tip).
Table 3. Comparison of simulated fracture criterion G/Gc and experimental toughness of 6 design patterns (* soft material ahead of the crack tip).
No.G/GcExperimental Toughness, (J/m3)
Specimen 1Specimen 2Specimen 3Average
6970.37315,38118,89913,00015,760
10,668 *0.37415,114994911,35512,139
57,8810.6957971998278368596
49,130 *0.6939489814181648598
15,9351.0089398573453776836
99,251 *1.0076698654358196353
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Chiu, Y.-H.; Liao, Y.-H.; Juang, J.-Y. Designing Bioinspired Composite Structures via Genetic Algorithm and Conditional Variational Autoencoder. Polymers 2023, 15, 281. https://doi.org/10.3390/polym15020281

AMA Style

Chiu Y-H, Liao Y-H, Juang J-Y. Designing Bioinspired Composite Structures via Genetic Algorithm and Conditional Variational Autoencoder. Polymers. 2023; 15(2):281. https://doi.org/10.3390/polym15020281

Chicago/Turabian Style

Chiu, Yi-Hung, Ya-Hsuan Liao, and Jia-Yang Juang. 2023. "Designing Bioinspired Composite Structures via Genetic Algorithm and Conditional Variational Autoencoder" Polymers 15, no. 2: 281. https://doi.org/10.3390/polym15020281

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop