M-StruGAN: An Automatic 2D-Plan Generation System under Mixed Structural Constraints for Homestays
Abstract
:1. Introduction
2. Literature Review
3. M-StruGAN Method
- Implementation of M-StruGAN: First, the implementation of M-StruGAN involves the selection of mixed structural elements (such as columns, shear walls, and traffic cores), which is key in determining the generation of control 2D-plan layouts. Second, there is the establishment and processing of the dataset, since the probability distribution and quality of the M-StruGAN design are directly related to the dataset’s quality. Finally, there is the training of the M-StruGAN model. The processed dataset is fed into the pix2pixHD model in two steps, and the functional partition model (A-B) of M-StruGAN and the space partition model (B-C) of M-StruGAN are trained. This procedure combines the steps of the designer’s method of designing the building plan. Furthermore, we use the generator loss curves of the two models to judge whether it was trained successfully.
- Analysis of M-StruGAN generation results: This study establishes an evaluation method for intelligently generated plan schemes and evaluates the image synthesis quality, scheme design rationality, and scheme design quality of M-StruGAN.
- M-StruGAN application: Applying M-StruGAN to the human–computer interaction interface, the user can quickly generate a 2D-plan layout diagram of a homestay by modifying and adjusting the hybrid structure. Moreover, compare it with the timeliness and economy of the designer’s design scheme.
4. Implementation of M-StruGAN
4.1. Mixed Structural Element Extraction
4.2. Dataset Production
4.3. M-StruGAN Training and Results
5. Result Evaluation
5.1. Image Synthesis Quality Assessment
5.2. Plan Rationality Assessment
- Judging whether the 2D-plan is generated by artificial intelligence or drawn by a designer.
- Evaluate and score the rationality of the 2D-plan design drawings.
- About 63.20% of the M-StruGAN-generated drawings were evaluated as architects’ drawings, 73.80% were evaluated as architect’s design drawings by nonprofessional designers, and the corresponding equals 68.50%. It can be seen that it is difficult for experimenters to distinguish M-StruGAN from the designer’s design accurately.
- The difference in rationality quantification between the design drawings generated by M-StruGAN and the designer’s design drawings is about 13.01%, which confirms the excellence of M-StruGAN 2D graphic design and the designer’s recognition of its design generation results.
5.3. Design Quality Assessment
6. Human–Computer Interaction Application
7. Conclusions and Discussion
- The trained M-StruGAN can generate 2D plans based on mixed structural constraints.
- This study used three evaluation methods: image synthesis quality assessment, scheme rationality assessment, and scheme design quality assessment. Image synthesis quality assessment quantifies and confirms the drawing generation quality of M-StruGAN; the rationality evaluation of the scheme shows that designers have a high degree of acceptance of the M-StruGAN design; and the scheme design quality evaluation shows that M-StruGAN has completed learning 2D layout design elements.
- Through the human–computer interaction application of M-StruGAN, it can be found that compared with traditional design methods, M-StruGAN based on pix2pixHD has high-definition image quality, higher design efficiency, lower design cost, and more stable design quality. Therefore, M-StruGAN has a high application prospect in aided design.
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Kim, G.; Schaefer, L.; Kim, J.T. Development of a Double-Skin Façade for Sustainable Renovation of Old Residential Buildings. Indoor Built Environ. 2012, 22, 180–190. [Google Scholar] [CrossRef]
- Liao, H.; Ren, R.; Li, L. Existing Building Renovation: A Review of Barriers to Economic and Environmental Benefits. Int. J. Environ. Res. Public Health 2023, 20, 4058. [Google Scholar] [CrossRef]
- Häkkinen, T.; Ruuska, A.; Vares, S.; Pulakka, S.; Kouhia, I.; Holopainen, R. Methods and Concepts for Sustainable Renovation of Buildings; VTT Technical Research Centre of Finland: Espoo, Finland, 2012; pp. 154–196. [Google Scholar]
- You, W.; Shen, J.; Ding, W. Improving Wind Environment of Residential Neighborhoods by Understanding the Relationship between Building Layouts and Ventilation Efficiency. Energy Proc. 2017, 105, 4531–4536. [Google Scholar] [CrossRef]
- Hsu, S.-L.; Lin, S.-L. Factors underlying college students’ choice homestay accommodation while travelling. World Trans. Eng. Technol. Educ. 2018, 9, 156–165. [Google Scholar]
- Kayat, K. Customer Orientation among Rural Home Stay Operators in Malaysia. Asean J. Hosp. Tour. 2017, 6, 65. [Google Scholar] [CrossRef]
- Hu, S.; Yan, D.; Guo, S.; Cui, Y.; Dong, B. A survey on energy consumption and energy usage behavior of households and residential building in urban China. Energy Build. 2017, 148, 366–378. [Google Scholar] [CrossRef]
- Kontogeorgopoulos, N.; Churyen, A.; Duangsaeng, V. Homestay Tourism and the Commercialization of the Rural Home in Thailand. Asia Pac. J. Tour. Res. 2013, 20, 29–50. [Google Scholar] [CrossRef]
- Gimenez, L.; Hippolyte, J.-L.; Robert, S.; Suard, F.; Zreik, K. Review: Reconstruction of 3D building information models from 2D scanned plans. J. Build. Eng. 2015, 2, 24–35. [Google Scholar] [CrossRef]
- Peng, X.; Liu, P.; Jin, Y. The Age of Intelligence: Urban Design Thinking, Method Turning and Exploration. In Proceedings of the 2019 DigitalFUTURES, Shanghai, China, 7–8 July 2020; pp. 275–284. [Google Scholar]
- Mitchell, W.J. The theoretical foundation of computer-aided architectural design. Comput. Aided Des. 1976, 8, 285. [Google Scholar] [CrossRef]
- Chokwitthaya, C.; Zhu, Y.; Mukhopadhyay, S.; Collier, E. Augmenting building performance predictions during design using generative adversarial networks and immersive virtual environments. Autom. Constr. 2020, 119, 103350. [Google Scholar] [CrossRef]
- Lawson, B. Towards a computer-aided architectural design process: A journey of several mirages. Comput. Ind. 1998, 35, 47–57. [Google Scholar] [CrossRef]
- Rampini, L.; Cecconi, F.R. Artificial intelligence in construction asset management: A review of present status, challenges and future opportunities. J. Inf. Technol. Constr. 2022, 27, 884–913. [Google Scholar] [CrossRef]
- Liang, L.; Ye, H.; Li, G.Y. Multi—Agent Reinforcement Learning for Spectrum Sharing in Vehicular Networks. In Proceedings of the 2019 IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC), Cannes, France, 2–5 July 2019; pp. 224–235. [Google Scholar]
- Nadimi-Shahraki, M.H.; Taghian, S.; Mirjalili, S.; Faris, H. MTDE: An effective multi-trial vector-based differential evolution algorithm and its applications for engineering design problems. Appl. Soft Comput. 2020, 97, 106761. [Google Scholar] [CrossRef]
- Yu, X.; Li, C.; Zhou, J. A constrained differential evolution algorithm to solve UAV path planning in disaster scenarios. Knowl. Based Syst. 2020, 204, 106209. [Google Scholar] [CrossRef]
- Lachhwani, K. Application of neural network models for mathematical programming problems: A state of art review. Arch. Comput. Methods Eng. 2020, 27, 171–182. [Google Scholar] [CrossRef]
- Veloso, P.; Celani, G.; Scheeren, R. From the generation of layouts to the production of construction documents: An application in the customization of apartment plans. Autom. Constr. 2018, 96, 224–235. [Google Scholar] [CrossRef]
- Merrell, P.; Schkufza, E.; Koltun, V. Computer-generated residential building layouts. In Proceedings of the ACM SIGGRAPH Asia 2010 Papers on—SIGGRAPH ASIA’10, Seoul, Republic of Korea, 15–18 December 2010; pp. 1–12. [Google Scholar]
- Laignel, G.; Pozin, N.; Geffrier, X.; Delevaux, L.; Brun, F.; Dolla, B. Floor plan generation through a mixed constraint programming-genetic optimization approach. Autom. Constr. 2021, 123, 103491. [Google Scholar] [CrossRef]
- Inoue, M.; Takagi, H. Layout algorithm for an EC-based room layout planning support system. In Proceedings of the 2008 IEEE Conference on Soft Computing in Industrial Applications, Muroran, Japan, 25–27 June 2008; pp. 165–170. [Google Scholar]
- Gimenez, L.; Robert, S.; Suard, F.; Zreik, K. Automatic reconstruction of 3D building models from scanned 2D floor plans. Autom. Constr. 2016, 63, 48–56. [Google Scholar] [CrossRef]
- Sun, C.; Cong, X.; Han, Y. CGAN-Based Generative Design Method for Residential Areas’ Strong Drainage Scheme. J. Harbin Inst. Technol. 2021, 53, 111–121. [Google Scholar]
- Singaravel, S.; Suykens, J.; Geyer, P. Deep-learning neural-network architectures and methods: Using component-based models in building-design energy prediction. Adv. Eng. Inform. 2018, 38, 81–90. [Google Scholar] [CrossRef]
- Chaillou, S. AI and architecture: An experimental perspective. In The Routledge Companion to Artificial Intelligence in Architecture, 1st ed.; Routledge: London, UK, 2021; Volume 38, pp. 420–441. [Google Scholar]
- Ghosh, S.; Das, N.; Das, I.; Maulik, U. Understanding deep learning techniques for image segmentation. ACM Comput. Surv. 2019, 52, 73. [Google Scholar] [CrossRef]
- Goodfellow, I.; Pouget-Abadie, J.; Mirza, M.; Xu, B.; Warde-Farley, D.; Ozair, S.; Courville, A.; Bengio, Y. Generative adversarial networks. Commun. ACM 2020, 63, 139–144. [Google Scholar] [CrossRef]
- Yang, Z.; Gan, Z.; Wang, J.; Hu, X.; Ahmed, F.; Liu, Z.; Lu, Y.; Wang, L. UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling. In Proceedings of the Computer Vision—ECCV, Tel Aviv, Israel, 23–27 October 2022. [Google Scholar]
- Deng, M.; Tan, Y.; Singh, J.; Joneja, A.; Cheng, J.C. A BIM-based framework for automated generation of fabrication drawings for façade panels. Comput. Ind. 2021, 126, 103395. [Google Scholar] [CrossRef]
- Liu, Y.; Stouffs, R. Urban design process with conditional generative adversarial networks. Archit. J. 2018, 9, 108–111. [Google Scholar]
- Zheng, H. Drawing with Bots: Human-Computer Col-Laborative Drawing Experiments. In Proceedings of the 23rd International Conference on Computer-Aided Architectural Design Research in Asia: Learning, Prototyping and Adapting, Beijing, China, 17–19 May 2018; pp. 156–165. [Google Scholar]
- Shen, J.; Liu, C.; Ren, Y.; Zheng, H. Machine learning assisted urban filling. In Proceedings of the 25th CAADRIA Conference, Bangkok, Thailand, 5–6 August 2020; pp. 5–6. [Google Scholar]
- Cho, D.; Kim, J.; Shin, E.; Choi, J.; Lee, J.K. Recognizing architectural objects in floor-plan drawings using deep-learning style-transfer algorithms. In Proceedings of the 25th International Conference on Computer-Aided Architectural Design Research in Asia, Bangkok, Thailand, 5–6 August 2020; pp. 719–727. [Google Scholar]
- Isola, P.; Zhu, J.Y.; Zhou, T.; Efros, A.A. Image-to-image translation with conditional adversarial networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 1125–1134. [Google Scholar]
- Peters, N. Enabling Alternative Architectures: Collaborative Frameworks for Participatory Design. Ph.D. Thesis, Harvard University Graduate School of Design, Cambridge, MA, USA, 2022. [Google Scholar]
- Liu, Y.; Luo, Y.; Deng, Q.; Zhou, X. Exploration of Campus Layout Based on Generative Adversarial Network: Discussing the Significance of Small Amount Sample Learning for Architecture. In Proceedings of the 2020 DigitalFUTURES: The 2nd International Conference on Computational Design and Robotic Fabrication (CDRF 2020), Shanghai, China, 5–6 July 2020; pp. 169–178. [Google Scholar]
- Zhao, P.; Liao, W.; Huang, Y.; Lu, X. Intelligent design of shear wall layout based on graph neural networks. Adv. Eng. Inform. 2023, 55, 101886. [Google Scholar] [CrossRef]
- Yang, D.; Li, Q.; Fang, H.; Liu, Z. One day ahead prediction of global TEC using Pix2pixhd. Adv. Space Res. 2022, 70, 402–410. [Google Scholar] [CrossRef]
- Wang, T.C.; Liu, M.Y.; Zhu, J.Y.; Tao, A.; Kautz, J.; Catanzaro, B. High-resolution image synthesis and semantic manipulation with conditional gans. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–23 June 2018; pp. 8798–8807. [Google Scholar]
- Qu, Y.; Chen, Y.; Huang, J.; Xie, Y. Enhanced pix2pix dehazing network. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 15–20 June 2019. [Google Scholar]
- Mokhtar, S.; Sojka, A.; Davila, C.C. Conditional generative adversarial networks for pedestrian wind flow approximation. In Proceedings of the 11th Annual Symposium on Simulation for Architecture and Urban Design, Vienna, Austria, 25–27 May 2020. [Google Scholar]
- Wu, W.; Fu, X.M.; Tang, R.; Wang, Y.; Qi, Y.H.; Liu, L. Data-driven interior plan generation for residential buildings. ACM Trans. Graph. 2019, 38, 234. [Google Scholar] [CrossRef]
- ZHENG, H.; Keyao, A.N.; Jingxuan, W.E.I.; Yue, R.E.N. Apartment floor plans generation via generative adversarial networks. In Proceedings of the 25th International Conference of the Association for Computer-Aided Architectural Design Research in Asia (CAADRIA 2020): RE: Anthropocene, Design in the Age of Humans, Bangkok, Thailand, 5–6 August 2020. [Google Scholar]
- Anderson, C.; Bailey, C.; Heumann, A.; Davis, D. Augmented space planning: Using procedural generation to automate desk layouts. Int. J. Archit. Comput. 2018, 16, 164–177. [Google Scholar] [CrossRef]
- Tafraout, S.; Bourahla, N.; Bourahla, Y.; Mebarki, A. Automatic structural design of RC wall-slab buildings using a genetic algorithm with application in BIM environment. Autom. Constr. 2019, 106, 102901. [Google Scholar] [CrossRef]
- Nauata, N.; Chang, K.H.; Cheng, C.Y.; Mori, G.; Furukawa, Y. House-gan: Relational generative adversarial networks for graph-constrained house layout generation. In Proceedings of the Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, 23–28 August 2020. [Google Scholar]
- Long, J.; Shelhamer, E.; Darrell, T. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, 7–12 June 2015. [Google Scholar]
- Wang, Z.; Bovik, A.C.; Sheikh, H.R.; Simoncelli, E.P. Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Process. 2004, 13, 25–34. [Google Scholar] [CrossRef]
- Prasad, P.M.K.; Telagarapu, P.; Madhuri, G.U. Image compression using orthogonal wavelets viewed from peak signal to noise ratio and computation time. Int. J. Comput. Appl. 2012, 47, 25–34. [Google Scholar]
- Lu, L.; Neale, N.; Line, N.D.; Bonn, M. Improving data quality using Amazon mechanical Turk through platform setup. Cornell Hosp. Q. 2022, 63, 231–246. [Google Scholar] [CrossRef]
- Suebsuk, N.; Nakagawa, O. Sustainable Infrastructure and Conservation Ideas on Homestay Modification; Owners’ Motivation and Tourists’ Satisfaction in Amphawa, Thailand. Int. J. Eng. Technol. 2014, 41, 414. [Google Scholar] [CrossRef]
- Getz, D.; Carlsen, J. Characteristics and goals of family and owner-operated businesses in the rural tourism and hospitality sectors. Tour. Manag. 2000, 21, 547–560. [Google Scholar] [CrossRef]
- Chaves, M.S.; Gomes, R.; Pedron, C. Analysing reviews in the Web 2.0: Small and medium hotels in Portugal. Tour. Manag. 2012, 33, 1286–1287. [Google Scholar] [CrossRef]
- Demolingo, R.H.; Moniaga, N.E.P.; Karyatun, S.; Wiweka, K. Homestay Development Strategies in Cibodas Village. Int. J. Soc. Sci. Hum. Res. 2021, 4, 447–461. [Google Scholar] [CrossRef]
- Chen, J.; Su, Y.; Zong, D. Notes on the Construction of Manan House Langqing. Archit. J. 2016, 09, 90–95. [Google Scholar]
- Tian, J. Research on the renovation and design of traditional residential buildings. Design 2017, 19, 152–153. [Google Scholar]
- Dong, K. Research on the Design of Residential Renovation Homestay under the Background of Rural Tourism. Hous. Real Estate 2018, 31, 69–145. [Google Scholar]
- Mao, W.; Xie, D. Analysis of B&B Design Strategy Based on Low-Carbon Concept—Taking Moganshan Naked Heart Valley B&B as an Example. Build. Energy Conserv. 2019, 47, 86–89. [Google Scholar]
- Xu, X.; Yin, C.; Wu, Y. Preliminary Exploration to the Mountainous Architectural Design of the Mode of Container—The Case of the Sports Homestay in Jubao Mountain, Nanjing. Chin. Overseas Archit. 2018, 5, 124–126. [Google Scholar]
- Sufianto, H.; Baskara, M.; Sugiarto, B.; Citraningrum, A.; Adhitama, M.S. Architectural Concept for Homestay in Rural Area-A Case Study of Homestay Design in Sumbersari Village-Malang. IOP Conf. Ser. Earth Environ. Sci. 2019, 328, 012042. [Google Scholar] [CrossRef]
- Wan, D.; Zhao, R.; Zhang, S.; Liu, H.; Guo, L.; Li, P.; Ding, L. A Deep Learning-Based Approach to Generating Comprehensive Building Façades for Low-Rise Housing. Sustainability 2023, 15, 1816. [Google Scholar] [CrossRef]
- Sofiana, Y. Designing for behavioral change: Transforming of rural home into tourism facilities. In Proceedings of the IOP Conference Series: Earth and Environmental Science, Malang City, Indonesia, 12–13 March 2019. [Google Scholar]
Evaluation Indicators | A to B | B to C |
---|---|---|
PSNR (average) | 28.563 | 31.897 |
SSIM (average) | 0.856 | 0.889 |
Look at the Two Pictures below and Answer the Questions | |
---|---|
Question | Answer Options |
1. Please distinguish whether the above 2D-plan drawing is generated by AI or designed by designers. | A. AI generation B. Designer design |
2. Please evaluate the rationality of the 2D-plan drawing. (1 is unreasonable, 5 is very reasonable) | A. 1 B. 2 C. 3 D. 4 E. 5 |
Designer | Judging the Probability of AI or Designer Design | Quantitative Scoring | |||||
---|---|---|---|---|---|---|---|
Percentage of AI-Generated Images Marked as Designers | SEP-1 | Designer Design Score (Average out of 5) | AI Design Score (Average Out of 5) | Designer Design SEP-2 Score | AI Design SEP-2 Score | SEP-2 Score Difference | |
Expert | 63.20% | 68.50% | 3.50 | 3.30 | 3.60 | 3.05 | −13.01% |
Nonexpert | 73.8% | 3.81 | 3.54 |
Categories | Timeliness | Economy | Design Quality Stability |
---|---|---|---|
Designer | 3.5 h/preliminary design | Each item is charged at the market price | Depends on the designer’s experience |
M-StruGAN | 10 min/preliminary design | Efficient and fast operation with 0 fees | The design quality is stable |
Comparison | M-StruGAN design efficiency is 20 times faster | The design cost of M-StruGAN is much lower than the designer’s design cost | M-StruGAN design quality is more stable |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Gao, X.; Guo, X.; Lo, T. M-StruGAN: An Automatic 2D-Plan Generation System under Mixed Structural Constraints for Homestays. Sustainability 2023, 15, 7126. https://doi.org/10.3390/su15097126
Gao X, Guo X, Lo T. M-StruGAN: An Automatic 2D-Plan Generation System under Mixed Structural Constraints for Homestays. Sustainability. 2023; 15(9):7126. https://doi.org/10.3390/su15097126
Chicago/Turabian StyleGao, Xiaoni, Xiangmin Guo, and Tiantian Lo. 2023. "M-StruGAN: An Automatic 2D-Plan Generation System under Mixed Structural Constraints for Homestays" Sustainability 15, no. 9: 7126. https://doi.org/10.3390/su15097126