Aes3D: Aesthetic Assessment in 3D Gaussian Splatting
arXiv:2605.05155v1 [cs.CV] 6 May 2026
Chuanzhi Xu1,*† Boyu Wei1,* Haoxian Zhou1 Xuanhua Yin1 Zihan Deng2 Haodong Chen1 Qiang Qu1 Weidong Cai1 1 The University of Sydney 2 The University of Hong Kong [email protected]
Abstract As 3D Gaussian Splatting (3DGS) gains attention in immersive media and digital content creation, assessing the aesthetics of 3D scenes becomes important in helping creators build more visually compelling 3D content. However, existing evaluation methods for 3D scenes primarily emphasize reconstruction fidelity and perceptual realism, largely overlooking higher-level aesthetic attributes such as composition, harmony, and visual appeal. This limitation comes from two key challenges: (1) the absence of general 3DGS datasets with aesthetic annotations, and (2) the intrinsic nature of 3DGS as a low-level primitive representation, which makes it difficult to capture high-level aesthetic features. To address these challenges, we propose Aes3D, the first systematic framework for assessing the aesthetics of 3D neural rendering scenes. Aes3D includes Aesthetic3D, the first dataset dedicated to 3D scene aesthetic assessment, built on our proposed annotation strategy for 3D scene aesthetics. In addition, we present Aes3DGSNet, a lightweight model that directly predicts scene-level aesthetic scores from 3DGS representations. Notably, our model operates solely on 3D Gaussian primitives, eliminating the need for rendering multi-view images and thus reducing computational cost and hardware requirements. Through aesthetics-supervised learning on multi-view 3DGS scene representations, Aes3DGSNet effectively captures high-level aesthetic cues and accurately regresses aesthetic scores. Experimental results demonstrate that our approach achieves strong performance while maintaining a lightweight design, establishing a new benchmark for 3D scene aesthetic assessment. Code and datasets will be made available in a future version.
1
Introduction
The recent development of 3D scene neural rendering and novel view synthesis (NVS), particularly 3D Gaussian Splatting (3DGS), has opened new opportunities for visual perception research [6, 14]. 3DGS explicitly models scenes using a set of anisotropic 3D Gaussian distributions, enabling highquality, real-time novel view synthesis [24]. Compared to Neural Radiance Fields (NeRF) [37], 3DGS significantly reduces training and rendering costs while maintaining or even improving rendering quality, demonstrating strong potential for applications in virtual reality, digital twins, and immersive media [6, 14]. As a result, assessing the perceptual quality of 3DGS-generated content has emerged as a research direction. Existing evaluation methods for 3DGS have mainly focused on reconstruction accuracy and perceptual quality metrics [35, 48]. Traditional metrics such as PSNR, SSIM, and LPIPS are widely used to measure reconstruction performance [24], but these metrics often fail to align with human perception in complex scenes. Recent studies have begun introducing subjective evaluation datasets and perceptual metrics [35, 48, 54, 58, 64] to better assess human visual experience, but most of these works still focus on the level of "realism" or "distortion degree" and do not reach higher-level visual assessment. * Equal contribution. † Corresponding author.
Preprint.
Aesthetic3D Dataset Annotation
Aes3DGSNet
Input Multiple Views
MLLM-based IAA Annotator
GS 3D tives mi i r P
Annotate S!$
Query 1
2
3
4
5
6
7
8
Scoring Samples
8 Attribute-level Scores Retrieval GT:0.74
S!#
S!%
Gaussian Scene Encoding
Candidate View Selection
Scene Tokens
View Tokens
S!"
Aggregate
Views
3D Aesthetic Label
(𝑺𝟑𝑫 ) Pred: 0.66
GT:0.58
Projection-based View Tokenization
Fusion & Regression
3DGS Aesthetic Score
3D Gaussian Splatting Pred: 0.62
GT:0.40
Pred: 0.37
GT:0.36
Pred: 0.39
GT:0.29
Pred: 0.28
Figure 1: Aes3D includes a method for IAA-based aesthetic annotation of 3D Scene datasets, upon which the Aesthetic3D dataset is constructed. It also includes Aes3DGSNet, a model capable of evaluating the aesthetic scores of 3DGS scenes. Some scoring examples are shown below. Image Aesthetic Assessment (IAA) has long been an important problem in computer vision, aiming to quantify subjective quality in human visual perception beyond low-level fidelity [11, 9]. Early work focused on 2D image aesthetics, capturing factors such as composition, color harmony, and lighting [10, 23, 33]. With advances in deep learning, large-scale datasets such as AVA and AADB [38, 26] have driven data-driven approaches, enabling CNN and Transformer-based models to learn aesthetic mappings from visual features [17, 2]. Video aesthetic assessment further introduces temporal complexity, including temporal consistency, motion dynamics, and shot transitions [51, 60]. In parallel, aesthetics-driven image enhancement and color grading have emerged, where models not only assess but also optimize visual appearance according to human preferences [57, 40, 12, 61]. However, aesthetic quality is not equivalent to perceptual quality. Aesthetic quality focuses on high-level, holistic semantic attributes such as visual appeal, artistic expressiveness, composition, color, and emotional expression [19, 5]. This distinction is particularly important in 3D scenes: a 3D scene reconstruction may achieve high accuracy in geometry and texture, but still lacks visual appeal or artistic expressiveness. Although some works have begun to explore 3D optimization based on human preferences [39, 65] or stylization methods [62, 13], there is no systematic framework for the aesthetic assessment of 3D neural-rendered scenes. We believe that 3D aesthetic assessment is inherently challenging. First, no general 3D scenes dataset with aesthetic-quality labels currently exists to support explicit modeling of aesthetic scores. Second, compared to 2D evaluation, the aesthetic quality of a 3D scene should emerge from the combination of aesthetic perceptions across multiple viewpoints, yet these perceptions may vary significantly across views. Furthermore, in the context of 3DGS aesthetic assessment, aesthetic quality depends not only on the rendered results but also on the underlying properties of the Gaussian distribution, including density, color, and geometry. We anticipate that addressing these challenges will be significant for enabling aesthetics-driven applications such as 3D rendering, editing, compression, and generation, and may provide aesthetic guidance for 3D animation and game graphics. In this paper, we propose Aes3D, the first academic study on assessing aesthetics for 3D neuralrendered scenes across general scene categories, including the Aesthetic3D dataset and the Aes3DGSNet, as shown in Figure 1. Our contributions can be summarized as: • Aesthetic3D Dataset. We construct the first 3D scene aesthetic dataset, Aesthetic3D, by designing an IAA-based annotation pipeline that employs a multimodal large language model (MLLM)-based aesthetic annotator to produce both overall aesthetic scores and fine-grained attribute-level sub-scores across 8 aesthetic dimensions, providing a foundation for 3D aesthetic assessment research. • Aes3DGSNet. We propose Aes3DGSNet, a novel network for scene-level aesthetic assessment from input of 3DGS primitives, enabling rendering-independent and view-aware aesthetic score prediction. It achieves general 3D aesthetic assessment for the first time. • Benchmark and Evaluation. Aes3D establishes the first benchmark for 3DGS aesthetic assessment based on Aesthetic3D, and shows that Aes3DGSNet achieves superior aesthetic 2
assessment performance with a lightweight architecture, demonstrating the effectiveness and research significance of Aes3D.
2
Related Work
Image Aesthetic Assessment. Early studies on image aesthetic assessment rely on handcrafted features derived from photographic rules such as composition, color harmony, and depth of field [10, 23, 33]. With the advent of deep learning, CNN-based methods enable automatic aesthetic feature learning, with early works [30, 31] validating their effectiveness and the large-scale AVA dataset [38] further driving progress. NIMA [47] improves subjectivity modeling by predicting score distributions instead of scalar scores. Subsequent research focuses on enhancing feature representation, including multi-patch aggregation and multi-level spatial pooling [46, 16], as well as attention mechanisms that emphasize salient regions [5]. More recently, advanced architectures and paradigms have been explored, such as graph-based modeling of region relationships [45], Transformer-based methods like MUSIQ [21] for long-range dependency modeling, and multimodal approaches (e.g., VILA [22]) that incorporate textual cues. Additionally, several works [59, 32, 66] consider user preference modeling for personalized assessment. Comprehensive surveys [11, 9, 1] further highlight the significance and practical value of image aesthetic assessment. However, all of these methods rely on single-view static images, whereas 3D representations, such as NeRF or 3DGS, exhibit multi-view consistency, spatial structure, and viewpoint-dependent appearance changes. As a result, 3D aesthetic assessment depends not only on the visual quality of every single view but also on the overall perception across views and spatial coherence. Perceptual Quality Assessment of 3D Neural Rendering (NeRF & 3DGS). With the rapid development of neural rendering methods (or NVS) such as NeRF and 3DGS, there is an increasing demand for reliable perceptual quality assessment. Early studies mainly relied on full-reference image quality metrics computed on rendered novel views, such as PSNR, SSIM, and LPIPS [24, 37]. However, these metrics often show weak correlation with human perception in complex scenarios involving view-dependent effects and temporal inconsistencies. For NeRF, many works constructed subjective datasets and employed pairwise comparison protocols to systematically analyze the perceptual quality of different NVS methods and their correlation with objective metrics, revealing that traditional metrics fail to reliably reflect video-level perceptual quality [28, 34, 49]. More recent approaches propose quality modeling frameworks that combine view-level and point-level features, enabling no-reference perceptual quality prediction without relying on ground-truth images [42, 43]. For 3DGS, mainstream methods also build dedicated datasets and design sampling strategies to render multi-view images or videos, in order to analyze the impact of different distortion factors (e.g., compression, resolution, and reconstruction errors) on visual quality [58, 64, 35, 7, 54]. More recent work further constructs synthetic datasets to explore no-reference quality prediction directly on 3D Gaussian primitives, avoiding the need for rendered images [48]. However, these evaluation paradigms rely heavily on viewpoint sampling strategies and camera trajectory design, making the evaluation more about the quality of the viewing path than the intrinsic quality of the 3D scene itself. Moreover, existing studies mainly focus on perceptual fidelity, such as structural consistency, texture clarity, and temporal stability, while paying limited attention to higher-level visual attributes, including aesthetic quality, composition, and visual appeal.
3
Aesthetic Annotation for 3D Scenes & Aesthetic3D Dataset
3.1
Motivation & Overview
One principled approach to aesthetic assessment of 3D scenes is to construct a dedicated dataset with human-annotated aesthetic scores. However, collecting such a dataset is highly expensive and labor-intensive, as it requires large-scale user studies across diverse scenes and viewpoints. On the other hand, aesthetic assessment for 2D images has been extensively studied, with mature models and well-established datasets. We believe that human aesthetic perception of 3D scenes is largely formed by aggregating aesthetic impressions from multiple viewpoints, combined with an additional sense of spatial structure unique to 3D. Importantly, the aesthetic perception at each individual viewpoint can still be reasonably approximated as a 2D image assessment problem. This is consistent with prior work in neural rendering perceptual quality assessment [28, 34, 49, 58, 64, 35], where 3D scene quality is commonly evaluated via rendered image or video sequences from multiple viewpoints. 3
Aesthetic3D Dataset Annotation MLLM-based IAA Annotator: ArtiMuse
Attr. 1
Attr. 2
Attr. 3
Attr. 4
Attr. 5
Attr. 6
Attr. 7
Attr. 8
Overall Score (𝑺𝑽𝒏)
Query
Rate
Input Multiple Views
Sub-Score 1
Sub-Score 2
Sub-Score 3
Sub-Score 4
Sub-Score 5
Sub-Score 6
Sub-Score 7
Sub-Score 8
Annotate
Textual Evaluation on 8 Aesthetic Attributes
Attribute-level Scores Retrieval
NVS S!$
S!#
S!% S!"
Aggregation
>>> Annotate >>>
3D Neural Rendering
Normalization
3D Aesthetic Label
(𝑺𝟑𝑫 )
Figure 2: Overview of IAA-based Annotation for constructing Aesthetic3D.
Motivated by this observation, we approximate 3D scene aesthetics by leveraging a state-of-the-art 2D aesthetic assessment model, ArtiMuse [4], as the annotator to score the input multiple views of 3D scene datasets. These scores are treated as proxy labels of human aesthetic perception at each viewpoint. We then aggregate the scores across all viewpoints to obtain a scene-level aesthetic score for each 3D rendering scene. Following this pipeline, we annotate two 3D scene datasets (DL3DV-10K [29], and Bilarf [50]), merge the scored samples, and construct a new benchmark dataset, termed the Aesthetic3D. An annotation schematic diagram can be found in Figure 2. Introduction of Selected IAA Annotator. ArtiMuse [4] is an MLLM-based image aesthetic assessment framework that jointly performs fine-grained aesthetic scoring and expert-level textual analysis. It is trained on ArtiMuse-10K, a dataset of 10,000 expert-annotated images evaluated across eight aesthetic dimensions: Composition & Design, Visual Elements & Structure, Technical Execution, Originality & Creativity, Theme & Communication, Emotion & Viewer Response, Overall Gestalt, and Comprehensive Evaluation. To enable precise fine-grained score prediction, ArtiMuse introduces Token As Score, a strategy that maps 101 ordered tokens from the existing tokenizer vocabulary to integer scores from 0 to 100, avoiding vocabulary expansion and quantization loss. Trained in a two-stage pipeline of text pretraining followed by LoRA-based score fine-tuning, ArtiMuse achieves state-of-the-art performance on multiple IAA benchmarks including AVA [38], PARA [59], TAD66K [15], and FLICKR-AES [44]. Furthermore, ArtiMuse demonstrates strong generalization capabilities across various image types (such as photography, paintings, and AIGC-generated images), and its multi-dimensional attribute modeling approach better aligns with the inherently multi-factorial nature of human aesthetics. For detailed explanation, please refer to Appendix D. Introduction of Selected 3D Scene Datasets. To construct the Aesthetic3D dataset, we select two widely used 3D scene datasets, DL3DV-10K (sampled subset) and Bilarf. By covering diverse scene types and visual characteristics, ranging from large-scale real-world environments to scenes with challenging lighting conditions, the combined datasets enable robust evaluation of aesthetic perception in 3DGS and improve the generalizability of learned models. More importantly, they reflect the types of 3D scenes that an individual user or a game/film producer would likely provide when seeking to evaluate scene aesthetics. For detailed explanation, please refer to Appendix C. 3.2
Aesthetic Annotation & Aesthetic Scores Aggregation
Aesthetic Annotation & Attribute-level Scores Retrieval. ArtiMuse provides a global aesthetic score together with textual evaluations over 8 aesthetic attributes. To obtain quantitative attributelevel labels, we further leverage its conversational inference interface and perform 8 independent attribute-scoring queries for each input view. For each attribute, we design a unified prompt: “Rate the aesthetic quality of this image from the aspect of {attr_name} on a 0–100 scale. Output only one number.” to query a single aesthetic score from the corresponding attribute perspective. The same image is then paired with 8 attribute prompts, producing 8 scoring outputs. This design has several advantages. First, it avoids training additional regression heads and directly uses the fine-grained aesthetic understanding already learned by ArtiMuse, effectively turning a generative model into a structured attribute scorer. Second, each attribute is evaluated using an explicit prompt, which improves interpretability and ensures that each score has a clear semantic meaning. Third, the 8 attribute scores are obtained through independent queries rather than a single coupled forward pass, making each score closer to an isolated judgment of one aesthetic factor, which is more suitable for 4