Study Design
This study was designed to evaluate the accuracy of three 3D printing technologies in reproducing clinically relevant anatomical models.
Accuracy was assessed in terms of precision and trueness, following the metrological definitions described in ISO 5725-1(13). Precision refers to how consistent repeated measurements are under the same conditions, reflecting the variability or spread (i.e., low variance).
Trueness describes how closely a measurement matches the reference value, reflecting systematic error (i.e., low bias). In this study, trueness indicates how closely a printed model matches its original STL file, while precision reflects how similar the printed models are to each other.
To evaluate precision and trueness, two experimental setups were used, as illustrated in Fig. 1. Precision was assessed by examining both intra-build variability (repeatability) and inter-build variability (reproducibility). Intra-build variability was measured by printing multiple copies of the same anatomical model simultaneously in a single build under identical conditions. Inter-build variability was assessed by printing the same models on different days using the same printer and settings.
All models used for precision assessment were subsequently also compared to their corresponding original STL files to evaluate trueness.
Figure 1. Methodological study design: Visual overview of the experimental workflow used to assess the accuracy of three 3D printing technologies (FFF, SLA, MJ) using clinically relevant anatomical models. Trueness was evaluated by comparing each printed model to its original STL reference (green arrow). Precision was assessed through intra-build variability and inter-build variability (red arrow), by comparing models printed simultaneously or across different builds.
Anatomical models and 3D printing workflow
Four different anatomical models were selected from a high-quality anatomically accurate skull model (SOMSO-Plast® Bauchene QS9/1, Coburg, Germany (14)): the sphenoid bone, frontal bone, zygomatic bone, and mandible. These models were chosen for their variability in size, geometry, and complexity. Each model was scanned using a MSCT with a high-resolution object scanning protocol. The scan settings were: slice thickness 0.6 mm, increment 0.4 mm, pitch 0.8, rotation time 1.0 s, effective mAs 420, with CARE Dose and CARE kV turned off. DICOM (Digital Imaging and Communications in Medicine) data from the MSCT was processed using Materialise Innovation Suite® (MIS, Leuven, Belgium). Segmentation was performed using a fixed threshold of -200 Hounsfield units (HU) across all models. The resulting voxel-based segmentations were converted into STL files for 3D printing.
Three 3D printing technologies were used.
The Felix Pro 3® printer was used for Fused Filament Fabrication (FFF), with a build volume of 237 × 244 × 235 mm. A 0.4 mm nozzle and a layer height of 200 microns were used, printing with PLA filament (15, 16).
The Formlabs Form 3B+® printer was used for Stereolithography (SLA), with a build volume of 145 × 145 × 165 mm. It printed with Formlabs Model Resin at a 100 micron layer thickness (17, 18). The The Stratasys J5 MediJet® printer was used for Material Jetting (MJ), offering a build volume of 140 × 200 × 190 mm and printing with MED620 material at a 27 micron layer thickness (19, 20).
All printers were properly calibrated prior to use. All prints were produced under identical conditions (temperature, relative humidity, conditioned room) using raw materials of equal age. Printer settings were based on the respective manufacturers' recommendations and were kept constant across builds to avoid introducing variability through slicing or process parameters.
After 3D printing, post-processing of the parts was performed. For FFF the supports were removed manually. The SLA printed parts first underwent a washing process of 10 minutes in ≥ 99% isopropyl alcohol (IPA), to remove any excess resin on the surface of the parts, and 5 minutes of post-curing at 60°C to achieve their optimal mechanical properties. Afterwards, the supports were removed manually. For MJ printed parts, the gel coat surrounding the parts is removed by submerging the parts in water followed using a water jet.
Precision assessment
For intra-build precision, multiple identical copies of each anatomical model were printed on the same build platform. The number of replicas per build was determined by the available build volume of each printer. For example, the MJ printer consistently produced four copies per model, while FFF and SLA produced two to three copies depending on the model size.
For inter-build precision, one copy of each model was printed on three separate occasions over the course of one week, using identical settings.
The consistency of each group of prints was evaluated by calculating the deviations between all possible pairwise combinations of the models within the same group (intra-build or inter-build). These deviations quantify how similar the models are to each other and reflect the precision of the printing process.
Trueness assessment
To evaluate trueness, each printed model was compared to the original segmented STL file. All models printed for intra-build and inter-build analysis were included in the trueness analysis. Thus, trueness was assessed across a range of build conditions and printers, providing a comprehensive picture of how faithfully each technology reproduces the reference geometry.
Optical scan of printed models
Each 3D printed model was scanned using an optical white light desktop 3D scanner (EinScan-SP, SHINING 3D Tech. Co., Ltd.). The scanner uses white light and coherence scanning interferometry (CSI) to perform non-contact surface digitization, with accuracy better than 50 microns (12, 21).
Each model was scanned in four orientations (cranial, caudal, left lateral, right lateral), and the scans were merged into a single non-watertight STL model. No post-processing (such as smoothing or hole filling) was applied. The final STL model was used for dimensional comparison with either the original STL file (for trueness) or other scans within the same group (for precision)(12).
Part comparison analysis and accuracy metric
The comparison analysis was performed in Materialise Mimics 18.0 (Materialise NV, Leuven, Belgium). STL files of both the 3D printed models and the original model were imported. For each analysis, the pair of STL models were aligned using a two-step process. An initial alignment was performed using six manually placed landmarks (N-point registration), followed by fine-tuning via global surface registration.
To quantify accuracy, a part comparison analysis was conducted subsequently, which is based on point-cloud comparison. This analysis measures deviations and calculates the Root Mean Square (RMS) deviation, which is the square root of the mean of the squared distances between corresponding surface points of the two aligned STL models. RMS reflects the overall magnitude of deviation, regardless of direction, making it more robust than the mean deviation (MD), which can be affected by the cancellation of positive and negative errors. Unlike MD, RMS accounts for both the distribution and magnitude of deviations and is therefore a more appropriate measure of overall dimensional error.
During this part comparison analysis, a heat map was generated to visually highlight areas of dimensional deviation (Fig. 2).
Figure 2: Demonstration of the part comparison analysis conducted in Materialise Mimics 18.0 (Materialise NV, Leuven, Belgium) for two 3D printed mandible models. First, the two models were aligned (N-point registration and global registration), then a point cloud part comparison analysis is carried out. A heat map shows the areas of aberrations.
RMS values were used as the primary outcome in the statistical analysis to evaluate the effects of printer type, anatomical model, and comparison type (intra-build, inter-build, trueness) on the accuracy of 3D printed models.
Statistical analysis
To address the complex and partially dependent structure of the data, a Linear Mixed Model (LMM) was employed (Fig. 3). LMMs are particularly well suited for datasets with repeated measures, hierarchical nesting, or clustering, as they allow the modelling of both fixed effects (systematic factors like printer type) and random effects (uncontrolled variability across clusters). This approach allows for more accurate estimation of fixed effects while controlling for within-group correlation. Because LMMs assume normally distributed residuals, the RMS values in this study were log-transformed to better meet this assumption and improve model fit.
The transformed RMS values were then used as the dependent variable in the LMM. Fixed effects included anatomical model, printer, and comparison type (intra-build, inter-build, and trueness). To correct for internal clustering of measurements under shared experimental conditions, a random intercept was added for each unique combination of anatomical model, printer, and comparison type.
Figue 3. Illustration of the linear mixed model used to analyze log-transformed RMS values (LogRMS). The model included fixed effects for anatomical model, printer type, and comparison type (shown in green). A random intercept was added for each unique combination of these three fixed factors (illustration of the clustering shown in red) to account for the hierarchical structure and repeated conditions in the experimental design. This modeling approach allows appropriate estimation of fixed effects while controlling for internal variance within clustered measurements.