Browse Source

Add benchmark results

nagadomi 9 years ago
parent
commit
0991a98ea4
1 changed files with 38 additions and 0 deletions
  1. 38 0
      appendix/benchmark.md

+ 38 - 0
appendix/benchmark.md

@@ -0,0 +1,38 @@
+# Benchmark results
+
+
+## dataset
+
+    photo_set: 300 various photos.
+    art_set  : 90 artworks (PNG only).
+
+## 2x upscaling model
+
+| Dataset/Model | anime\_style\_art(Y) | anime\_style\_art\_rgb | photo   | ukbench|
+|---------------|----------------------|------------------------|---------|--------|
+| photo\_test   |                29.83 |                  29.81 |**29.89**|  29.86 |
+| art\_test     |                36.02 |               **36.24**|  34.92  |  34.85 |
+
+The evaluation metric is PSNR(Y only), higher is better.
+
+## Denosing level 1 model
+
+| Dataset/Model            | anime\_style\_art | anime\_style\_art\_rgb | photo   |
+|--------------------------|-------------------|------------------------|---------|
+| photo\_test Quality 80   |             36.07 |               **36.20**|   36.01 |
+| photo\_test Quality 50,45|             31.72 |                 32.01  |**32.31**|
+| art\_test Quality 80     |             40.39 |               **42.48**|   40.35 |
+| art\_test Quality 50,45  |             35.45 |               **36.70**|   36.27 |
+
+The evaluation metric is PSNR(RGB), higher is better.
+
+## Denosing level 2 model
+
+| Dataset/Model            | anime\_style\_art | anime\_style\_art\_rgb | photo   |
+|--------------------------|-------------------|------------------------|---------|
+| photo\_test Quality 80   |             34.03 |                  34.42 |**36.06**|
+| photo\_test Quality 50,45|             31.95 |                  32.31 |**32.42**|
+| art\_test Quality 80     |             39.20 |               **41.12**|   40.48 |
+| art\_test Quality 50,45  |             36.14 |               **37.78**|   36.55 |
+
+The evaluation metric is PSNR(RGB), higher is better.