JENA Loader Benchmarks: Difference between revisions

From lotico
Jump to navigation Jump to search
← Older edit
No edit summary
 
(80 intermediate revisions by the same user not shown)
Line 1: Line 1:
tdbloader
==tdbloader==


{|
{|
Line 14: Line 14:
! user
! user
! sys
! sys
! storage size
! size on disk
! input
! input
! notes
|-
|-
|3.11
|3.11
|Ubuntu 19.04
|Ubuntu 19.04
|OpenJDK 11
|OpenJDK 11
|Intel i7-6700 CPU @ 3.40GHz
|Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz
|64GB
|64GB
|SSD
|SSD
|180,505,758
|180,505,758
|2,214.35
|2,214.35s
|81,516.25
|81,516.25
|37m6.921
|37m6.921s
|37m43.594
|37m43.594s
|0m53.788
|0m53.788s
|28G
|28G
|ttl.gz
|ttl.gz (1.16G)
|SSD=CT500MX500SSD1
|-
|-
|3.12
|3.13
|Ubuntu 19.04
|Ubuntu 19.04
|Open JDK 12.01
|Open JDK 12.01
|
|Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz
|
|64GB
|
|SSD
|
|180,505,758
|
|2,361.31s
|76,443.19
|39m31.724s
|40m53.732s
|0m48.914s
|28G
|ttl.gz (1.16G)
|SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
|-
|3.13
|Ubuntu 19.04
|Open JDK 12.01
|Intel(R) Core(TM) i5-3210M CPU @ 2.50GHz
|16GB
|HD
|180,505,758
|6,893.81s
|26,183.74
|168m59.657s
|76m50.081s
|3m48.615s
|28G
|ttl.gz (1.16G)
|-
|-
|3.13
|3.13
|Windows
|Ubuntu 19.04
|JDK 12.01
|Open JDK 12.01
|
|Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|
|256GB
|
|SSD
|180,505,758
|3,406.35
|52,990.90
|56m49.589s
|57m14.923s
|2m57.746s
|28G
|ttl.gz (1.16G)
|Azure VM EAST US Standard E32-16s_v3 (16 vcpus, 256 GiB memory)Premium SSD (30GiB) + 512GB
|-
|-
|}
|}


tdbloader2
==tdbloader2==


{|
{|
Line 65: Line 98:
! user
! user
! sys
! sys
! storage size
! size on disk
! input
! input
|-
|-
Line 71: Line 104:
|Ubuntu 19.04
|Ubuntu 19.04
|OpenJDK 11
|OpenJDK 11
|Intel i7-6700 CPU @ 3.40GHz
|Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz
|64GB
|64GB
|SSD
|SSD
|180,505,758
|180,505,758
|1,320.45
|1,320.45s
|136,700.08
|136,700.08
|33m38.361s
|33m38.361s
Line 81: Line 114:
|1m19.987s
|1m19.987s
|17G
|17G
|ttl.gz
|ttl.gz (1.16G)
|SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
|-
|-
|3.13
|3.13
|Ubuntu 19.04
|Ubuntu 19.04
|Open JDK 12.01
|Open JDK 12.01
|Intel(R) Core(TM) i5-3210M CPU @ 2.50GHz
|16GB
|HD
|180,505,758
|4451s(2,637.89s)
|68,428.11
|74m11.262s
|81m6.853s
|3m53.422s
|17G
|ttl.gz (1.16G)
|
|
|
|-
|
|3.13
|
|Ubuntu 19.04
|_
|Open JDK 12.01
|Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz
|64GB
|SSD
|180,505,758
|1999s(1,309.61s)
|137,831.80
|33m18.694s
|43m0.869s
|1m23.055s
|17G
|ttl.gz (1.16G)
|SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
|-
|3.13
|Ubuntu 19.04
|Open JDK 12.01
|Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|256GB
|SSD
|180,505,758
|2921s(2,132.71s)
|84,636.64
|48m40.710s
|63m6.416s
|3m1.636s
|17G
|ttl.gz (1.16G)
|Azure VM EAST US Standard E32-16s_v3 (16 vcpus, 256 GiB memory)Premium SSD (30GiB) + 512GB
|-
|}
|}


 
==tdb2.tdbloader==
tdb2.tdbloader


{|
{|
! style="text-align:left;"| Jena Version
! #
! style="text-align:left;"| Jena
! OS
! OS
! JDK Version
! JDK Version
Line 105: Line 179:
! # Triples
! # Triples
! Time
! Time
! Triples/sec
! Triples/sec / indexer
! real
! real
! user
! user
! sys
! sys
! storage size
! size on disk
! input
! compressed/uncompressed
! notes
|-
|-
|1
|3.11
|3.11
|Ubuntu 19.04
|Ubuntu 19.04
|OpenJDK 11
|OpenJDK 11
|Intel i7-6700 CPU @ 3.40GHz
|Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz
|64GB
|64GB
|SSD
|SSD
Line 121: Line 197:
|
|
|
|
|26m55.268
|26m55.268s
|45m29.688
|45m29.688s
|2m53.078
|2m53.078s
|28G
|28G
|ttl.gz
|ttl.gz (1.16G)
|SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
|-
|-
|2
|3.13
|3.13
|Ubuntu 19.04
|Ubuntu 19.04
|OpenJDK 12.01
|OpenJDK 12.01
|Intel i7-6700 CPU @ 3.40GHz
|Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz
|64GB
|64GB
|SSD
|SSD
|180,505,758
|1,497.453s
|120,542
|24m58.791s
|44m8.768s
|2m42.672s
|28G
|ttl.gz (1.16G)
|SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
|-
|3
|3.13
|Ubuntu 19.04
|OpenJDK 12.01
|Intel(R) Core(TM) i5-3210M CPU @ 2.50GHz
|16GB
|HD
|180,505,758
|180,505,758
|
|
|
|
|25m51.134s
|126m9.826s
|43m45.483s
|98m45.230s
|2m38.957s
|6m43.824s
|28G
|28G
|ttl.gz
|ttl.gz (1.16G)
|-
|-
|4
|3.13
|Ubuntu 19.04
|OpenJDK 12.01
|Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz
|64GB
|SSD
|180,505,758
|1,446.839s
|124,759
|24m8.094
|49m33.557s
|2m57.582s
|28G
|ttl.gz (1.16G)
| --loader=parallel SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
|-
|5
|3.13
|Ubuntu 19.04
|Open JDK 12.01
|Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
|256GB
|SSD
|180,505,758
|1,571.540
|114,859
|26m12.842s
|65m18.011s
|5m15.307s
|28G
|ttl.gz (1.16G)
| --loader=parallel;Azure VM EAST US Standard E32-16s_v3 (16 vcpus, 256 GiB memory)Premium SSD (30GiB) + 512GB
|-
|6
|3.13
|Ubuntu 19.04
|Open JDK 12.01
|Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz
|64GB
|NVMe SSD
|180,505,758
|741.577s
|243,408
|12m22.734s
|35m52.742s
|1m40.389s
|28G
|ttl.gz (1.16G)
| --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2
|-
|7a
|3.13
|Ubuntu 20.04*<br>(5.4.0-37-generic)
|Open JDK 12.01
|Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz
|64GB
|NVMe SSD
|180,505,758
|1552.857s
|116,241
|25m59.561s
|47m1.060s
|3m48.757s
|39G
|ttl.gz (770M/4G)
| --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
|-
|7b
|3.15
|Ubuntu 20.04*<br>(5.4.0-39-generic)
|Open JDK 12.01
|
|
|
|180,505,759
|1,519.713
|118,776
|25m21.039s
|46m40.163s
|3m33.435s
|39G
|ttl.gz (770M/4G)
| --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
|-
|7c
|3.15
|Ubuntu 20.04*<br>(5.4.0-40-generic)
|Open JDK 12.01
|
|
|
|180,505,759
|1,482.566s
|121,752
|24m43.948s
|45m54.528s
|3m27.487s
|39G
|ttl.gz (770M/4G)
| --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
|-
|7d
|3.15
|Ubuntu 20.04*<br>(5.4.0-37-generic)
|Open JDK 13.02
|
|
|
|180,505,758
|1,855.803s
|97,266
|30m57.179s
|54m13.804s
|3m44.125s
|39G
|ttl.gz (770M/4G)
| --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
|-
|8
|3.13
|Ubuntu 20.04 LTS
|Open JDK 13.0.2
|Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz
|64GB
|NVMe SSD
|1,000,000,001
|12874.74s
|77,671
|215m3.603s
|328m43.471s
|43m33.704s
|214G
|ttl.gz/.ttl (4.2G/23G )
| --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
|-
|9
|3.15
|Ubuntu 20.04 LTS
|Open JDK 13.0.2
|Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz
|64GB
|NVMe SSD
|1,000,000,001
|12993.75s
|76,799
|217m2.838s
|333m58.845s
|43m51.748s
|214G
|ttl.gz/.ttl (4.2G/23G )
| --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
|-
|10
|3.15
|Ubuntu 20.04 LTS
|Open JDK 12.0.1
|Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz
|64GB
|NVMe SSD
|1,000,000,001
|11,467.457
|87,203
|191m9.179s
|301m50.424s
|42m50.488s
|214G
|ttl.gz/.ttl (4.2G/23G )
| --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
|-
|11
|4.8
|Ubuntu 22.04.2 LTS
|Open JDK 19.0.2
|Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz
|64GB
|NVMe SSD
|180,524,233
|1,303.463
|219,154/138,496
|21m45.282s
|39m13.822s
|2m29.940s
|28G
|ttl.gz/.ttl (1.2G/20G )
| --loader=phased;RAM=128GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
|-
|12
|4.8
|Ubuntu 22.04.2 LTS
|Open JDK 19.0.2
|Intel(R) Core(TM) i9-13900 CPU
|64GB
|NVMe SSD
|180,524,233
|767.214 sec
|354,735/235,298
|12m48.258s
|25m14.011s
|1m52.646s
|28G
|ttl.gz/.ttl (1.2G/20G )
| --loader=phased;RAM=64GB DIMM DDR5 4800MHz Samsung unbuffered, Samsung PM9A3 PCIe® Gen4 x4 RAID1
|-
|13
|4.8
|Ubuntu 22.04.2 LTS
|Open JDK 19.0.2
|Intel(R) Core(TM) i9-13900 CPU
|64GB
|NVMe SSD
|180,524,233
|526.929 sec
|342,597
|8m48.018
|25m0.701s
|2m5.309s
|28G
|ttl.gz/.ttl (1.2G/20G )
| --loader=parallel;RAM=64GB DIMM DDR5 4800MHz Samsung unbuffered, Samsung PM9A3 PCIe® Gen4 x4 RAID1
|}
|}
* performance regression might be related to a bug with ZFS in Ubuntu 20.04 LTS which can be fixed with a v5.6.18 Mainline kernel patch  https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.6.18/ (not yet tested)

Latest revision as of 15:20, 15 March 2023

tdbloader

Jena Version OS JDK Version CPU Memory HD/SSD # Triples Time Triples/sec real user sys size on disk input notes
3.11 Ubuntu 19.04 OpenJDK 11 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 2,214.35s 81,516.25 37m6.921s 37m43.594s 0m53.788s 28G ttl.gz (1.16G) SSD=CT500MX500SSD1
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 2,361.31s 76,443.19 39m31.724s 40m53.732s 0m48.914s 28G ttl.gz (1.16G) SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Core(TM) i5-3210M CPU @ 2.50GHz 16GB HD 180,505,758 6,893.81s 26,183.74 168m59.657s 76m50.081s 3m48.615s 28G ttl.gz (1.16G)
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 256GB SSD 180,505,758 3,406.35 52,990.90 56m49.589s 57m14.923s 2m57.746s 28G ttl.gz (1.16G) Azure VM EAST US Standard E32-16s_v3 (16 vcpus, 256 GiB memory)Premium SSD (30GiB) + 512GB

tdbloader2

Jena Version OS JDK Version CPU Memory HD/SSD # Triples Time Triples/sec real user sys size on disk input
3.11 Ubuntu 19.04 OpenJDK 11 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 1,320.45s 136,700.08 33m38.361s 43m25.897s 1m19.987s 17G ttl.gz (1.16G) SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Core(TM) i5-3210M CPU @ 2.50GHz 16GB HD 180,505,758 4451s(2,637.89s) 68,428.11 74m11.262s 81m6.853s 3m53.422s 17G ttl.gz (1.16G)
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 1999s(1,309.61s) 137,831.80 33m18.694s 43m0.869s 1m23.055s 17G ttl.gz (1.16G) SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 256GB SSD 180,505,758 2921s(2,132.71s) 84,636.64 48m40.710s 63m6.416s 3m1.636s 17G ttl.gz (1.16G) Azure VM EAST US Standard E32-16s_v3 (16 vcpus, 256 GiB memory)Premium SSD (30GiB) + 512GB

tdb2.tdbloader

# Jena OS JDK Version CPU Memory HD/SSD # Triples Time Triples/sec / indexer real user sys size on disk compressed/uncompressed notes
1 3.11 Ubuntu 19.04 OpenJDK 11 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 26m55.268s 45m29.688s 2m53.078s 28G ttl.gz (1.16G) SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
2 3.13 Ubuntu 19.04 OpenJDK 12.01 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 1,497.453s 120,542 24m58.791s 44m8.768s 2m42.672s 28G ttl.gz (1.16G) SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
3 3.13 Ubuntu 19.04 OpenJDK 12.01 Intel(R) Core(TM) i5-3210M CPU @ 2.50GHz 16GB HD 180,505,758 126m9.826s 98m45.230s 6m43.824s 28G ttl.gz (1.16G)
4 3.13 Ubuntu 19.04 OpenJDK 12.01 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 1,446.839s 124,759 24m8.094 49m33.557s 2m57.582s 28G ttl.gz (1.16G) --loader=parallel SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
5 3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 256GB SSD 180,505,758 1,571.540 114,859 26m12.842s 65m18.011s 5m15.307s 28G ttl.gz (1.16G) --loader=parallel;Azure VM EAST US Standard E32-16s_v3 (16 vcpus, 256 GiB memory)Premium SSD (30GiB) + 512GB
6 3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 180,505,758 741.577s 243,408 12m22.734s 35m52.742s 1m40.389s 28G ttl.gz (1.16G) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2
7a 3.13 Ubuntu 20.04*
(5.4.0-37-generic) 		Open JDK 12.01 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 180,505,758 1552.857s 116,241 25m59.561s 47m1.060s 3m48.757s 39G ttl.gz (770M/4G) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
7b 3.15 Ubuntu 20.04*
(5.4.0-39-generic) 		Open JDK 12.01 180,505,759 1,519.713 118,776 25m21.039s 46m40.163s 3m33.435s 39G ttl.gz (770M/4G) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
7c 3.15 Ubuntu 20.04*
(5.4.0-40-generic) 		Open JDK 12.01 180,505,759 1,482.566s 121,752 24m43.948s 45m54.528s 3m27.487s 39G ttl.gz (770M/4G) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
7d 3.15 Ubuntu 20.04*
(5.4.0-37-generic) 		Open JDK 13.02 180,505,758 1,855.803s 97,266 30m57.179s 54m13.804s 3m44.125s 39G ttl.gz (770M/4G) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
8 3.13 Ubuntu 20.04 LTS Open JDK 13.0.2 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 1,000,000,001 12874.74s 77,671 215m3.603s 328m43.471s 43m33.704s 214G ttl.gz/.ttl (4.2G/23G ) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
9 3.15 Ubuntu 20.04 LTS Open JDK 13.0.2 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 1,000,000,001 12993.75s 76,799 217m2.838s 333m58.845s 43m51.748s 214G ttl.gz/.ttl (4.2G/23G ) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
10 3.15 Ubuntu 20.04 LTS Open JDK 12.0.1 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 1,000,000,001 11,467.457 87,203 191m9.179s 301m50.424s 42m50.488s 214G ttl.gz/.ttl (4.2G/23G ) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
11 4.8 Ubuntu 22.04.2 LTS Open JDK 19.0.2 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 180,524,233 1,303.463 219,154/138,496 21m45.282s 39m13.822s 2m29.940s 28G ttl.gz/.ttl (1.2G/20G ) --loader=phased;RAM=128GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
12 4.8 Ubuntu 22.04.2 LTS Open JDK 19.0.2 Intel(R) Core(TM) i9-13900 CPU 64GB NVMe SSD 180,524,233 767.214 sec 354,735/235,298 12m48.258s 25m14.011s 1m52.646s 28G ttl.gz/.ttl (1.2G/20G ) --loader=phased;RAM=64GB DIMM DDR5 4800MHz Samsung unbuffered, Samsung PM9A3 PCIe® Gen4 x4 RAID1
13 4.8 Ubuntu 22.04.2 LTS Open JDK 19.0.2 Intel(R) Core(TM) i9-13900 CPU 64GB NVMe SSD 180,524,233 526.929 sec 342,597 8m48.018 25m0.701s 2m5.309s 28G ttl.gz/.ttl (1.2G/20G ) --loader=parallel;RAM=64GB DIMM DDR5 4800MHz Samsung unbuffered, Samsung PM9A3 PCIe® Gen4 x4 RAID1 
* performance regression might be related to a bug with ZFS in Ubuntu 20.04 LTS which can be fixed with a v5.6.18 Mainline kernel patch  https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.6.18/ (not yet tested)
Retrieved from "http://www.lotico.com/index.php?title=JENA_Loader_Benchmarks&oldid=5918"