High Performance Data Analytics Using Java

Download Report

Transcript High Performance Data Analytics Using Java

High Performance Machine Learning Using Java
0,6
0,4
Java OpenMPI
20
15
10
0
0
TxPxN
6
C# MPI.NET
5,5
5
Java OpenMPI
4,5
4
4
3,5
3
MPI Allreduce (top) and Ping-Pong
(bottom) Benchmarks with Infiniband
1
3
21
1,5
1
1
1
2
4
Parallelism
8
1
2
4
8
Parallelism
Deterministic Annealing Vector Sponge Charge5 (left) and
Charge2 (right) Performance
1
0
Parallelism
Parallelism
Deterministic Annealing Pairwise
Clustering Performance
256
1,5
0,5
64
2
128
2
32
512KB
128KB
8KB
32KB
2KB
512B
128B
32B
8B
2B
0B
1
3,5
2,5
2,5
10
1,5
8
Time (us)
100
4,5
Speedup
Speedup
C OpenMPI
16
Java OpenMPI
41
C# MPI.NET
Java OpenMPI
5
4
Java FastMPJ
2
5,5
2
C# MPI.NET
Message size (bytes)
61
2,5
1
10000
1000
3
TxPxN
Message size (bytes)
81
1
2
4
8
16
32
64
128
256
4MB
1MB
64KB
256KB
16KB
4KB
1KB
256B
64B
4B
16B
5
5
Java OpenMPI
4
3,5
50
0,2
101
Time (hours)
Time (us)
500
Java OpenMPI
0,8
Java OpenMPI
C# MPI.NET
25
Time (hours)
5000
C# MPI.NET
1
Time (hours)
50000
4,5
30
Speedup
1,2
C# MPI.NET
Java FastMPJ
Java OpenMPI
C OpenMPI