[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building flink-ml 1.3-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-checkstyle-plugin:2.17:check (validate) @ flink-ml_2.10 ---
[INFO]
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-maven) @ flink-ml_2.10 ---
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ flink-ml_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ flink-ml_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /Users/fokkodriesprong/Desktop/flink-test/flink-libraries/flink-ml/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ flink-ml_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- scala-maven-plugin:3.2.2:compile (default) @ flink-ml_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ flink-ml_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ flink-ml_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- scala-maven-plugin:3.2.2:testCompile (default) @ flink-ml_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-surefire-plugin:2.18.1:test (default-test) @ flink-ml_2.10 ---
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (scala-test) @ flink-ml_2.10 ---
Discovery starting.
Discovery completed in 270 milliseconds.
Run starting. Expected test count is: 67
FlinkMLToolsSuite:
FlinkMLTools
- should register the required types
DistributedRowMatrixSuite:
DistributedRowMatrix
- should contain the initialization data
- should return the correct dimensions when provided by the user
- should return a sparse local matrix containing the initialization data
- should return a dense local matrix containing the initialization data
add
- should correctly add two distributed row matrices
DenseMatrixSuite:
Flink's DenseMatrix
- should contain the initialization data
- should fail in case of invalid element access
- should be copyable
QuadTreeSuite:
QuadTree Class
- should partition into equal size sub-boxes and search for nearby objects properly
DistanceMetricSuite:
Distance Measures
- should calculate Euclidean distance correctly
- should calculate square value of Euclidean distance correctly
- should calculate Chebyshev distance correctly
- should calculate Cosine distance correctly
- should calculate Manhattan distance correctly
- should calculate Minkowski distance correctly
- should calculate Tanimoto distance correctly
- should be serialized
MLUtilsSuite:
The RichExecutionEnvironment
- should read a libSVM/SVMLight input file
- should write a libSVM/SVMLight output file
BreezeMathSuite:
Breeze vector conversion
- should convert a DenseMatrix into breeze.linalg.DenseMatrix and vice versa
- should convert a SparseMatrix into breeze.linalg.CSCMatrix
- should convert a dense Flink vector into a dense Breeze vector and vice versa
- should convert a sparse Flink vector into a sparse Breeze vector and given the right converter back into a dense Flink vector
DenseVectorSuite:
Flink's DenseVector
- should contain the initialization data
- should fail in case of an illegal element access
- should calculate dot product with DenseVector
- should calculate dot product with SparseVector
- should calculate dot product with SparseVector 2
- should fail in case of calculation dot product with different size vector
- should calculate outer product with DenseVector correctly as DenseMatrix
- should calculate outer product with SparseVector correctly as SparseMatrix
- should calculate outer product with a DenseVector correctly as DenseMatrix 2
- should calculate outer product with a SparseVector correctly as SparseMatrix 2
- should DenseVector right outer product with one-dimensional DenseVector as identity
- should DenseVector right outer product with one-dimensional SparseVector as identity
- should DenseVector left outer product with one-dimensional unit DenseVector as identity
- should SparseVector left outer product with one-dimensional unit DenseVector as identity
- should DenseVector outer product via multiplication if both vectors are one-dimensional
- should SparseVector outer product via multiplication if both vectors are one-dimensional
- should calculate magnitude of vector
- should convert from and to Breeze vector
SparseVectorSuite:
Flink's SparseVector
- should contain a single element provided as coordinate list (COO)
- should contain the initialization data provided as coordinate list (COO)
- should fail when accessing elements using an invalid index
- should fail when the COO list contains elements with invalid indices
- should be copyable
- should calculate dot product with SparseVector
- should calculate dot product with SparseVector 2
- should calculate dot product with DenseVector
- should fail in case of calculation dot product with different size vector
- should calculate outer product with SparseVector correctly as SparseMatrix
- should calculate outer product with DenseVector correctly as SparseMatrix
- should calculate outer product with a DenseVector correctly as SparseMatrix 2
- should calculate outer product with a SparseVector correctly as SparseMatrix 2
- should calculate right outer product with DenseVector
with one-dimensional unit DenseVector as identity
- should calculate right outer product with DenseVector
with one-dimensional unit SparseVector as identity
- should calculate left outer product for SparseVector
with one-dimensional unit DenseVector as identity
- should calculate outer product with SparseVector
via multiplication if both vectors are one-dimensional
- should calculate outer product with DenseVector
via multiplication if both vectors are one-dimensional
- should calculate magnitude of vector
- should convert from and to Breeze vectors
SparseMatrixSuite:
Flink's SparseMatrix
- should contain a single element provided as a coordinate list (COO)
- should be initialized from a coordinate list representation (COO)
- should fail when accessing zero elements or using invalid indices
- should fail when elements of the COO list have invalid indices
- should be copyable
Run completed in 3 seconds, 652 milliseconds.
Total number of tests run: 67
Suites: completed 11, aborted 0
Tests: succeeded 67, failed 0, canceled 0, ignored 0, pending 0
All tests passed.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ flink-ml_2.10 ---
[INFO] Building jar: /Users/fokkodriesprong/Desktop/flink-test/flink-libraries/flink-ml/target/flink-ml_2.10-1.3-SNAPSHOT.jar
[INFO]
[INFO] --- maven-site-plugin:3.5.1:attach-descriptor (attach-descriptor) @ flink-ml_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.4.1:shade (shade-flink) @ flink-ml_2.10 ---
[INFO] Excluding org.scalamacros:quasiquotes_2.10:jar:2.0.1 from the shaded jar.
[INFO] Excluding org.scalanlp:breeze_2.10:jar:0.12 from the shaded jar.
[INFO] Excluding org.scalanlp:breeze-macros_2.10:jar:0.12 from the shaded jar.
[INFO] Excluding com.github.fommil.netlib:core:jar:1.1.2 from the shaded jar.
[INFO] Excluding net.sourceforge.f2j:arpack_combined_all:jar:0.1 from the shaded jar.
[INFO] Excluding net.sf.opencsv:opencsv:jar:2.3 from the shaded jar.
[INFO] Excluding com.github.rwl:jtransforms:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.spire-math:spire_2.10:jar:0.7.4 from the shaded jar.
[INFO] Excluding org.spire-math:spire-macros_2.10:jar:0.7.4 from the shaded jar.
[INFO] Excluding com.chuusai:shapeless_2.10.4:jar:2.0.0 from the shaded jar.
[INFO] Including org.apache.flink:force-shading:jar:1.3-SNAPSHOT in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /Users/fokkodriesprong/Desktop/flink-test/flink-libraries/flink-ml/target/flink-ml_2.10-1.3-SNAPSHOT.jar with /Users/fokkodriesprong/Desktop/flink-test/flink-libraries/flink-ml/target/flink-ml_2.10-1.3-SNAPSHOT-shaded.jar
[INFO] Replacing original test artifact with shaded test artifact.
[INFO] Replacing /Users/fokkodriesprong/Desktop/flink-test/flink-libraries/flink-ml/target/flink-ml_2.10-1.3-SNAPSHOT-tests.jar with /Users/fokkodriesprong/Desktop/flink-test/flink-libraries/flink-ml/target/flink-ml_2.10-1.3-SNAPSHOT-shaded-tests.jar
[INFO] Dependency-reduced POM written at: /Users/fokkodriesprong/Desktop/flink-test/flink-libraries/flink-ml/target/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /Users/fokkodriesprong/Desktop/flink-test/flink-libraries/flink-ml/target/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /Users/fokkodriesprong/Desktop/flink-test/flink-libraries/flink-ml/target/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-javadoc-plugin:2.9.1:jar (attach-javadocs) @ flink-ml_2.10 ---
[INFO]
[INFO] --- maven-assembly-plugin:2.4:single (make-assembly) @ flink-ml_2.10 ---
[INFO] Building jar: /Users/fokkodriesprong/Desktop/flink-test/flink-libraries/flink-ml/target/flink-ml_2.10-1.3-SNAPSHOT-jar-with-dependencies.jar
[INFO]
[INFO] --- maven-surefire-plugin:2.18.1:test (integration-tests) @ flink-ml_2.10 ---
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (integration-test) @ flink-ml_2.10 ---
Discovery starting.
Discovery completed in 322 milliseconds.
Run starting. Expected test count is: 49
SplitterITSuite:
Flink's DataSet Splitter
- should result in datasets with no elements in common and all elements used
- should result in datasets of an expected size when precise
- should result in expected number of datasets
- should produce TrainTestDataSets in which training size is greater than testing size
- should throw an exception if sample fraction ins nonsensical
MultipleLinearRegressionITSuite:
The multiple linear regression implementation
Jan 27, 2017 10:58:46 AM com.github.fommil.netlib.BLAS <clinit>
WARNING: Failed to load implementation from: com.github.fommil.netlib.NativeSystemBLAS
Jan 27, 2017 10:58:46 AM com.github.fommil.netlib.BLAS <clinit>
WARNING: Failed to load implementation from: com.github.fommil.netlib.NativeRefBLAS
- should estimate a linear function
- should work with sparse vectors as input
- should estimate a cubic function
- should make (mostly) correct predictions
PredictionFunctionITSuite:
The optimization framework prediction functions
- should correctly calculate linear predictions
- should correctly calculate the gradient for linear predictions
ALSITSuite:
The alternating least squares (ALS) implementation
Jan 27, 2017 10:58:49 AM com.github.fommil.netlib.LAPACK <clinit>
WARNING: Failed to load implementation from: com.github.fommil.netlib.NativeSystemLAPACK
Jan 27, 2017 10:58:49 AM com.github.fommil.netlib.LAPACK <clinit>
WARNING: Failed to load implementation from: com.github.fommil.netlib.NativeRefLAPACK
- should properly factorize a matrix
PolynomialFeaturesITSuite:
The polynomial base implementation
- should map single element vectors to the polynomial vector space
- should map vectors to the polynomial vector space
- should return an empty vector if the max degree is zero
StochasticOutlierSelectionITSuite:
Stochastic Outlier Selection algorithm
- should Compute the perplexity of the vector and return the correct error
- should Compute the distance matrix and give symmetrical distances
- should Compute the distance matrix and give the correct distances
- should Computing the affinity matrix and return the correct affinity
- should Compute the binding probabilities and return the correct probabilities
- should Compute the product of the vector, should return the correct values
- should Verifying the output of the SOS algorithm assign the one true outlier
MinMaxScalerITSuite:
Flink's MinMax Scaler
- should scale the vectors' values to be restricted in the [0.0,1.0] range
- should scale vectors' values in the [-1.0,1.0] range
StandardScalerITSuite:
Flink's Standard Scaler
- should scale the vectors to have mean equal to 0 and std equal to 1
- should scale the vectors to have mean equal to 10 and standard deviation equal to 2
- should work with LabeledVector
- should work with (FlinkVector, Double) tuples
LossFunctionITSuite:
The optimization Loss Function implementations
- should calculate squared loss and gradient correctly
PipelineITSuite:
Flink's pipelines
- should support chaining of compatible transformer
- should throw an exception when the pipeline operators are not compatible
- should throw an exception when the input data is not supported
- should support multiple transformers and a predictor
- should throw an exception when the input data is not supported by a predictor
SVMITSuite:
The SVM using CoCoA implementation
- should train a SVM
- should make (mostly) correct predictions
- should be possible to get the raw decision function values
GradientDescentITSuite:
The Stochastic Gradient Descent implementation
- should correctly solve an L1 regularized regression problem
- should correctly perform one step with L2 regularization
- should estimate a linear function
- should estimate a linear function without an intercept
- should correctly perform one step of the algorithm with initial weights provided
- should terminate early if the convergence criterion is reached
- should come up with similar parameter estimates with xu step-size strategy
KNNITSuite:
The KNN Join Implementation
- should throw an exception when the given K is not valid
- should throw an exception when the given count of blocks is not valid
- should calculate kNN join correctly without using a Quadtree
- should calculate kNN join correctly with a Quadtree
- should throw an exception when using a Quadtree with an incompatible metric
Run completed in 22 seconds, 215 milliseconds.
Total number of tests run: 49
Suites: completed 14, aborted 0
Tests: succeeded 49, failed 0, canceled 0, ignored 0, pending 0
All tests passed.
[INFO]
[INFO] --- scalastyle-maven-plugin:0.8.0:check (default) @ flink-ml_2.10 ---
Saving to outputFile=/Users/fokkodriesprong/Desktop/flink-test/flink-libraries/flink-ml/target/scalastyle-output.xml
Processed 76 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 1281 ms
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 41.055 s
[INFO] Finished at: 2017-01-27T10:59:06+01:00
[INFO] Final Memory: 44M/833M
[INFO] ------------------------------------------------------------------------