wie man spark 2.0.0 Vorschau in Java

Question

Ich möchte Bibliotheken von Spark 2.0.0 Vorschau-Version, importieren, aber es gibt keine Funken 2 in Maven Repository jetzt. Ich habe die vorgeschlagene Lösung in here verwendet. aber es hat nicht funktioniert: der Fehler ist:

The POM for org.apache.spark:spark-core_2.2.11:jar:2.0.0-SNAPSHOT is missing, no dependency information available 
The POM for org.apache.spark:spark-mllib_2.11:jar:2.0.0-SNAPSHOT is missing, no dependency information available 
The POM for org.apache.spark:spark-sql_2.2.11:jar:2.0.0-SNAPSHOT is missing, no dependency information available 
------------------------------------------------------------------------ 
BUILD FAILURE 

The following artifacts could not be resolved: org.apache.spark:spark-core_2.2.11:jar:2.0.0-SNAPSHOT, org.apache.spark:spark-mllib_2.11:jar:2.0.0-SNAPSHOT, org.apache.spark:spark-sql_2.2.11:jar:2.0.0-SNAPSHOT: Could not find artifact org.apache.spark:spark-core_2.2.11:jar:2.0.0-SNAPSHOT -> [Help 1] 

meine pom-Datei looklike ist dies:

 <dependency> 
      <groupId>org.apache.spark</groupId> 
      <artifactId>spark-core_2.2.11</artifactId> 
      <version>2.0.0-SNAPSHOT</version> 
     </dependency> 
     <dependency> 
      <groupId>org.apache.spark</groupId> 
      <artifactId>spark-mllib_2.11</artifactId> 
      <version>2.0.0-SNAPSHOT</version> 
     </dependency> 
     <dependency> 
      <groupId>org.apache.spark</groupId> 
      <artifactId>spark-sql_2.2.11</artifactId> 
      <version>2.0.0-SNAPSHOT</version> 
     </dependency> 

Answer 1

diese in Ihre pom.xml:

<repositories> 
    <repository> 
     <id>asf-snapshot</id> 
     <url>http://repository.apache.org/snapshots</url> 
     <snapshots> 
      <enabled>true</enabled> 
     </snapshots> 
    </repository> 
</repositories> 

Answer 2

2.0.0-preview ist verfügbar unter Apache Spark Core 2.11. Sie können Ihre pom.xml wie folgt ändern:

<properties> 
    <spark.version>2.0.0-preview</spark.version> 
</properties> 

<dependencies> 
    <dependency> 
     <groupId>org.apache.spark</groupId> 
     <artifactId>spark-core_2.11</artifactId> 
     <version>${spark.version}</version> 
    </dependency> 
    <dependency> 
     <groupId>org.apache.spark</groupId> 
     <artifactId>spark-sql_2.11</artifactId> 
     <version>${spark.version}</version> 
    </dependency> 
    <dependency> 
     <groupId>org.apache.spark</groupId> 
     <artifactId>spark-yarn_2.11</artifactId> 
     <version>${spark.version}</version> 
    </dependency>