Hi
I hope you are well.
While following this tutorial
https://mahout.apache.org/users/sparkbindings/play-with-shell.html
I ran into some problems.
At point 4. of "Starting Mahout's Spark shell", executing `bin/mahout
spark-shell` returns
Error: Could not find or load main class
org.apache.mahout.sparkbindings.shell.Main
so I had a look at classes folder's tree and ./bin/mahout's source code.
vagrant [ at ] vagrant-ubuntu-trusty-64:~/tl/mahout$ ls -l
$MAHOUT_HOME/spark-shell/target/
total 40
drwxrwxr-x 3 vagrant vagrant 4096 Aug 13 11:18 classes
-rw-rw-r-- 1 vagrant vagrant 1 Aug 13 11:18 classes.timestamp
-rw-rw-r-- 1 vagrant vagrant 3014 Aug 13 11:18
mahout-spark-shell_2.10-1.0-SNAPSHOT-sources.jar
-rw-rw-r-- 1 vagrant vagrant 3132 Aug 13 11:18
mahout-spark-shell_2.10-1.0-SNAPSHOT-tests.jar
-rw-rw-r-- 1 vagrant vagrant 14136 Aug 13 11:18
mahout-spark-shell_2.10-1.0-SNAPSHOT.jar
drwxrwxr-x 2 vagrant vagrant 4096 Aug 13 11:18 maven-archiver
drwxrwxr-x 2 vagrant vagrant 4096 Aug 13 11:18 test-classes
while line 180 in ./bin/mahout reads
for f in $MAHOUT_HOME/spark-shell/target/mahout-spark-shell-*.jar ; do
Now, by applying the following diff
diff --git a/bin/mahout b/bin/mahout
index 5f54181..a6f4ba8 100755
--- a/bin/mahout
+++ b/bin/mahout
@@ -177,7 +177,7 @@ then
CLASSPATH=${CLASSPATH}:$f;
done
- for f in $MAHOUT_HOME/spark-shell/target/mahout-spark-shell-*.jar ; do
+ for f in $MAHOUT_HOME/spark-shell/target/mahout-spark-shell_*.jar ; do
CLASSPATH=${CLASSPATH}:$f;
done
I'm now able to get to mahout's shell after running `./bin/mahout
spark-shell`, but I get the following errors
Using Scala version 2.10.3 (OpenJDK 64-Bit Server VM, Java 1.7.0_55)
Type in expressions to have them evaluated.
Type :help for more information.
<console>:9: error: object drm is not a member of package
org.apache.mahout.math
@transient implicit val sdc:
org.apache.mahout.math.drm.DistributedContext =
<console>:10: error: type SparkDistributedContext is not a member of
package org.apache.mahout.sparkbindings
new
org.apache.mahout.sparkbindings.SparkDistributedContext(
Mahout distributed context is available as "implicit val sdc".
<console>:13: error: not found: value scalabindings
import scalabindings._
<console>:13: error: not found: value RLikeOps
import RLikeOps._
<console>:13: error: not found: value drm
import drm._
<console>:13: error: not found: value RLikeDrmOps
import RLikeDrmOps._
Has anyone any idea of what's going on/wrong? Any hints on what I'm doing
wrong or how I could fix this?
Thanks in advance, and thanks for the awesome project.
Looking forward to participate.
Regards
Andrea
I hope you are well.
While following this tutorial
https://mahout.apache.org/users/sparkbindings/play-with-shell.html
I ran into some problems.
At point 4. of "Starting Mahout's Spark shell", executing `bin/mahout
spark-shell` returns
Error: Could not find or load main class
org.apache.mahout.sparkbindings.shell.Main
so I had a look at classes folder's tree and ./bin/mahout's source code.
vagrant [ at ] vagrant-ubuntu-trusty-64:~/tl/mahout$ ls -l
$MAHOUT_HOME/spark-shell/target/
total 40
drwxrwxr-x 3 vagrant vagrant 4096 Aug 13 11:18 classes
-rw-rw-r-- 1 vagrant vagrant 1 Aug 13 11:18 classes.timestamp
-rw-rw-r-- 1 vagrant vagrant 3014 Aug 13 11:18
mahout-spark-shell_2.10-1.0-SNAPSHOT-sources.jar
-rw-rw-r-- 1 vagrant vagrant 3132 Aug 13 11:18
mahout-spark-shell_2.10-1.0-SNAPSHOT-tests.jar
-rw-rw-r-- 1 vagrant vagrant 14136 Aug 13 11:18
mahout-spark-shell_2.10-1.0-SNAPSHOT.jar
drwxrwxr-x 2 vagrant vagrant 4096 Aug 13 11:18 maven-archiver
drwxrwxr-x 2 vagrant vagrant 4096 Aug 13 11:18 test-classes
while line 180 in ./bin/mahout reads
for f in $MAHOUT_HOME/spark-shell/target/mahout-spark-shell-*.jar ; do
Now, by applying the following diff
diff --git a/bin/mahout b/bin/mahout
index 5f54181..a6f4ba8 100755
--- a/bin/mahout
+++ b/bin/mahout
@@ -177,7 +177,7 @@ then
CLASSPATH=${CLASSPATH}:$f;
done
- for f in $MAHOUT_HOME/spark-shell/target/mahout-spark-shell-*.jar ; do
+ for f in $MAHOUT_HOME/spark-shell/target/mahout-spark-shell_*.jar ; do
CLASSPATH=${CLASSPATH}:$f;
done
I'm now able to get to mahout's shell after running `./bin/mahout
spark-shell`, but I get the following errors
Using Scala version 2.10.3 (OpenJDK 64-Bit Server VM, Java 1.7.0_55)
Type in expressions to have them evaluated.
Type :help for more information.
<console>:9: error: object drm is not a member of package
org.apache.mahout.math
@transient implicit val sdc:
org.apache.mahout.math.drm.DistributedContext =
<console>:10: error: type SparkDistributedContext is not a member of
package org.apache.mahout.sparkbindings
new
org.apache.mahout.sparkbindings.SparkDistributedContext(
Mahout distributed context is available as "implicit val sdc".
<console>:13: error: not found: value scalabindings
import scalabindings._
<console>:13: error: not found: value RLikeOps
import RLikeOps._
<console>:13: error: not found: value drm
import drm._
<console>:13: error: not found: value RLikeDrmOps
import RLikeDrmOps._
Has anyone any idea of what's going on/wrong? Any hints on what I'm doing
wrong or how I could fix this?
Thanks in advance, and thanks for the awesome project.
Looking forward to participate.
Regards
Andrea