Spark/Scala kernel failing on Jupyter due to Java error
I've been using the Spark/Scala kernel on Jupyter (I'm not sure which version/how to check since it's not listed in jupyter kernelspec list).
All of a sudden, it stopped working. Poking around a bit, I've found an error preventing the kernel from initiating:
Exception in thread "main" java.lang.UnsupportedClassVersionError: com/typesafe/config/ConfigMergeable : Unsupported major.minor version 52.0
I've seen several threads trying to address this issue (1, 2, 3, 4), but I don't follow them at all / how to apply suggested solutions to my situation.
It appears there's some sort of version mismatch somewhere inside how the kernel's working, but I don't know how to figure out where the mismatch is / how to fix it. I've looked at the following, but don't see (or know how to diagnose, really) any inconsistency:
printenv | grep "JAVA"
# JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64
java -version
# java version "1.7.0_131"
# OpenJDK Runtime Environment (IcedTea 2.6.9) (7u131-2.6.9-0ubuntu0.14.04.2)
# OpenJDK 64-Bit Server VM (build 24.131-b00, mixed mode)
javac -version
# javac 1.7.0_131
This is being run on a remote machine, so I only have terminal access to diagnose / fix the problem.
java scala ubuntu apache-spark jupyter-notebook
add a comment |
I've been using the Spark/Scala kernel on Jupyter (I'm not sure which version/how to check since it's not listed in jupyter kernelspec list).
All of a sudden, it stopped working. Poking around a bit, I've found an error preventing the kernel from initiating:
Exception in thread "main" java.lang.UnsupportedClassVersionError: com/typesafe/config/ConfigMergeable : Unsupported major.minor version 52.0
I've seen several threads trying to address this issue (1, 2, 3, 4), but I don't follow them at all / how to apply suggested solutions to my situation.
It appears there's some sort of version mismatch somewhere inside how the kernel's working, but I don't know how to figure out where the mismatch is / how to fix it. I've looked at the following, but don't see (or know how to diagnose, really) any inconsistency:
printenv | grep "JAVA"
# JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64
java -version
# java version "1.7.0_131"
# OpenJDK Runtime Environment (IcedTea 2.6.9) (7u131-2.6.9-0ubuntu0.14.04.2)
# OpenJDK 64-Bit Server VM (build 24.131-b00, mixed mode)
javac -version
# javac 1.7.0_131
This is being run on a remote machine, so I only have terminal access to diagnose / fix the problem.
java scala ubuntu apache-spark jupyter-notebook
add a comment |
I've been using the Spark/Scala kernel on Jupyter (I'm not sure which version/how to check since it's not listed in jupyter kernelspec list).
All of a sudden, it stopped working. Poking around a bit, I've found an error preventing the kernel from initiating:
Exception in thread "main" java.lang.UnsupportedClassVersionError: com/typesafe/config/ConfigMergeable : Unsupported major.minor version 52.0
I've seen several threads trying to address this issue (1, 2, 3, 4), but I don't follow them at all / how to apply suggested solutions to my situation.
It appears there's some sort of version mismatch somewhere inside how the kernel's working, but I don't know how to figure out where the mismatch is / how to fix it. I've looked at the following, but don't see (or know how to diagnose, really) any inconsistency:
printenv | grep "JAVA"
# JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64
java -version
# java version "1.7.0_131"
# OpenJDK Runtime Environment (IcedTea 2.6.9) (7u131-2.6.9-0ubuntu0.14.04.2)
# OpenJDK 64-Bit Server VM (build 24.131-b00, mixed mode)
javac -version
# javac 1.7.0_131
This is being run on a remote machine, so I only have terminal access to diagnose / fix the problem.
java scala ubuntu apache-spark jupyter-notebook
I've been using the Spark/Scala kernel on Jupyter (I'm not sure which version/how to check since it's not listed in jupyter kernelspec list).
All of a sudden, it stopped working. Poking around a bit, I've found an error preventing the kernel from initiating:
Exception in thread "main" java.lang.UnsupportedClassVersionError: com/typesafe/config/ConfigMergeable : Unsupported major.minor version 52.0
I've seen several threads trying to address this issue (1, 2, 3, 4), but I don't follow them at all / how to apply suggested solutions to my situation.
It appears there's some sort of version mismatch somewhere inside how the kernel's working, but I don't know how to figure out where the mismatch is / how to fix it. I've looked at the following, but don't see (or know how to diagnose, really) any inconsistency:
printenv | grep "JAVA"
# JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64
java -version
# java version "1.7.0_131"
# OpenJDK Runtime Environment (IcedTea 2.6.9) (7u131-2.6.9-0ubuntu0.14.04.2)
# OpenJDK 64-Bit Server VM (build 24.131-b00, mixed mode)
javac -version
# javac 1.7.0_131
This is being run on a remote machine, so I only have terminal access to diagnose / fix the problem.
java scala ubuntu apache-spark jupyter-notebook
java scala ubuntu apache-spark jupyter-notebook
asked Jul 27 '17 at 22:13
MichaelChirico
19.7k859109
19.7k859109
add a comment |
add a comment |
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f45361879%2fspark-scala-kernel-failing-on-jupyter-due-to-java-error%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f45361879%2fspark-scala-kernel-failing-on-jupyter-due-to-java-error%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown