Elasticsearch spend 80% time in build_scorer
We have upgraded our ES from ES-2.3 to ES-6.4. So we have done reindexing of all our indexes.
Now while running the query to new elasticsearch, we got performance with such queries :
{
"_source": false,
"query": {
"bool": {
"filter": {
"bool": {
"must": [
{
"range": {
"visitTime": {
"gte": "2018-07-18T18:30:00"
}
}
}
],
"must_not": [
{
"exists": {
"field": "source"
}
}
]
}
}
}
}
}
So my question is why ES query taking much time in build_scorer ????
When running the same query in ES 2.3, take much less time.
elasticsearch
edited Nov 21 '18 at 13:03
Dave
2,23151625
asked Nov 21 '18 at 12:32
Praveen kumar singhalPraveen kumar singhal
64
add a comment |
We have upgraded our ES from ES-2.3 to ES-6.4. So we have done reindexing of all our indexes.
Now while running the query to new elasticsearch, we got performance with such queries :
{
"_source": false,
"query": {
"bool": {
"filter": {
"bool": {
"must": [
{
"range": {
"visitTime": {
"gte": "2018-07-18T18:30:00"
}
}
}
],
"must_not": [
{
"exists": {
"field": "source"
}
}
]
}
}
}
}
}
So my question is why ES query taking much time in build_scorer ????
When running the same query in ES 2.3, take much less time.
elasticsearch
edited Nov 21 '18 at 13:03
Dave
2,23151625
asked Nov 21 '18 at 12:32
Praveen kumar singhalPraveen kumar singhal
64
You should simply replacemustwithfilter
– Val
Nov 21 '18 at 12:34
tried, no gain in performance. when I am viewing elasticsearch log, found out this line "not opting out of the query cache; authorization is not allowed" I done understand what this means ?
– Praveen kumar singhal
Nov 22 '18 at 17:18
add a comment |
We have upgraded our ES from ES-2.3 to ES-6.4. So we have done reindexing of all our indexes.
Now while running the query to new elasticsearch, we got performance with such queries :
{
"_source": false,
"query": {
"bool": {
"filter": {
"bool": {
"must": [
{
"range": {
"visitTime": {
"gte": "2018-07-18T18:30:00"
}
}
}
],
"must_not": [
{
"exists": {
"field": "source"
}
}
]
}
}
}
}
}
So my question is why ES query taking much time in build_scorer ????
When running the same query in ES 2.3, take much less time.
elasticsearch
edited Nov 21 '18 at 13:03
Dave
2,23151625
asked Nov 21 '18 at 12:32
Praveen kumar singhalPraveen kumar singhal
64
We have upgraded our ES from ES-2.3 to ES-6.4. So we have done reindexing of all our indexes.
Now while running the query to new elasticsearch, we got performance with such queries :
{
"_source": false,
"query": {
"bool": {
"filter": {
"bool": {
"must": [
{
"range": {
"visitTime": {
"gte": "2018-07-18T18:30:00"
}
}
}
],
"must_not": [
{
"exists": {
"field": "source"
}
}
]
}
}
}
}
}
So my question is why ES query taking much time in build_scorer ????
When running the same query in ES 2.3, take much less time.
elasticsearch
elasticsearch
edited Nov 21 '18 at 13:03
Dave
2,23151625
asked Nov 21 '18 at 12:32
Praveen kumar singhalPraveen kumar singhal
64
edited Nov 21 '18 at 13:03
Dave
2,23151625
asked Nov 21 '18 at 12:32
Praveen kumar singhalPraveen kumar singhal
64
edited Nov 21 '18 at 13:03
Dave
2,23151625
edited Nov 21 '18 at 13:03
Dave
2,23151625
edited Nov 21 '18 at 13:03
Dave
2,23151625
2,23151625
asked Nov 21 '18 at 12:32
Praveen kumar singhalPraveen kumar singhal
64
asked Nov 21 '18 at 12:32
Praveen kumar singhalPraveen kumar singhal
64
asked Nov 21 '18 at 12:32
Praveen kumar singhalPraveen kumar singhal
64
64
You should simply replacemustwithfilter
– Val
Nov 21 '18 at 12:34
tried, no gain in performance. when I am viewing elasticsearch log, found out this line "not opting out of the query cache; authorization is not allowed" I done understand what this means ?
– Praveen kumar singhal
Nov 22 '18 at 17:18
add a comment |
You should simply replacemustwithfilter
– Val
Nov 21 '18 at 12:34
tried, no gain in performance. when I am viewing elasticsearch log, found out this line "not opting out of the query cache; authorization is not allowed" I done understand what this means ?
– Praveen kumar singhal
Nov 22 '18 at 17:18
You should simply replace
must with filter– Val
Nov 21 '18 at 12:34
You should simply replace
must with filter– Val
Nov 21 '18 at 12:34
tried, no gain in performance. when I am viewing elasticsearch log, found out this line "not opting out of the query cache; authorization is not allowed" I done understand what this means ?
– Praveen kumar singhal
Nov 22 '18 at 17:18
tried, no gain in performance. when I am viewing elasticsearch log, found out this line "not opting out of the query cache; authorization is not allowed" I done understand what this means ?
– Praveen kumar singhal
Nov 22 '18 at 17:18
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53412115%2felasticsearch-spend-80-time-in-build-scorer%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53412115%2felasticsearch-spend-80-time-in-build-scorer%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
You should simply replace
mustwithfilter– Val
Nov 21 '18 at 12:34
tried, no gain in performance. when I am viewing elasticsearch log, found out this line "not opting out of the query cache; authorization is not allowed" I done understand what this means ?
– Praveen kumar singhal
Nov 22 '18 at 17:18