Triggering on FileIO.toPath sink completion
I have an IO Source I'm multiplexing a file and handing off to another part of the system to execute like:
source.alsoTo(FileIO.toPath(path))
This is used for a cache, i.e. i'm writing a file passing through my system to a temporary cache location. Once the cache is written, I want to move it atomically to its final location.
The consumer of the source gets a Future and knows when it is done, but my side-channel writing to file to disk has no such facility that I can find. Is there some way of attaching a completion handler to a sink so that I can complete my manipulation of that file?
akka akka-stream
asked Nov 22 '18 at 19:30
Arne ClaassenArne Claassen
9,14335083
add a comment |
I have an IO Source I'm multiplexing a file and handing off to another part of the system to execute like:
source.alsoTo(FileIO.toPath(path))
This is used for a cache, i.e. i'm writing a file passing through my system to a temporary cache location. Once the cache is written, I want to move it atomically to its final location.
The consumer of the source gets a Future and knows when it is done, but my side-channel writing to file to disk has no such facility that I can find. Is there some way of attaching a completion handler to a sink so that I can complete my manipulation of that file?
akka akka-stream
asked Nov 22 '18 at 19:30
Arne ClaassenArne Claassen
9,14335083
add a comment |
I have an IO Source I'm multiplexing a file and handing off to another part of the system to execute like:
source.alsoTo(FileIO.toPath(path))
This is used for a cache, i.e. i'm writing a file passing through my system to a temporary cache location. Once the cache is written, I want to move it atomically to its final location.
The consumer of the source gets a Future and knows when it is done, but my side-channel writing to file to disk has no such facility that I can find. Is there some way of attaching a completion handler to a sink so that I can complete my manipulation of that file?
akka akka-stream
asked Nov 22 '18 at 19:30
Arne ClaassenArne Claassen
9,14335083
I have an IO Source I'm multiplexing a file and handing off to another part of the system to execute like:
source.alsoTo(FileIO.toPath(path))
This is used for a cache, i.e. i'm writing a file passing through my system to a temporary cache location. Once the cache is written, I want to move it atomically to its final location.
The consumer of the source gets a Future and knows when it is done, but my side-channel writing to file to disk has no such facility that I can find. Is there some way of attaching a completion handler to a sink so that I can complete my manipulation of that file?
akka akka-stream
akka akka-stream
asked Nov 22 '18 at 19:30
Arne ClaassenArne Claassen
9,14335083
asked Nov 22 '18 at 19:30
Arne ClaassenArne Claassen
9,14335083
asked Nov 22 '18 at 19:30
Arne ClaassenArne Claassen
9,14335083
asked Nov 22 '18 at 19:30
Arne ClaassenArne Claassen
9,14335083
asked Nov 22 '18 at 19:30
Arne ClaassenArne Claassen
9,14335083
9,14335083
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
Instead of alsoTo, use alsoToMat and mapMaterializedValue to access the materialized value of the file Sink:
val source: Source[ByteString, _] = ???
val cachedSource =
source
.alsoToMat(FileIO.toPath(path))(Keep.right)
.mapMaterializedValue { fileResult => // fileResult is a Future[IOResult]
// do something with fileResult
}
answered Nov 23 '18 at 13:38
Jeffrey ChungJeffrey Chung
14.3k62142
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53437098%2ftriggering-on-fileio-topath-sink-completion%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Instead of alsoTo, use alsoToMat and mapMaterializedValue to access the materialized value of the file Sink:
val source: Source[ByteString, _] = ???
val cachedSource =
source
.alsoToMat(FileIO.toPath(path))(Keep.right)
.mapMaterializedValue { fileResult => // fileResult is a Future[IOResult]
// do something with fileResult
}
answered Nov 23 '18 at 13:38
Jeffrey ChungJeffrey Chung
14.3k62142
add a comment |
Instead of alsoTo, use alsoToMat and mapMaterializedValue to access the materialized value of the file Sink:
val source: Source[ByteString, _] = ???
val cachedSource =
source
.alsoToMat(FileIO.toPath(path))(Keep.right)
.mapMaterializedValue { fileResult => // fileResult is a Future[IOResult]
// do something with fileResult
}
answered Nov 23 '18 at 13:38
Jeffrey ChungJeffrey Chung
14.3k62142
add a comment |
Instead of alsoTo, use alsoToMat and mapMaterializedValue to access the materialized value of the file Sink:
val source: Source[ByteString, _] = ???
val cachedSource =
source
.alsoToMat(FileIO.toPath(path))(Keep.right)
.mapMaterializedValue { fileResult => // fileResult is a Future[IOResult]
// do something with fileResult
}
answered Nov 23 '18 at 13:38
Jeffrey ChungJeffrey Chung
14.3k62142
Instead of alsoTo, use alsoToMat and mapMaterializedValue to access the materialized value of the file Sink:
val source: Source[ByteString, _] = ???
val cachedSource =
source
.alsoToMat(FileIO.toPath(path))(Keep.right)
.mapMaterializedValue { fileResult => // fileResult is a Future[IOResult]
// do something with fileResult
}
answered Nov 23 '18 at 13:38
Jeffrey ChungJeffrey Chung
14.3k62142
edited Nov 23 '18 at 23:46
answered Nov 23 '18 at 13:38
Jeffrey ChungJeffrey Chung
14.3k62142
answered Nov 23 '18 at 13:38
Jeffrey ChungJeffrey Chung
14.3k62142
answered Nov 23 '18 at 13:38
Jeffrey ChungJeffrey Chung
14.3k62142
14.3k62142
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53437098%2ftriggering-on-fileio-topath-sink-completion%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
