Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wrapped Napi-extracted functions into C++ shared_ptr<>-s for easier lifetime management. #182

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
158 changes: 158 additions & 0 deletions thread_safe_function_counting_wrapped/node-addon-api/addon.cc
Original file line number Diff line number Diff line change
@@ -0,0 +1,158 @@
#include <chrono>
#include <functional>
#include <thread>

#include "napi.h"

template <class T>
struct ExtractJSFunctionImpl;

class NodeJSContext final {
private:
struct Impl final {
Napi::Env env_;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We really don't recommend storing the Napi::Env. You can access it from promise_.Env()

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good point, thanks, C5T/Current#904.

Napi::Promise::Deferred promise_;
std::vector<std::thread> threads_;

explicit Impl(Napi::Env env) : env_(env), promise_(Napi::Promise::Deferred::New(env)) {}

~Impl() {
for (std::thread& t : threads_) {
t.join();
}
// NOTE(dkorolev): This promise can be set to something other than `true`.
promise_.Resolve(Napi::Boolean::New(env_, true));
}
};
std::shared_ptr<Impl> impl_;

public:
explicit NodeJSContext(Napi::Env env) : impl_(std::make_shared<Impl>(env)) {}
explicit NodeJSContext(const Napi::CallbackInfo& info) : NodeJSContext(info.Env()) {}

template <typename T>
typename ExtractJSFunctionImpl<T>::retval_t ExtractJSFunction(T f) {
return ExtractJSFunctionImpl<T>::DoIt(*this, f);
}

void RunAsync(std::function<void()> f) { impl_->threads_.emplace_back(f); }

Napi::Env GetEnv() const { return impl_->env_; }
Napi::Value GetPromise() const { return impl_->promise_.Promise(); }
};

template <class TUPLE, size_t I, size_t N>
struct ArgsPopulator final {
static void DoIt(Napi::Env env, const TUPLE& input, std::vector<napi_value>& output) {
PopulateArg(env, std::get<I>(input), output[I]);
ArgsPopulator<TUPLE, I + 1u, N>::DoIt(env, input, output);
}
static void PopulateArg(Napi::Env env, int input, napi_value& output) { output = Napi::Number::New(env, input); }
static void PopulateArg(Napi::Env env, const std::string& input, napi_value& output) { output = Napi::String::New(env, input); }
// NOTE(dkorolev): Add more type wrappers or find the right way to do it within Napi.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"the right way" ... perhaps something that uses Value::From:

  template <typename ValueType>
  static void PopulateArg(Napi::Env env, ValueType input, napi_value& output) { output = Napi::Value::From(env, input); }

};

template <class TUPLE, size_t N>
struct ArgsPopulator<TUPLE, N, N> final {
static void DoIt(Napi::Env, const TUPLE&, std::vector<napi_value>&) {}
};

class NodeJSFunction final {
private:
struct Impl final {
// The `NodeJSContext` is captured into `std::shared_ptr<NodeJSFunction::Impl>`, to ensure proper cleanup order.
NodeJSContext context_;
Napi::ThreadSafeFunction function_;

Impl(NodeJSContext context, Napi::Function jsf)
: context_(context),
function_(Napi::ThreadSafeFunction::New(
context_.GetEnv(),
jsf,
"dkorolev_cpp_callaback",
0, // Max queue size (0 = unlimited).
1, // Initial thread count.
static_cast<void*>(nullptr),
[context](Napi::Env, void*, void*) {
// NOTE(dkorolev): The *IMPORTANT* part is to capture `context` by value here.
// If this is not done, the reference counter for the very `NodeJSContext` would drop to zero,
// the functions will get called, but the cleanup would fail, crashing the application.
},
reinterpret_cast<int*>(0))) {}
~Impl() {
// NOTE(dkorolev): This `.Release()` would eventually call the finalization lambda, which, in its turn,
// would release the captured-by-copy `context`, ensuring the cleanup is happening as it should,
// first the captured functions, then by joining the async threads, and finally by setting the promise.
function_.Release();
}
};
std::shared_ptr<Impl> impl_;

public:
NodeJSFunction(NodeJSContext context, Napi::Function fun) : impl_(std::make_shared<Impl>(context, fun)) {}

template <typename... ARGS>
void operator()(ARGS&&... args) const {
auto args_as_tuple_to_copy = std::make_tuple(std::forward<ARGS>(args)...);
if (impl_->function_.BlockingCall(
reinterpret_cast<int*>(0), [args_as_tuple_to_copy](Napi::Env env, Napi::Function jsf, int*) {
std::vector<napi_value> params;
using tuple_t = decltype(args_as_tuple_to_copy);
params.resize(std::tuple_size<tuple_t>::value);
ArgsPopulator<tuple_t, 0, std::tuple_size<tuple_t>::value>::DoIt(env, args_as_tuple_to_copy, params);
jsf.Call(params);
// TODO(dkorolev): Process the return value as needed.
Comment on lines +99 to +104
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very neat implementation of "automagically" casting the C++ types to respective Napi::Values.

You mention "process the return value". Currently the operator() returns void, so yes, the caller (eg. f_odd(1,"one") in your example) has no way of processing the return value of the JavaScript side.

The problem is that this is done asynchronously, so we can't return the immediate value. What about using an std::promise<Napi::Value> from the return value of jsf.Call()...? Just throwing some ideas out.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi Kevin!

Thanks for chiming in! I've refactored the code since, you may find this and this more complete.

On a grander scheme of things, I'm looking into tighter C++ <=> V8 coupling these days, both in my day job and as a pet project, and would be glad to be of help if we could join our efforts. There's an open problem we have right now (can't create a JavaScript object with several wrapped C++ functions as the fields of this JSON object without these fuctions being garbage-collected), and I'm looking forward to finding the time to take a deeper look.

Thanks,
Dima

}) != napi_ok) {
Napi::Error::Fatal("NAPI", "`Napi::ThreadSafeNapi::Function.BlockingCall() != napi_ok`.");
}
}
};

template <>
struct ExtractJSFunctionImpl<Napi::Function> {
using retval_t = NodeJSFunction;
static NodeJSFunction DoIt(NodeJSContext self, Napi::Function js_function) {
return NodeJSFunction(self, js_function);
}
};

template <>
struct ExtractJSFunctionImpl<Napi::Value> {
using retval_t = NodeJSFunction;
static NodeJSFunction DoIt(NodeJSContext self, Napi::Value js_function) {
return NodeJSFunction(self, js_function.As<Napi::Function>());
}
};

Napi::Value RunAsyncWork(const Napi::CallbackInfo& cbinfo) {
// Create the context that would manage the lifetime of the extracted JS functions, to `.Release()` them later.
NodeJSContext ctx(cbinfo);

// Create the captured functions before starting the async thread, as the very `cbinfo` is a const reference.
NodeJSFunction f_even = ctx.ExtractJSFunction(cbinfo[0]);
NodeJSFunction f_odd = ctx.ExtractJSFunction(cbinfo[1]);

// Run the C++ code asynchronously.
ctx.RunAsync([f_even, f_odd]() {
// NOTE(dkorolev): It is *IMPORTANT* to capture `f_{even,odd}` by value, so that their refcounts are incremented.
struct IntString final { int i; std::string s; };
for (IntString& value : std::vector<IntString>({{1, "one"}, {2, "two"}, {3, "three"}, {4, "four"}, {5 ,"five"}})) {
((value.i % 2 == 0) ? f_even : f_odd)(value.i, value.s);
std::this_thread::sleep_for(std::chrono::milliseconds(500));
}
});

// This `return` would return the promise immediately, as the "business logic" is run in a dedicated thread.
return ctx.GetPromise();

// The very `NodeJSContext ctx` would be released after the extracted functions are released,
// and the extracted functions will be released when they have no users left.
// The TL;DR is that as long as they are copied, not captured by reference, everything would work correctly.
}

Napi::Object Init(Napi::Env env, Napi::Object exports) {
exports["runAsyncWork"] = Napi::Function::New(env, RunAsyncWork);
return exports;
}

NODE_API_MODULE(addon, Init)
9 changes: 9 additions & 0 deletions thread_safe_function_counting_wrapped/node-addon-api/addon.js
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
const { runAsyncWork } = require('bindings')('addon');

console.log('RunAsyncWork(): calling the C++ function.');
const promise = runAsyncWork(
(i, s) => { console.log(`Callback from C++: even ${s}=${i}.`); },
(i, s) => { console.log(`Callback from C++: odd ${s}=${i}.`); }
);
console.log('RunAsyncWork(): the promise is returned from C++.');
promise.then((value) => { console.log(`RunAsyncWork(): the promise resolved, from C++, to ${value}.`); });
21 changes: 21 additions & 0 deletions thread_safe_function_counting_wrapped/node-addon-api/binding.gyp
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
{
'targets': [{
'target_name': 'addon',
'defines': ['V8_DEPRECATION_WARNINGS=1'],
'sources': ['addon.cc'],
'include_dirs': ["<!@(node -p \"require('node-addon-api').include\")"],
'dependencies': ["<!(node -p \"require('node-addon-api').gyp\")"],
'cflags!': ['-fno-exceptions'],
'cflags_cc!': ['-fno-exceptions'],
'xcode_settings': {
'GCC_ENABLE_CPP_EXCEPTIONS': 'YES',
'CLANG_CXX_LIBRARY': 'libc++',
'MACOSX_DEPLOYMENT_TARGET': '10.7',
},
'msvs_settings': {
'VCCLCompilerTool': {
'ExceptionHandling': 1
},
},
}]
}
15 changes: 15 additions & 0 deletions thread_safe_function_counting_wrapped/node-addon-api/package.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
{
"name": "tsfn-counting",
"version": "0.0.0",
"description": "Thread-safe Function Example",
"main": "addon.js",
"private": true,
"gypfile": true,
"dependencies": {
"node-addon-api": "*",
"bindings": "*"
},
"engines": {
"node": ">= 10.16.0"
}
}