Clink is a library that provides infrastructure to do the following:
Furthermore, Clink provides an off-the-shelf library of reusable Feature Processing functions that can be executed as Java and C++ functions.
Clink is useful in the scenario where users want to do online feature processing with low latency (in sub-millisecond) in C++, apply the same logic to do offline feature processing in Java, and implement this logic only once (in C++).
Clink uses TFRT as the underlying execution engine and therefore follows TFRT's Operation System and installation requirements.
Currently supported operating systems are as follows:
Here are the prerequisites to build and install Clink:
Clink provides dockerfiles and pre-built docker images that satisfy the installation requirements listed above. You can use one of the following commands to build the docker image, according to the operating system you expect to use.
$ docker build -t ubuntu:16.04_clink -f docker/Dockerfile_ubuntu_1604 .
$ docker build -t centos:centos7.7.1908_clink -f docker/Dockerfile_centos_77 .
Or you can use one of the following commands to pull the pre-built Docker image from Docker Hub.
$ docker pull docker.io/flinkextended/clink:ubuntu16.04
$ docker pull docker.io/flinkextended/clink:centos7.7.1908
If you plan to set up the Clink environment without the docker images provided above, please check the TFRT README for more detailed instructions to install, configure and verify Bazel, Clang, and libstdc++8.
After setting up the environment according to the instructions above and pulling Clink repository, please use the following command to initialize submodules like TFRT before building any Clink target from source.
$ git submodule update --init --recursive
Users can execute Clink C++ function example in parallel in C++ using one of the following commands.
$ bazel run //:executor -- `pwd`/mlir_test/executor/basic.mlir --work_queue_type=mstd --host_allocator_type=malloc
Developers can run the following command to build all targets and to run all tests.
$ bazel test $(bazel query //...) -c dbg
Changes to Clink C++ code should conform to Google C++ Style Guide.
Clink uses ClangFormat to check C++ code, diffplug/spotless to check java code, and Buildifier to check bazel code.
Please run the following command to format codes before uploading PRs for review.
$ ./tools/format-code.sh
Clink provides maven configuration that allows users to view or edit java code with IDEs like IntelliJ IDEA. Before IDEs can correctly compile java project, users need to run the following commands after setting up Clink repo and build Clink.
$ bazel build //:clink_java_proto
$ cp bazel-bin/libclink_proto-speed.jar java-lib/lib/
Then users can open java-lib
directory with their IDEs.
此处可能存在不合适展示的内容,页面不予展示。您可通过相关编辑功能自查并修改。
如您确认内容无涉及 不当用语 / 纯广告导流 / 暴力 / 低俗色情 / 侵权 / 盗版 / 虚假 / 无价值内容或违法国家有关法律法规的内容,可点击提交进行申诉,我们将尽快为您处理。