IAP GITLAB

Skip to content
Snippets Groups Projects
Commit 035b9a5b authored by Dominik Haunß's avatar Dominik Haunß
Browse files

Merge branch 'master' of gitlab.ikp.kit.edu:dhaunss/grpc-only-cpp-client-

parents 60c587e8 8367af8a
No related branches found
No related tags found
No related merge requests found
# gRPC only cpp client
using only grpc to create a client, to communicate with tensorflow_serving container
\ No newline at end of file
Using only grpc to communicate with tensorflow_serving container.
inspired by https://stackoverflow.com/questions/55033952/grpc-only-tensorflow-serving-client-in-c
To use this u need to install:
grpcio ,
grpcio_tools
to Create DockerImage to serve model use:
docker run -d --name serving_base tensorflow/serving
and copy Model into the container by:
docker cp models/<my model> serving_base:/models/<my model>
inside container run:
tensorflow_model_server --port=8500 --rest_api_port=8501 --model_name=best_model --model_base_path=/models/best_model
to run the model server.
To check the variables and signature of your model run:
saved_model_cli show --dir models/best_model/1 --all
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment