Analytics Zoo Open-Source Big Data AI platform

My contribution:

• Supported multi-model front-end HTTP serving to serve different models with single front-end Scala service
• Introduced the support of local inference model serving that cloud be up to 9 times faster than cluster serving
• Implemented front-end gRPC serving with java-grpc library to provide users a new option and improve speeds for roughly 20% comparing with HTTP serving

Project Github Repo: https://github.com/intel-analytics/analytics-zoo