Server
Documentation Install now

Get the AI Server Running Anywhere
in Seconds

# Setup server architecture
export ARCH=cpu # gpu also available

Setup models directory


export MODELS=/path/to/models


Pull the docker image


docker pull docker.jolibrain.com/deepdetect_${ARCH}


Start the AI server


docker run -d -u $(id -u ${USER}):$(id -g ${USER}) -v ${MODELS}:/opt/models -p 8080:8080 docker.jolibrain.com/deepdetect_${ARCH}
curl -X GET http://localhost:8080/info


Output


{
“head”: {
“branch”: “master”,
“commit”: “15c577976ae920fb71973d2f5686c9fdd12716bc”,
“method”: “/info”,
“services”: [],
“version”: “0.1”
},
“status”: {
“code”: 200,
“msg”: “OK”
}
}

Comes in many flavors

Spin a server up on Cloud, Desktop and embedded devices alike

PyTorch
TensorRT
Support for PyTorch and TensorRT Backends
Train and serve models with PyTorch, then optimize NVIDIA GPU inference with TensorRT.
Heterogeneous Data Sources
  • CSV pre-processing
  • On-the-fly data augmentation for images
  • Audio spectrograms
  • BoW and character-based text inputs
Music Photo File
CSV Timeseries

Seamless Integration into Real-World Applications

JSON in / JSON out with built-in Mustache output templates

JSON in / JSON out

Send JSON messages from within your applications, use the JSON output programmatically.

Mustache templating allows shaping the output to fit any sink application (e.g. Elasticsearch, …).

# Send an image over for processing
curl -X POST 'http://localhost:8080/predict' -d '{
  "service": "detection_600",
  "parameters": {
    "output": {
      "confidence_threshold": 0.3,
      "bbox": true
    },
    "mllib": {
      "gpu": true
    }
  },
  "data": [
    "/data/example.jpg"
  ]
}'

{
  "status": {
    "code": 200,
    "msg": "OK"
  },
  "head": {
    "method": "/predict",
    "service": "detection_600",
    "time": 60
  },
  "body": {
    "predictions": [
      {
        "classes": [
          {
            "prob": 0.8248323798179626,
            "bbox": {
              "xmax": 487.2122497558594,
              "ymax": 351.72113037109375,
              "ymin": 521.0411376953125,
              "xmin": 301.8126220703125
            },
            "cat": "Car"
          }        ],
        "uri": "/data/example.jpg"
      }
    ]
  }
}

Pure C++ for best Performances

Uncompromised Performances on GPU and CPU

From Cloud to Desktop and Edge, the best in-production performances. Full C++-11 Open Source server eases deployment with top performances from virtual to bare-metal.